-- Logs begin at Tue 2022-05-17 13:42:01 UTC, end at Tue 2022-05-17 15:00:51 UTC. -- May 17 14:16:37.916162 dv-cinder-835881-12-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 17 14:16:37.925411 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 17 14:16:37.928276 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 14:16:37 2022] *** May 17 14:16:37.928425 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 14:16:37.928532 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 14:16:37.928634 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: nodename: dv-cinder-835881-12-iscsi May 17 14:16:37.928720 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: machine: x86_64 May 17 14:16:37.928821 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: clock source: unix May 17 14:16:37.928920 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: pcre jit disabled May 17 14:16:37.929024 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: detected number of CPU cores: 4 May 17 14:16:37.929125 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: current working directory: / May 17 14:16:37.929223 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: detected binary path: /usr/bin/uwsgi-core May 17 14:16:37.929327 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: your processes number limit is 47680 May 17 14:16:37.929427 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: your memory page size is 4096 bytes May 17 14:16:37.929527 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: detected max file descriptor number: 2048 May 17 14:16:37.929649 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: lock engine: pthread robust mutexes May 17 14:16:37.929894 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: thunder lock: enabled May 17 14:16:37.930206 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 17 14:16:37.930379 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 14:16:37.985981 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: Python main interpreter initialized at 0x5645b76af9c0 May 17 14:16:37.985981 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: python threads support enabled May 17 14:16:37.985981 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: your server socket listen backlog is limited to 100 connections May 17 14:16:37.985981 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: your mercy for graceful operations on workers is 90 seconds May 17 14:16:37.986387 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: mapped 403077 bytes (393 KB) for 2 cores May 17 14:16:37.986450 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: *** Operational MODE: preforking *** May 17 14:16:37.986710 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: *** uWSGI is running in multiple interpreter mode *** May 17 14:16:37.986710 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: spawned uWSGI master process (pid: 79863) May 17 14:16:37.986923 dv-cinder-835881-12-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 17 14:16:37.987786 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: spawned uWSGI worker 1 (pid: 79877, cores: 1) May 17 14:16:37.988047 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: spawned uWSGI worker 2 (pid: 79878, cores: 1) May 17 14:16:37.988204 dv-cinder-835881-12-iscsi devstack@keystone.service[79863]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 14:16:43.772050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 14:16:43.772050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: from cryptography.utils import int_from_bytes May 17 14:16:43.773326 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 14:16:43.773326 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: from cryptography.utils import int_from_bytes May 17 14:16:43.776219 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 14:16:43.776219 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: from cryptography.utils import int_from_bytes May 17 14:16:43.777597 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 14:16:43.777597 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: from cryptography.utils import int_from_bytes May 17 14:16:43.822146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 14:16:43.822341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 14:16:43.822532 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] command line args: [] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 14:16:43.822793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 14:16:43.822957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ================================================================================ {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 14:16:43.823211 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] admin_token = **** {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.823452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] config_dir = [] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.823634 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.823810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] config_source = [] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.823984 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] debug = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.824178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.826428 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 14:16:43.826428 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 14:16:43.826547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.826617 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] command line args: [] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 14:16:43.826689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.826748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 14:16:43.826804 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.826860 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ================================================================================ {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 14:16:43.826916 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.827043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] admin_token = **** {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.827680 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] list_limit = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.827853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] config_dir = [] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.828269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] log_config_append = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.828269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.828384 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.828449 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] log_dir = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.828523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] config_source = [] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.828582 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] log_file = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.828643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] debug = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.828701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.828757 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.828846 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.828906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.828906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829142 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829210 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] list_limit = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829505 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] log_config_append = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829568 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829641 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829760 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] log_dir = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829760 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] log_file = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.829943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.830006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.830006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.830112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.830783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.831011 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.831502 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.831669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.831669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.832046 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.832244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.832244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.832629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.832828 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.833070 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] publish_errors = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.833237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.833429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.833624 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.833824 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.833824 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.834250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.834250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.834621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.834621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.834990 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.835178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] standard_threads = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.835402 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.835574 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.835773 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.835937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.835937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.835937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] use_journal = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.836421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.836587 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] use_json = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.836750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] publish_errors = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.836887 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] use_stderr = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.837014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.837141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] use_syslog = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.837273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.837400 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.837527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.837664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.837799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.837932 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.838059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.838243 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.838385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] standard_threads = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.838522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.838656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.838784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.838910 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.839036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.839162 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.839162 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] use_journal = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.839417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.839544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] use_json = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.839669 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.839801 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] use_stderr = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.839929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.840073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] use_syslog = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.840201 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.840334 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 14:16:43.840466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.840593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.840793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.840924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.841057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.841184 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.841310 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.841436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.841570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.841697 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.841834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.841969 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.842096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.842263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.842405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.842535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.843065 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.843228 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.843367 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.843496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.843646 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.843777 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.843904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.844032 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.844173 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.844307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.844446 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.844574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.844700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.844834 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.844968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.845097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.845236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.845364 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.845491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.845618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.845744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.845881 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.846019 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.846148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.846340 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.846469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.846595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.846721 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.846859 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.846987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.847114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.847241 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.847374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.847374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.847699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.847830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.847957 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.848084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.848210 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.848344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.848479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.848479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.848719 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.848845 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.848970 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.849096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.849230 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.849357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.849494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.849621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.849748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.849886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.850014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.850147 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.850304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.850304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.850546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.850683 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.850811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.850937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.851070 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.852298 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.852511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.852722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.852889 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.853081 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.853277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.853503 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.853669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.853897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.854065 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.854323 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.854486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.854678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.854868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.855113 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.855285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.855543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.855743 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.855943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.856109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.856336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.856502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.856697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.856889 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.857086 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.857318 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.857516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.857666 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.857838 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.857971 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.858105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.858734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.859017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.859179 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.859313 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.859450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.859580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.859707 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.859836 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.859964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.860100 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.860246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.860246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.860533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.860662 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.860798 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.860928 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.861055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.861182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.861321 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.861450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.861578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.861718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.861850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.861988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.862116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.862278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.862408 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.862551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.862680 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.862814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.863012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.863150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.863278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.863421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.863555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.863683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.863816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.863955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.864083 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.864284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.864415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.864543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.864670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.864804 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.864943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.865079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.865207 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.865334 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.865461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.865588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.865734 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.865734 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.865977 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.866105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.866291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.866424 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.866563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.866691 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.866819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.866946 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.867072 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.867200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.867335 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.867473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.867625 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.867755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.867883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.868009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.868136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.868264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.868399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.868527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.868654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.868781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.868907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.869034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.869169 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.869299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.869435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.869563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] auth.external = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.869690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.869816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.869952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.870116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.870299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.870430 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.870567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.870695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] auth.password = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.870832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.870960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] auth.token = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.870960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.871211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.871346 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.871474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.871609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.871765 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.871906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.872044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.872173 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.872302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.872431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.872559 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.872695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.872825 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] auth.external = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.872953 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] credential.caching = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.873160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.873313 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.873448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.873587 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.873717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.874369 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.874875 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] auth.password = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.875011 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.875149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] auth.token = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.875281 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.875409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.875547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.875678 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.875818 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.875956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.876086 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.876214 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.876343 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.876478 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.876609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.876746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.876875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.877004 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.877132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.877260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] credential.caching = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.877388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.877528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.877668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.877797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.877926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.878054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.878340 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] federation.caching = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.878507 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.878645 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.878781 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.878910 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.879039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.879167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.879303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.879432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.879560 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.879706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.879837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.879980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.880244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.880395 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.880528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.880657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.880786 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.880915 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.880915 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.881247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.881378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.881506 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.881645 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity.caching = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.881776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.881912 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.882042 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] federation.caching = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.882170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.882324 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.882458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.882587 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.882731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.882864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.882992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.883120 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.883261 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.883390 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.883538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.883668 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.883797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.883934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.884064 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.884192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.884328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.884457 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.884585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.884713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.884840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.884969 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.885105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.885245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity.caching = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.885373 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.885500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.885628 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.885756 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.885892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.886023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.886151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.886333 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.886463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.886602 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.886731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.886860 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.886998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.887128 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.887256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.887396 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.887526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.887654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.887782 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.887909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.888037 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.888221 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.888356 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.888485 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.888612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.888746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.888889 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.889026 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.889156 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.889284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.889434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.889434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.890782 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.890925 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.891056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.891185 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.891315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.891444 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.891579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.891718 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.891862 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.891991 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.892120 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.892248 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.892377 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.892514 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.892650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.892779 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.892907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.893034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.893162 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.893298 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.893440 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.893580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.893709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.893837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.893978 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.894119 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.894311 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.894443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.894572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.894700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.894827 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.894967 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.895096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.895224 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.895353 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.895492 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.895621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.895757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.895887 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.896016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.896143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.896271 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.896399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.896536 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.896666 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.896794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.896921 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.897049 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.897177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.897322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.897501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.897632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.897761 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.897889 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.898017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.898155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.898323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.898453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.898583 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.898711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.898839 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.898978 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.898978 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.899233 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.899361 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.899489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.899617 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.899753 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.899882 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.900010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.900010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.900251 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.900379 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.900515 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.900515 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.900761 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.900900 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.901029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.901166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.901296 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.901431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.901560 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.901688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.901817 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.901953 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.902082 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.902252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.902389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.902518 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.902656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.902656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.902913 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.902913 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.903165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.903295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.903423 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.903559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.903689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.903818 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.903946 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.904073 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.904201 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.904336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.904475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.904604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.904732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.904861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.904989 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.905666 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.905841 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.905976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.906105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.906255 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.906389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.906530 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] resource.caching = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.906660 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.906788 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.906927 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.907057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.907186 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.907323 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.907453 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.907582 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.907711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.907839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.907839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.908159 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.908159 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.908407 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.908407 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.908650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.908789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.908926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.909058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] role.caching = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.909058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] role.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.909301 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.909429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.909557 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.909693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.909823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.909951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.910080 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.910228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.910365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.910516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.910647 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.910775 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.910904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] resource.caching = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.911032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.911161 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.911297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.911428 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.911557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.911685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.911813 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.911941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.912077 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.912208 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.912349 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.912516 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.912650 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.912785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.912922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.913052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.913052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.913314 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.913456 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] role.caching = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.913591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.913732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] role.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.913869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.913999 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.914138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.914366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.914509 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.914639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.914769 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.914898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.915027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.915156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.915292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.915424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.915553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.915553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.915935 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.916082 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.916221 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.916352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.916482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.916611 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.916739 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.916868 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.917004 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.917134 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.917263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.917392 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.917522 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.917651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.917787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.917928 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.917928 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.918187 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.918325 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] token.caching = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.918454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.918595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.918726 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.918859 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.918988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.919117 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.919246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.919383 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.919514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.919654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.919784 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.919921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.920050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.920188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.920319 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.920449 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.920579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.921281 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.921499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.922121 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.922289 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.922424 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.922554 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.922697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.922828 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.922969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.923101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.923231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.923360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.923489 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.923627 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.923759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.923888 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.924028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.924159 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.924287 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.connection = **** {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.924439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] token.caching = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.924579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.924718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.924850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.924979 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.925109 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.925238 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.925415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.925560 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.925692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.925821 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.925951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.926080 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.926290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.926451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.926583 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.926713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.926842 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.926842 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.927088 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.927225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.927355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.927484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.927612 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.927740 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.927906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.928053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.928184 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.928324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.928453 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.928582 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.928711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.928848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.928980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.929110 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.929110 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 14:16:43.929355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.929355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.connection = **** {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.929355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.929355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.929355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.929355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.929355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.929355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.929355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.930552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.930552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.930552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.930552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.930552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.930552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.930552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.930552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.930552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.931609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.931609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 14:16:43.931609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 14:16:43.940275 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:43.940570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:43.940707 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:43.940840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:43.941061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:43.941290 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:43.949858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:43.950457 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:43.980975 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:43.981228 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:43.990879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:43.991119 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.036184 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.036714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.088726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.089025 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.089115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.089259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.156030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.156390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.156620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.156787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.156875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.157010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.157091 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.157243 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.157337 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.157517 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.157686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.157905 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.180595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.180842 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.180930 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.181070 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.181152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.181282 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.181363 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.181503 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.181584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.181713 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.181792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.181931 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.182021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.182217 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.195237 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.195407 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.208891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.209126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.209341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.209562 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.209745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.209833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.209987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.210069 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.210229 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79877) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.210315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.210445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.210651 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.210867 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.211084 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 14:16:44.227932 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.228143 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 14:16:44.228479 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.228680 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 14:16:44.228945 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.229203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.229461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.229715 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.230873 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.231088 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 14:16:44.231422 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.231623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 14:16:44.231890 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.232148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.232403 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.232657 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.240660 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.240938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.241204 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.241484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.244278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.244554 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.244824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.245106 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.251773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.253813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.256535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.257135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.257415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.257636 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.257727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.257914 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.258070 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.258348 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.258450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.258621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.258705 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.258886 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.258973 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.259152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.259249 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.259426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.259513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.259691 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.259791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.259951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.260034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.260216 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.288415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.290042 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.290354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.293407 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.295087 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.295368 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.296450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.296734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.297019 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.300905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.301186 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.301457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.305705 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.305983 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.308729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.309007 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.312485 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.313222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.313504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.313782 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.314053 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.314222 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.314369 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.314450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.314603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.314745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.314885 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.315018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.315258 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.315524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.315783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.316038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.335573 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.335740 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.335875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.336019 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.340291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.340444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.343931 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.344219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.344586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.344880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.349119 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.349820 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.352674 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.353407 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.356370 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.356663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.356938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.357212 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.357430 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.357565 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.357747 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.357884 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.358014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.358151 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.358844 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.359148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.377339 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.377707 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.377969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.378248 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.379131 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.379507 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.379773 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.380036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.386018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.387730 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.387903 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.388042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.390677 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.390960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.391616 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.391894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.392174 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.392462 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.392735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.394007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.394313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.394603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.394883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.395168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.406008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.406302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.406578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.406870 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.407144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.407415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.407681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.409043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.409324 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.409603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.409895 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.410191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.410479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.410753 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.425636 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.428905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.429400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.432169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.432682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.433752 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.435382 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.435656 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.435944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.436089 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.438599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.440259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.440535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.440825 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.443897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.445473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.448264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.448673 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.448957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.449233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.449497 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.449857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.454019 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.454333 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.454614 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.454887 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.460303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.460583 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.460851 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.464354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.464659 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.464938 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.469380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79877) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.469653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.469923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.470206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.470502 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.470755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.471019 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.471549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.471808 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.472078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.472347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.472604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.472852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79877) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.473984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 14:16:44.474288 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.474567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.474842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.475111 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.475396 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.475666 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.475939 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.476204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.476466 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.476731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.477007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.477269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.477528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 14:16:44.511962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5645b76af9c0 pid: 79877 (default app) May 17 14:16:44.515621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e807fea-3d09-40b4-9d09-8914497bfaa0 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:44.515921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e807fea-3d09-40b4-9d09-8914497bfaa0 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:44.516205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e807fea-3d09-40b4-9d09-8914497bfaa0 None None] PATH_INFO: `/v3` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:44.518061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5645b76af9c0 pid: 79878 (default app) May 17 14:16:44.520367 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Tue May 17 14:16:44 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:16:52.573589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dff369-8d06-40e0-af8d-73422bd082a2 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:52.574121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dff369-8d06-40e0-af8d-73422bd082a2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:52.574121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dff369-8d06-40e0-af8d-73422bd082a2 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:52.579331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:16:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:16:52.584967 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bec79-2265-4940-821a-c56f753ea1b1 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:52.585402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bec79-2265-4940-821a-c56f753ea1b1 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:52.585686 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bec79-2265-4940-821a-c56f753ea1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:52.617202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG oslo_db.sqlalchemy.engines [None req-566bec79-2265-4940-821a-c56f753ea1b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 14:16:52.802964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG passlib.handlers.bcrypt [None req-566bec79-2265-4940-821a-c56f753ea1b1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79877) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 17 14:16:52.803384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG passlib.handlers.bcrypt [None req-566bec79-2265-4940-821a-c56f753ea1b1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79877) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 17 14:16:52.859532 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-566bec79-2265-4940-821a-c56f753ea1b1 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:16:52.861159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-566bec79-2265-4940-821a-c56f753ea1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:16:52.989240 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:16:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 17 14:16:53.120532 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dff369-8d06-40e0-af8d-73422bd082a2 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:16:53.155449 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG oslo_db.sqlalchemy.engines [None req-a9dff369-8d06-40e0-af8d-73422bd082a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 14:16:53.290102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dff369-8d06-40e0-af8d-73422bd082a2 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:16:53.294376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8701c6-e89a-40bc-ab0f-495d7b9ecc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:16:53.295036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8701c6-e89a-40bc-ab0f-495d7b9ecc05 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:53.295320 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8701c6-e89a-40bc-ab0f-495d7b9ecc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:53.296133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8701c6-e89a-40bc-ab0f-495d7b9ecc05 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:53.304129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8701c6-e89a-40bc-ab0f-495d7b9ecc05 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:16:53.357465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8d8701c6-e89a-40bc-ab0f-495d7b9ecc05 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 17 14:16:53.357804 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8701c6-e89a-40bc-ab0f-495d7b9ecc05 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:16:53.368405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Tue May 17 14:16:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 14:16:53.374869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bec79-2265-4940-821a-c56f753ea1b1 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:16:53.388775 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bec79-2265-4940-821a-c56f753ea1b1 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:16:53.394609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfda7a-1c0d-47b1-96f7-fb8c0f8cb915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:16:53.395716 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfda7a-1c0d-47b1-96f7-fb8c0f8cb915 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:53.396002 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfda7a-1c0d-47b1-96f7-fb8c0f8cb915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:53.396279 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfda7a-1c0d-47b1-96f7-fb8c0f8cb915 admin admin] PATH_INFO: `/v3/projects/c7c1abe20ef64ed9a7be8720622420f6` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:53.397803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfda7a-1c0d-47b1-96f7-fb8c0f8cb915 admin admin] RBAC: Authorizing `identity:get_project(project_id=c7c1abe20ef64ed9a7be8720622420f6)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:16:53.448431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: WARNING keystone.common.rbac_enforcer.enforcer [None req-29bfda7a-1c0d-47b1-96f7-fb8c0f8cb915 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 17 14:16:53.448771 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfda7a-1c0d-47b1-96f7-fb8c0f8cb915 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:16:53.453472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Tue May 17 14:16:53 2022] GET /identity/v3/projects/c7c1abe20ef64ed9a7be8720622420f6 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:16:55.719745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6372b6-151a-4f95-8e69-50bae6c1cd36 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:55.720281 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6372b6-151a-4f95-8e69-50bae6c1cd36 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:55.720281 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6372b6-151a-4f95-8e69-50bae6c1cd36 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:55.724380 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:16:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:16:55.729858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c510d-1df1-403b-b0e3-478d371e058d None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:55.730260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c510d-1df1-403b-b0e3-478d371e058d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:55.730444 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c510d-1df1-403b-b0e3-478d371e058d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:55.750723 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-ef6c510d-1df1-403b-b0e3-478d371e058d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:16:55.752210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ef6c510d-1df1-403b-b0e3-478d371e058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:16:55.759909 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:16:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 17 14:16:55.783232 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6372b6-151a-4f95-8e69-50bae6c1cd36 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:16:55.795031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6372b6-151a-4f95-8e69-50bae6c1cd36 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:16:55.799842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002116cc-c01f-4a8f-a33b-fb237714a540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:16:55.800475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002116cc-c01f-4a8f-a33b-fb237714a540 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:55.800757 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002116cc-c01f-4a8f-a33b-fb237714a540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:55.801035 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002116cc-c01f-4a8f-a33b-fb237714a540 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:55.808767 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002116cc-c01f-4a8f-a33b-fb237714a540 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:16:55.810577 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002116cc-c01f-4a8f-a33b-fb237714a540 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:16:55.819816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Tue May 17 14:16:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:16:55.825039 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c510d-1df1-403b-b0e3-478d371e058d None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:16:55.834758 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c510d-1df1-403b-b0e3-478d371e058d None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:16:55.839060 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c935f31-f2f8-4606-9474-1702d0c174a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:16:55.839908 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c935f31-f2f8-4606-9474-1702d0c174a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:55.840189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c935f31-f2f8-4606-9474-1702d0c174a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:55.840465 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c935f31-f2f8-4606-9474-1702d0c174a0 admin admin] PATH_INFO: `/v3/users/5f9c1bba177246ada74d212c9f20dadb` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:55.841836 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c935f31-f2f8-4606-9474-1702d0c174a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=5f9c1bba177246ada74d212c9f20dadb)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:16:55.843689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c935f31-f2f8-4606-9474-1702d0c174a0 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:16:55.845216 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Tue May 17 14:16:55 2022] GET /identity/v3/users/5f9c1bba177246ada74d212c9f20dadb => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:16:58.136348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315d100-a9eb-4428-a149-053b71576a70 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:58.136893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315d100-a9eb-4428-a149-053b71576a70 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:58.136893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315d100-a9eb-4428-a149-053b71576a70 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:58.138256 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:16:58.144172 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96b504-0725-4c1c-9ef8-6b42683bcde8 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:58.144629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c53b2f-d247-4cc8-9aae-5ae7aaebfe78 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:58.144733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96b504-0725-4c1c-9ef8-6b42683bcde8 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:58.144823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c53b2f-d247-4cc8-9aae-5ae7aaebfe78 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:58.144910 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96b504-0725-4c1c-9ef8-6b42683bcde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:58.145366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c53b2f-d247-4cc8-9aae-5ae7aaebfe78 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:58.146648 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:16:58.151541 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bba6ce-e165-425f-8903-2e87efdd6554 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:58.151826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bba6ce-e165-425f-8903-2e87efdd6554 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:58.152104 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bba6ce-e165-425f-8903-2e87efdd6554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:58.194674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG passlib.handlers.bcrypt [None req-67bba6ce-e165-425f-8903-2e87efdd6554 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79878) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 17 14:16:58.195101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG passlib.handlers.bcrypt [None req-67bba6ce-e165-425f-8903-2e87efdd6554 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79878) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 17 14:16:58.247133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-67bba6ce-e165-425f-8903-2e87efdd6554 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:16:58.249489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-67bba6ce-e165-425f-8903-2e87efdd6554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:16:58.279092 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-ce96b504-0725-4c1c-9ef8-6b42683bcde8 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:16:58.281456 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ce96b504-0725-4c1c-9ef8-6b42683bcde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:16:58.365537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:16:58.370383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:16:58.388536 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96b504-0725-4c1c-9ef8-6b42683bcde8 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:16:58.392271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bba6ce-e165-425f-8903-2e87efdd6554 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:16:58.486112 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96b504-0725-4c1c-9ef8-6b42683bcde8 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:16:58.489807 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bba6ce-e165-425f-8903-2e87efdd6554 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:16:58.519011 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb28e3-2bda-48ac-a8c3-0e22f33c771b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:16:58.519811 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb28e3-2bda-48ac-a8c3-0e22f33c771b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:58.520094 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb28e3-2bda-48ac-a8c3-0e22f33c771b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:58.520374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb28e3-2bda-48ac-a8c3-0e22f33c771b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:58.522437 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f1cf0-6268-47e5-89f9-4bee0bc6955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:16:58.523328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f1cf0-6268-47e5-89f9-4bee0bc6955b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:58.523625 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f1cf0-6268-47e5-89f9-4bee0bc6955b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:58.523899 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f1cf0-6268-47e5-89f9-4bee0bc6955b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:58.532235 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb28e3-2bda-48ac-a8c3-0e22f33c771b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-8abb28e3-2bda-48ac-a8c3-0e22f33c771b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:16:58.543457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:16:58.544378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:16:58.545417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:16:58.545417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:16:58.545417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:16:58.545417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:16:58.545417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:16:58.545417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:16:58.545417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:16:58.545417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:16:58.545417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:16:58.545417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:16:58.545417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:16:58.545417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:16:58.545417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:16:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:16:58.550390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb28e3-2bda-48ac-a8c3-0e22f33c771b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:16:58.594486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f1cf0-6268-47e5-89f9-4bee0bc6955b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:16:58.596018 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f1cf0-6268-47e5-89f9-4bee0bc6955b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:16:58.647922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb28e3-2bda-48ac-a8c3-0e22f33c771b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:16:58.679768 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1888b-454e-47dd-a610-f483bfa783f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:16:58.680433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1888b-454e-47dd-a610-f483bfa783f5 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:58.680720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1888b-454e-47dd-a610-f483bfa783f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:58.680998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1888b-454e-47dd-a610-f483bfa783f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:58.681752 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1888b-454e-47dd-a610-f483bfa783f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:16:58.682060 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1888b-454e-47dd-a610-f483bfa783f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:16:58.683498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1888b-454e-47dd-a610-f483bfa783f5 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:16:58.691402 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 8/15] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:16:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 14:16:58.695564 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 8/16] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:16:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:16:58.696873 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f1cf0-6268-47e5-89f9-4bee0bc6955b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:16:58.700776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1888b-454e-47dd-a610-f483bfa783f5 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:16:58.803759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1888b-454e-47dd-a610-f483bfa783f5 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:16:58.839181 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9f32b-0dbc-491c-a47e-8efa0e1a281d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:16:58.840050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9f32b-0dbc-491c-a47e-8efa0e1a281d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:58.840337 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9f32b-0dbc-491c-a47e-8efa0e1a281d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:58.840617 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9f32b-0dbc-491c-a47e-8efa0e1a281d None admin] PATH_INFO: `/v3/users/5f9c1bba177246ada74d212c9f20dadb` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:58.841833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9f32b-0dbc-491c-a47e-8efa0e1a281d None admin] RBAC: Authorizing `identity:get_user(user_id=5f9c1bba177246ada74d212c9f20dadb)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:16:58.843371 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9f32b-0dbc-491c-a47e-8efa0e1a281d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:16:58.845171 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:16:58 2022] GET /identity/v3/users/5f9c1bba177246ada74d212c9f20dadb => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:16:58.850389 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9f32b-0dbc-491c-a47e-8efa0e1a281d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:16:58.901650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f1cf0-6268-47e5-89f9-4bee0bc6955b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:16:58.934059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6764-2b36-4b47-9308-a862d524c271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:16:58.934869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6764-2b36-4b47-9308-a862d524c271 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:58.935153 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6764-2b36-4b47-9308-a862d524c271 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:58.935429 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6764-2b36-4b47-9308-a862d524c271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:58.944324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9f32b-0dbc-491c-a47e-8efa0e1a281d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:16:58.954673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d6764-2b36-4b47-9308-a862d524c271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:16:58.956400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d6764-2b36-4b47-9308-a862d524c271 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:16:58.976143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-eb4d6764-2b36-4b47-9308-a862d524c271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:16:58.976143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:16:58.976143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:16:58.976143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:16:58.976143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:16:58.976143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:16:58.976143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:16:58.976143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:16:58.976143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:16:58.976143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:16:58.976143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:16:58.976143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:16:58.976143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:16:58.976143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:16:58.976143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:16:58.976955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:16:58.977755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:16:58.977755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:16:58.977755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:16:58.977755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:16:58.977755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:16:58.978362 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203d3dc-1801-4be6-bc11-9d801491beb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:16:58.979223 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203d3dc-1801-4be6-bc11-9d801491beb0 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:58.979511 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203d3dc-1801-4be6-bc11-9d801491beb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:58.979784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203d3dc-1801-4be6-bc11-9d801491beb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:58.980989 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203d3dc-1801-4be6-bc11-9d801491beb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:16:58.982550 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203d3dc-1801-4be6-bc11-9d801491beb0 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:16:58.983702 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6764-2b36-4b47-9308-a862d524c271 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:16:58.984822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:16:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:16:58.990415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203d3dc-1801-4be6-bc11-9d801491beb0 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:16:59.086528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6764-2b36-4b47-9308-a862d524c271 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:16:59.086729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203d3dc-1801-4be6-bc11-9d801491beb0 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:16:59.119061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ebe4c-0be0-4d1c-9ac7-8e1606e5ab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:16:59.119260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e286631-4c23-4d22-8b42-5c548ef137ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:16:59.119723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ebe4c-0be0-4d1c-9ac7-8e1606e5ab42 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:59.119816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e286631-4c23-4d22-8b42-5c548ef137ab None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:16:59.120008 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ebe4c-0be0-4d1c-9ac7-8e1606e5ab42 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:59.120093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e286631-4c23-4d22-8b42-5c548ef137ab None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:16:59.120283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ebe4c-0be0-4d1c-9ac7-8e1606e5ab42 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:59.120370 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e286631-4c23-4d22-8b42-5c548ef137ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:16:59.121007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ebe4c-0be0-4d1c-9ac7-8e1606e5ab42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:16:59.121127 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e286631-4c23-4d22-8b42-5c548ef137ab None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.domain.id=default, user.id=5f9c1bba177246ada74d212c9f20dadb) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:16:59.121340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ebe4c-0be0-4d1c-9ac7-8e1606e5ab42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:16:59.121439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e286631-4c23-4d22-8b42-5c548ef137ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:16:59.122785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ebe4c-0be0-4d1c-9ac7-8e1606e5ab42 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:16:59.122901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e286631-4c23-4d22-8b42-5c548ef137ab None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:16:59.130036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Tue May 17 14:16:58 2022] GET /identity/v3/role_assignments?user.id=5f9c1bba177246ada74d212c9f20dadb&scope.domain.id=default&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 233 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:16:59.141054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:01.899833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf517a-07cf-42db-8fcf-38702d8b6388 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:01.899833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf517a-07cf-42db-8fcf-38702d8b6388 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:01.899833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf517a-07cf-42db-8fcf-38702d8b6388 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:01.900998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:01.905475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559de576-18a1-410f-8c7e-24f3554f0edc None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:01.906302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559de576-18a1-410f-8c7e-24f3554f0edc None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:01.906775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559de576-18a1-410f-8c7e-24f3554f0edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:01.930725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-559de576-18a1-410f-8c7e-24f3554f0edc None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:01.932245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-559de576-18a1-410f-8c7e-24f3554f0edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:02.020023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:02.064245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf517a-07cf-42db-8fcf-38702d8b6388 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:02.173745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf517a-07cf-42db-8fcf-38702d8b6388 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:02.212094 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577b6fa-f96a-4ff2-b512-1c686aefa627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:02.212908 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577b6fa-f96a-4ff2-b512-1c686aefa627 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:02.213190 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577b6fa-f96a-4ff2-b512-1c686aefa627 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:02.213462 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577b6fa-f96a-4ff2-b512-1c686aefa627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:02.224803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577b6fa-f96a-4ff2-b512-1c686aefa627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:02.226319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577b6fa-f96a-4ff2-b512-1c686aefa627 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:02.253157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-3577b6fa-f96a-4ff2-b512-1c686aefa627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:17:02.253157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:02.253157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:02.253157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:02.253157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:02.253157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:02.253157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:02.253157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:02.253157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:02.253157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:02.253157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:02.253157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:02.253157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:17:02.253157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:17:02.253157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:02.254009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:02.254848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:17:02.254848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:17:02.254848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:17:02.254848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:02.255072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 13/24] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:02.260908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559de576-18a1-410f-8c7e-24f3554f0edc None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:02.308579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580facc9-3b28-4a89-b462-84487a7a1ab7 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:02.308901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580facc9-3b28-4a89-b462-84487a7a1ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:02.309132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580facc9-3b28-4a89-b462-84487a7a1ab7 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:02.311568 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 14/25] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:02.319459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b578a-2b58-495c-a44f-a44ee2bb564d None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:02.320003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b578a-2b58-495c-a44f-a44ee2bb564d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:02.320476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b578a-2b58-495c-a44f-a44ee2bb564d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:02.340477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-1c1b578a-2b58-495c-a44f-a44ee2bb564d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:02.343067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-1c1b578a-2b58-495c-a44f-a44ee2bb564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:02.418587 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 15/26] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:02.427746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f7746-dc5e-4c60-b1c1-63395527724b None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:02.428275 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f7746-dc5e-4c60-b1c1-63395527724b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:02.428748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f7746-dc5e-4c60-b1c1-63395527724b None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:02.430599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 16/27] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:02.437102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559de576-18a1-410f-8c7e-24f3554f0edc None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:02.443737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b8145-3c4c-4e1b-9baa-29b61fc335c4 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:02.444269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b8145-3c4c-4e1b-9baa-29b61fc335c4 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:02.444773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b8145-3c4c-4e1b-9baa-29b61fc335c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:02.462930 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-a83b8145-3c4c-4e1b-9baa-29b61fc335c4 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:02.464458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a83b8145-3c4c-4e1b-9baa-29b61fc335c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:02.517727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a54ff-1cbd-4b21-8266-768e056197f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:02.518439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a54ff-1cbd-4b21-8266-768e056197f2 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:02.518727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a54ff-1cbd-4b21-8266-768e056197f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:02.518999 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a54ff-1cbd-4b21-8266-768e056197f2 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:02.519920 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a54ff-1cbd-4b21-8266-768e056197f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:02.520387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a54ff-1cbd-4b21-8266-768e056197f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:02.521930 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a54ff-1cbd-4b21-8266-768e056197f2 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:02.545804 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 12/28] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:02.546595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 17/29] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:02.554304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a54ff-1cbd-4b21-8266-768e056197f2 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:02.555571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b8145-3c4c-4e1b-9baa-29b61fc335c4 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:02.663349 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b8145-3c4c-4e1b-9baa-29b61fc335c4 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:02.699476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8fb63-b563-425d-80a5-2a9c64b1ee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:02.700487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8fb63-b563-425d-80a5-2a9c64b1ee37 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:02.700987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8fb63-b563-425d-80a5-2a9c64b1ee37 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:02.701979 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8fb63-b563-425d-80a5-2a9c64b1ee37 None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:02.703577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8fb63-b563-425d-80a5-2a9c64b1ee37 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:02.705244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8fb63-b563-425d-80a5-2a9c64b1ee37 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:02.750768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a54ff-1cbd-4b21-8266-768e056197f2 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:02.786788 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415213c2-049f-4dd0-9aef-f4cf7c7a95a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:02.787769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415213c2-049f-4dd0-9aef-f4cf7c7a95a7 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:02.788192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415213c2-049f-4dd0-9aef-f4cf7c7a95a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:02.788608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415213c2-049f-4dd0-9aef-f4cf7c7a95a7 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:02.789608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415213c2-049f-4dd0-9aef-f4cf7c7a95a7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:02.791328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415213c2-049f-4dd0-9aef-f4cf7c7a95a7 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:02.856079 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 18/30] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 14:17:02 2022] POST /identity/v3/projects => generated 301 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:17:02.857420 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8fb63-b563-425d-80a5-2a9c64b1ee37 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:02.931532 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 13/31] 10.222.0.48 () {60 vars in 1131 bytes} [Tue May 17 14:17:02 2022] POST /identity/v3/roles => generated 219 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:17:02.933944 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd945-ec0d-4a50-9f6c-c59b88548ab9 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:02.934516 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd945-ec0d-4a50-9f6c-c59b88548ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:02.935001 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd945-ec0d-4a50-9f6c-c59b88548ab9 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:02.937004 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 14/32] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:02.943156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b082be7-a00c-4729-a0dd-d7b013756387 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:02.943795 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b082be7-a00c-4729-a0dd-d7b013756387 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:02.944274 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b082be7-a00c-4729-a0dd-d7b013756387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:02.985801 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7b082be7-a00c-4729-a0dd-d7b013756387 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:02.989672 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7b082be7-a00c-4729-a0dd-d7b013756387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:03.090842 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8fb63-b563-425d-80a5-2a9c64b1ee37 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:03.144066 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3885fd2-335c-4d0e-a55e-819fa8f6dff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:03.145309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3885fd2-335c-4d0e-a55e-819fa8f6dff0 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:03.145803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3885fd2-335c-4d0e-a55e-819fa8f6dff0 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:03.146307 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3885fd2-335c-4d0e-a55e-819fa8f6dff0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:03.163593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3885fd2-335c-4d0e-a55e-819fa8f6dff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:03.163931 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 15/33] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-a3885fd2-335c-4d0e-a55e-819fa8f6dff0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:03.177724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:03.178664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:03.179433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:03.179433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:03.179433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:03.179433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:03.179433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:03.179433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:03.179433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:03.179433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:03.179433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:03.179433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:03.179433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:03.179433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:03.182146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 19/34] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:17:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:03.188335 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b082be7-a00c-4729-a0dd-d7b013756387 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:03.207615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3885fd2-335c-4d0e-a55e-819fa8f6dff0 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:03.323830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3885fd2-335c-4d0e-a55e-819fa8f6dff0 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:03.374769 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6b4bd-c65b-444d-a560-b9f71c1a3c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:03.375469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6b4bd-c65b-444d-a560-b9f71c1a3c82 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:03.375761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6b4bd-c65b-444d-a560-b9f71c1a3c82 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:03.376049 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6b4bd-c65b-444d-a560-b9f71c1a3c82 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:03.376849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6b4bd-c65b-444d-a560-b9f71c1a3c82 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:03.379151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6b4bd-c65b-444d-a560-b9f71c1a3c82 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:03.397375 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b082be7-a00c-4729-a0dd-d7b013756387 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:03.402211 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 20/35] 10.222.0.48 () {60 vars in 1131 bytes} [Tue May 17 14:17:03 2022] POST /identity/v3/roles => generated 225 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:17:03.443053 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032757c3-b05e-467c-828d-2956403171cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:03.443751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032757c3-b05e-467c-828d-2956403171cf None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:03.444040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032757c3-b05e-467c-828d-2956403171cf None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:03.444318 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032757c3-b05e-467c-828d-2956403171cf None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:03.445100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032757c3-b05e-467c-828d-2956403171cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:03.445400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032757c3-b05e-467c-828d-2956403171cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:03.447032 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032757c3-b05e-467c-828d-2956403171cf None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:03.468939 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 16/36] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:03.474888 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6b4bd-c65b-444d-a560-b9f71c1a3c82 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:03.507382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173deed-e7cd-47b1-b55f-dd56f7997f12 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:03.507725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173deed-e7cd-47b1-b55f-dd56f7997f12 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:03.507954 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173deed-e7cd-47b1-b55f-dd56f7997f12 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:03.509328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 17/37] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:17:03.516275 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e23ef-4a8e-4b44-8d02-f1a556541cc2 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:03.516560 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e23ef-4a8e-4b44-8d02-f1a556541cc2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:03.516837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e23ef-4a8e-4b44-8d02-f1a556541cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:03.535211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-ee3e23ef-4a8e-4b44-8d02-f1a556541cc2 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:03.536534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ee3e23ef-4a8e-4b44-8d02-f1a556541cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:03.609994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6b4bd-c65b-444d-a560-b9f71c1a3c82 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:03.621172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 18/38] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:03.622910 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e81468-4238-46bf-859d-dbea35bbaab5 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:03.623396 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e81468-4238-46bf-859d-dbea35bbaab5 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:03.623812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e81468-4238-46bf-859d-dbea35bbaab5 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:03.629064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 19/39] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:03.630966 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760101f-b563-448c-9323-e28269b56562 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:03.631261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760101f-b563-448c-9323-e28269b56562 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:03.631545 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760101f-b563-448c-9323-e28269b56562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:03.649017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7760101f-b563-448c-9323-e28269b56562 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:03.649294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054a17b-7c7b-4671-93e7-2b2b001b8a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:03.650198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054a17b-7c7b-4671-93e7-2b2b001b8a58 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:03.650326 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7760101f-b563-448c-9323-e28269b56562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:03.650593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054a17b-7c7b-4671-93e7-2b2b001b8a58 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:03.650870 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054a17b-7c7b-4671-93e7-2b2b001b8a58 None admin] PATH_INFO: `/v3/users/5f9c1bba177246ada74d212c9f20dadb` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:03.652088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054a17b-7c7b-4671-93e7-2b2b001b8a58 None admin] RBAC: Authorizing `identity:get_user(user_id=5f9c1bba177246ada74d212c9f20dadb)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:03.653560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054a17b-7c7b-4671-93e7-2b2b001b8a58 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:03.655822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 21/40] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:03 2022] GET /identity/v3/users/5f9c1bba177246ada74d212c9f20dadb => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:03.656547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054a17b-7c7b-4671-93e7-2b2b001b8a58 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:03.727838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 20/41] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:03.729089 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760101f-b563-448c-9323-e28269b56562 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:03.759854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054a17b-7c7b-4671-93e7-2b2b001b8a58 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:03.792606 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe1c60-23bb-4c7e-8d4c-babd8fd38619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:03.793283 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe1c60-23bb-4c7e-8d4c-babd8fd38619 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:03.793575 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe1c60-23bb-4c7e-8d4c-babd8fd38619 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:03.793913 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe1c60-23bb-4c7e-8d4c-babd8fd38619 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:03.794709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe1c60-23bb-4c7e-8d4c-babd8fd38619 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:03.796216 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe1c60-23bb-4c7e-8d4c-babd8fd38619 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:03.808574 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1131 bytes} [Tue May 17 14:17:03 2022] POST /identity/v3/roles => generated 223 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:17:03.809381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe1c60-23bb-4c7e-8d4c-babd8fd38619 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:03.827490 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760101f-b563-448c-9323-e28269b56562 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:03.864500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee7ae5-c98b-4e9b-8fad-42d4678321c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:03.865297 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee7ae5-c98b-4e9b-8fad-42d4678321c0 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:03.865590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee7ae5-c98b-4e9b-8fad-42d4678321c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:03.865873 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee7ae5-c98b-4e9b-8fad-42d4678321c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:03.867527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee7ae5-c98b-4e9b-8fad-42d4678321c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:03.869158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee7ae5-c98b-4e9b-8fad-42d4678321c0 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:03.871221 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:17:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:03.877324 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee7ae5-c98b-4e9b-8fad-42d4678321c0 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:03.916211 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe1c60-23bb-4c7e-8d4c-babd8fd38619 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:03.952604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913e004-3400-460a-b6d0-cfea232ecc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:03.953415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913e004-3400-460a-b6d0-cfea232ecc73 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:03.953708 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913e004-3400-460a-b6d0-cfea232ecc73 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:03.953990 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913e004-3400-460a-b6d0-cfea232ecc73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:03.955344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913e004-3400-460a-b6d0-cfea232ecc73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:03.957092 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913e004-3400-460a-b6d0-cfea232ecc73 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:03.963580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 23/44] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:17:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:03.964698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913e004-3400-460a-b6d0-cfea232ecc73 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:03.983010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee7ae5-c98b-4e9b-8fad-42d4678321c0 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:04.020642 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87b498-4bbd-4d66-97f5-c65669ec6011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:04.021604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87b498-4bbd-4d66-97f5-c65669ec6011 None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:04.021895 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87b498-4bbd-4d66-97f5-c65669ec6011 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:04.022212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87b498-4bbd-4d66-97f5-c65669ec6011 None admin] PATH_INFO: `/v3/domains/default/users/5f9c1bba177246ada74d212c9f20dadb/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:04.024503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87b498-4bbd-4d66-97f5-c65669ec6011 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5f9c1bba177246ada74d212c9f20dadb, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:04.025991 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87b498-4bbd-4d66-97f5-c65669ec6011 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:04.042503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 22/45] 10.222.0.48 () {58 vars in 1361 bytes} [Tue May 17 14:17:03 2022] PUT /identity/v3/domains/default/users/5f9c1bba177246ada74d212c9f20dadb/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:17:04.070814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913e004-3400-460a-b6d0-cfea232ecc73 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:04.106902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0e4a1-515a-4b5e-a9e7-b85f3e681eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:04.108253 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0e4a1-515a-4b5e-a9e7-b85f3e681eb6 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:04.108519 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0e4a1-515a-4b5e-a9e7-b85f3e681eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:04.108802 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0e4a1-515a-4b5e-a9e7-b85f3e681eb6 None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:04.109547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0e4a1-515a-4b5e-a9e7-b85f3e681eb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:04.111098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0e4a1-515a-4b5e-a9e7-b85f3e681eb6 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:04.139322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 14:17:03 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:17:06.275543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03597e29-8cc5-42f4-a0e9-b6b7366e52ee None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:06.276067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03597e29-8cc5-42f4-a0e9-b6b7366e52ee None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:06.276160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03597e29-8cc5-42f4-a0e9-b6b7366e52ee None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:06.277624 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 23/47] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:06.283364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab4f1-b8ed-4d9b-b348-6ff913158d16 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:06.283797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab4f1-b8ed-4d9b-b348-6ff913158d16 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:06.283918 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab4f1-b8ed-4d9b-b348-6ff913158d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:06.300826 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-1afab4f1-b8ed-4d9b-b348-6ff913158d16 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:06.302346 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-1afab4f1-b8ed-4d9b-b348-6ff913158d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:06.366221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 25/48] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:06.377490 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bf2b6-9dac-46ba-a844-c6260399c067 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:06.377787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bf2b6-9dac-46ba-a844-c6260399c067 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:06.378070 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bf2b6-9dac-46ba-a844-c6260399c067 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:06.379462 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 24/49] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:06.384849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b5aae-b193-49d7-8565-d1310485c226 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:06.385145 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b5aae-b193-49d7-8565-d1310485c226 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:06.385426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b5aae-b193-49d7-8565-d1310485c226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:06.390412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bf2b6-9dac-46ba-a844-c6260399c067 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:06.403103 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-065b5aae-b193-49d7-8565-d1310485c226 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:06.404281 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-065b5aae-b193-49d7-8565-d1310485c226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:06.472566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 26/50] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:06.498012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b5aae-b193-49d7-8565-d1310485c226 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:06.508884 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bf2b6-9dac-46ba-a844-c6260399c067 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:06.543059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174187e-6caa-4b4f-b34f-ba161cf8f938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:06.543854 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174187e-6caa-4b4f-b34f-ba161cf8f938 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:06.544147 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174187e-6caa-4b4f-b34f-ba161cf8f938 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:06.544429 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174187e-6caa-4b4f-b34f-ba161cf8f938 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:06.556765 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174187e-6caa-4b4f-b34f-ba161cf8f938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-1174187e-6caa-4b4f-b34f-ba161cf8f938 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:06.566552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:06.567400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:06.568148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:06.568148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:06.568148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:06.568148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:06.568148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:06.568148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:06.568148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:06.568148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:06.568148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:06.568148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:06.568148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:06.568148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:06.568148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 25/51] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:17:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:17:06.573481 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174187e-6caa-4b4f-b34f-ba161cf8f938 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:06.596163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b5aae-b193-49d7-8565-d1310485c226 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:06.628658 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7e9d1-6985-477b-973d-2def466a837b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:06.629449 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7e9d1-6985-477b-973d-2def466a837b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:06.629735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7e9d1-6985-477b-973d-2def466a837b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:06.630017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7e9d1-6985-477b-973d-2def466a837b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:06.631244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7e9d1-6985-477b-973d-2def466a837b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:06.632729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7e9d1-6985-477b-973d-2def466a837b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:06.634529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 27/52] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:17:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:06.639812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7e9d1-6985-477b-973d-2def466a837b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:06.671593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174187e-6caa-4b4f-b34f-ba161cf8f938 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:06.703430 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c947c-788a-4312-bce6-f9389f9c0e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:06.704093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c947c-788a-4312-bce6-f9389f9c0e57 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:06.704377 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c947c-788a-4312-bce6-f9389f9c0e57 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:06.704654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c947c-788a-4312-bce6-f9389f9c0e57 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:06.705410 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c947c-788a-4312-bce6-f9389f9c0e57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:06.705713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c947c-788a-4312-bce6-f9389f9c0e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:06.707400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c947c-788a-4312-bce6-f9389f9c0e57 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:06.715137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:06.721095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c947c-788a-4312-bce6-f9389f9c0e57 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:06.734215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7e9d1-6985-477b-973d-2def466a837b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:06.766721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81016950-52c0-41fb-a4a8-0821062c1251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:06.767380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81016950-52c0-41fb-a4a8-0821062c1251 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:06.767695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81016950-52c0-41fb-a4a8-0821062c1251 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:06.767983 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81016950-52c0-41fb-a4a8-0821062c1251 None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:06.768697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81016950-52c0-41fb-a4a8-0821062c1251 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:06.770152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81016950-52c0-41fb-a4a8-0821062c1251 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:06.795274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 28/54] 10.222.0.48 () {60 vars in 1140 bytes} [Tue May 17 14:17:06 2022] POST /identity/v3/projects => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:17:06.833982 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c947c-788a-4312-bce6-f9389f9c0e57 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:06.870540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb05e-a210-4f6a-b459-72f6b2f3af5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:06.871436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb05e-a210-4f6a-b459-72f6b2f3af5e None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:06.871727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb05e-a210-4f6a-b459-72f6b2f3af5e None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:06.872011 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb05e-a210-4f6a-b459-72f6b2f3af5e None admin] PATH_INFO: `/v3/users/5f9c1bba177246ada74d212c9f20dadb` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:06.873307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bb05e-a210-4f6a-b459-72f6b2f3af5e None admin] RBAC: Authorizing `identity:get_user(user_id=5f9c1bba177246ada74d212c9f20dadb)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:06.874920 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bb05e-a210-4f6a-b459-72f6b2f3af5e None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:06.876651 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:06 2022] GET /identity/v3/users/5f9c1bba177246ada74d212c9f20dadb => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:06.882336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81016950-52c0-41fb-a4a8-0821062c1251 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:06.985328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81016950-52c0-41fb-a4a8-0821062c1251 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:07.018431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f10f2-0557-46b2-97c9-38fa69c870d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:07.019234 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f10f2-0557-46b2-97c9-38fa69c870d3 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:07.019525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f10f2-0557-46b2-97c9-38fa69c870d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:07.019810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f10f2-0557-46b2-97c9-38fa69c870d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:07.020998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f10f2-0557-46b2-97c9-38fa69c870d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:07.022486 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f10f2-0557-46b2-97c9-38fa69c870d3 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:07.024101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 29/56] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:17:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:07.030446 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb05e-a210-4f6a-b459-72f6b2f3af5e None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:07.128479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb05e-a210-4f6a-b459-72f6b2f3af5e None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:07.160168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b06c30-ca34-4933-887f-01b4545ac9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:07.160824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b06c30-ca34-4933-887f-01b4545ac9b2 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:07.161109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b06c30-ca34-4933-887f-01b4545ac9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:07.161387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b06c30-ca34-4933-887f-01b4545ac9b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:07.162241 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b06c30-ca34-4933-887f-01b4545ac9b2 None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.domain.id=default, user.id=5f9c1bba177246ada74d212c9f20dadb) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:07.162558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b06c30-ca34-4933-887f-01b4545ac9b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:07.164027 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b06c30-ca34-4933-887f-01b4545ac9b2 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:07.172402 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1322 bytes} [Tue May 17 14:17:07 2022] GET /identity/v3/role_assignments?user.id=5f9c1bba177246ada74d212c9f20dadb&scope.domain.id=default&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:09.039745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fab517-3bad-4362-bdc6-6f0dd7b9c06e None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:09.040285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fab517-3bad-4362-bdc6-6f0dd7b9c06e None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:09.040285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fab517-3bad-4362-bdc6-6f0dd7b9c06e None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:09.041662 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 30/58] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:09.046975 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586fb22-fa7d-422e-b5ac-712893dc1476 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:09.047378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586fb22-fa7d-422e-b5ac-712893dc1476 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:09.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586fb22-fa7d-422e-b5ac-712893dc1476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:09.064455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-1586fb22-fa7d-422e-b5ac-712893dc1476 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:09.065632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1586fb22-fa7d-422e-b5ac-712893dc1476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:09.131101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 29/59] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:09.155734 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fab517-3bad-4362-bdc6-6f0dd7b9c06e None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:09.253731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fab517-3bad-4362-bdc6-6f0dd7b9c06e None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:09.286633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a63c1-1137-4b3d-9b73-ab01307dd542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:09.287415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a63c1-1137-4b3d-9b73-ab01307dd542 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:09.287703 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a63c1-1137-4b3d-9b73-ab01307dd542 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:09.287981 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a63c1-1137-4b3d-9b73-ab01307dd542 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:09.289153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a63c1-1137-4b3d-9b73-ab01307dd542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:09.290735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a63c1-1137-4b3d-9b73-ab01307dd542 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:09.292295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 31/60] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:17:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:09.298011 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586fb22-fa7d-422e-b5ac-712893dc1476 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:09.391798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586fb22-fa7d-422e-b5ac-712893dc1476 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:09.423757 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830c561-77cd-412a-ae82-00aef2c0d8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:09.424416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c561-77cd-412a-ae82-00aef2c0d8b3 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:09.424702 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c561-77cd-412a-ae82-00aef2c0d8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:09.424982 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c561-77cd-412a-ae82-00aef2c0d8b3 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:09.425691 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830c561-77cd-412a-ae82-00aef2c0d8b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:09.427179 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830c561-77cd-412a-ae82-00aef2c0d8b3 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:09.451887 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 30/61] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:17:09 2022] POST /identity/v3/users => generated 275 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:17:12.786591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad95ac-892d-48e2-9953-3a9914f4f262 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:12.787139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad95ac-892d-48e2-9953-3a9914f4f262 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:12.787139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad95ac-892d-48e2-9953-3a9914f4f262 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:12.789128 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 32/62] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:12.794088 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de69e-a320-4a95-9cce-0d3cd8670d01 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:12.794526 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de69e-a320-4a95-9cce-0d3cd8670d01 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:12.794711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de69e-a320-4a95-9cce-0d3cd8670d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:12.819414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-557de69e-a320-4a95-9cce-0d3cd8670d01 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:12.820599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-557de69e-a320-4a95-9cce-0d3cd8670d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:12.903709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 31/63] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:12.938742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad95ac-892d-48e2-9953-3a9914f4f262 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:12.945681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429f656-5882-4b96-a62b-e6bde3b4d9c5 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:12.945976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429f656-5882-4b96-a62b-e6bde3b4d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:12.946295 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429f656-5882-4b96-a62b-e6bde3b4d9c5 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:12.947973 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 32/64] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:12.949091 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d16eb-d893-4c2e-b32a-a57aee80d175 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:12.949382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d16eb-d893-4c2e-b32a-a57aee80d175 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:12.949658 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d16eb-d893-4c2e-b32a-a57aee80d175 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:12.951216 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 33/65] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:12.955425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bc247-cb4a-4e02-a8ef-a6b1de9ac6a4 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:12.955721 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bc247-cb4a-4e02-a8ef-a6b1de9ac6a4 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:12.956004 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bc247-cb4a-4e02-a8ef-a6b1de9ac6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:12.974960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-9c5bc247-cb4a-4e02-a8ef-a6b1de9ac6a4 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:12.976158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-9c5bc247-cb4a-4e02-a8ef-a6b1de9ac6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:13.046791 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 34/66] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:13.048379 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a440fd7-3545-49bc-b360-c0c1b6b0766a None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:13.048817 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a440fd7-3545-49bc-b360-c0c1b6b0766a None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:13.049263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a440fd7-3545-49bc-b360-c0c1b6b0766a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:13.051716 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad95ac-892d-48e2-9953-3a9914f4f262 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:13.065792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-0a440fd7-3545-49bc-b360-c0c1b6b0766a None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:13.067251 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0a440fd7-3545-49bc-b360-c0c1b6b0766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:13.087385 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b9481-12e4-4f9b-972d-efc8658432b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:13.088460 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b9481-12e4-4f9b-972d-efc8658432b8 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:13.088884 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b9481-12e4-4f9b-972d-efc8658432b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:13.089299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b9481-12e4-4f9b-972d-efc8658432b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:13.102070 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b9481-12e4-4f9b-972d-efc8658432b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-3c2b9481-12e4-4f9b-972d-efc8658432b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:13.111405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:13.112543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:13.113467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:13.113467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:13.113467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:13.113467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:13.113467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:13.113467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:13.113467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:13.113467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:13.113467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:13.113467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:13.113467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:13.113467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:13.115646 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 33/67] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:13.116579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b9481-12e4-4f9b-972d-efc8658432b8 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:13.136351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 35/68] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:13.138230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a440fd7-3545-49bc-b360-c0c1b6b0766a None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:13.229573 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b9481-12e4-4f9b-972d-efc8658432b8 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:13.262473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a440fd7-3545-49bc-b360-c0c1b6b0766a None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:13.271939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ae969-112a-4b63-a41c-248d0b498a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:13.272736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ae969-112a-4b63-a41c-248d0b498a9d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:13.273180 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ae969-112a-4b63-a41c-248d0b498a9d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:13.273597 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ae969-112a-4b63-a41c-248d0b498a9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:13.285200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ae969-112a-4b63-a41c-248d0b498a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-766ae969-112a-4b63-a41c-248d0b498a9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:13.293084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:13.294115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:13.295299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:13.295299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:13.295299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:13.295299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:13.295299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:13.295299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:13.295299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:13.295299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:13.295299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:13.295299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:13.295299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:13.295299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:13.297976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:17:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:13.299238 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ae969-112a-4b63-a41c-248d0b498a9d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:13.299712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cefd6-ce1e-49d6-9aae-b22b153bf83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:13.300578 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cefd6-ce1e-49d6-9aae-b22b153bf83a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:13.301010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cefd6-ce1e-49d6-9aae-b22b153bf83a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:13.301480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cefd6-ce1e-49d6-9aae-b22b153bf83a None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:13.302673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cefd6-ce1e-49d6-9aae-b22b153bf83a None admin] RBAC: Adding query filter params (name=member) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:13.303157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cefd6-ce1e-49d6-9aae-b22b153bf83a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:13.304723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cefd6-ce1e-49d6-9aae-b22b153bf83a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:13.314084 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 36/70] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:13.315156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cefd6-ce1e-49d6-9aae-b22b153bf83a None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:13.411164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ae969-112a-4b63-a41c-248d0b498a9d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:13.423548 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cefd6-ce1e-49d6-9aae-b22b153bf83a None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:13.446601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a67345-59a7-4abe-a4d1-67997207ee50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:13.447635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a67345-59a7-4abe-a4d1-67997207ee50 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:13.448061 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a67345-59a7-4abe-a4d1-67997207ee50 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:13.448477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a67345-59a7-4abe-a4d1-67997207ee50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:13.458925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56abbbc-9b9a-4547-9b9b-ddc5d16b55f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:13.459805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56abbbc-9b9a-4547-9b9b-ddc5d16b55f5 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:13.460239 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56abbbc-9b9a-4547-9b9b-ddc5d16b55f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:13.460662 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56abbbc-9b9a-4547-9b9b-ddc5d16b55f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:13.460894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a67345-59a7-4abe-a4d1-67997207ee50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:13.461735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56abbbc-9b9a-4547-9b9b-ddc5d16b55f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:13.462218 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56abbbc-9b9a-4547-9b9b-ddc5d16b55f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:13.463792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56abbbc-9b9a-4547-9b9b-ddc5d16b55f5 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-f2a67345-59a7-4abe-a4d1-67997207ee50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:13.469902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:13.470980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:13.471854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:13.471854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:13.471854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:13.471854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:13.471854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:13.471854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:13.471854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:13.471854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:13.471854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:13.471854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:13.471854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:13.471854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:13.473086 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 37/71] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:13.473851 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 35/72] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:17:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:13.473983 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56abbbc-9b9a-4547-9b9b-ddc5d16b55f5 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:13.478711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a67345-59a7-4abe-a4d1-67997207ee50 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:13.579031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a67345-59a7-4abe-a4d1-67997207ee50 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:13.579481 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56abbbc-9b9a-4547-9b9b-ddc5d16b55f5 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:13.612005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371563b5-dac4-4165-aca0-2c4baa5cfb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:13.612745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930b7e7-c960-46b5-a21c-ee176d075f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:13.612886 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371563b5-dac4-4165-aca0-2c4baa5cfb39 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:13.613155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371563b5-dac4-4165-aca0-2c4baa5cfb39 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:13.613436 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371563b5-dac4-4165-aca0-2c4baa5cfb39 None admin] PATH_INFO: `/v3/users/5f9c1bba177246ada74d212c9f20dadb` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:13.613613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930b7e7-c960-46b5-a21c-ee176d075f18 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:13.613899 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930b7e7-c960-46b5-a21c-ee176d075f18 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:13.614222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930b7e7-c960-46b5-a21c-ee176d075f18 None admin] PATH_INFO: `/v3/users/e85023b8270143b3943eb58af91e46eb` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:13.614663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371563b5-dac4-4165-aca0-2c4baa5cfb39 None admin] RBAC: Authorizing `identity:get_user(user_id=5f9c1bba177246ada74d212c9f20dadb)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:13.616137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371563b5-dac4-4165-aca0-2c4baa5cfb39 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:13.617920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:13 2022] GET /identity/v3/users/5f9c1bba177246ada74d212c9f20dadb => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:13.618536 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371563b5-dac4-4165-aca0-2c4baa5cfb39 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:13.629496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930b7e7-c960-46b5-a21c-ee176d075f18 None admin] RBAC: Authorizing `identity:get_user(user_id=e85023b8270143b3943eb58af91e46eb)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:13.631011 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930b7e7-c960-46b5-a21c-ee176d075f18 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:13.632701 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 38/74] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:13 2022] GET /identity/v3/users/e85023b8270143b3943eb58af91e46eb => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:13.633946 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de9e11-bf39-49be-be38-8c1a3d10dc28 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:13.634260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de9e11-bf39-49be-be38-8c1a3d10dc28 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:13.634548 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de9e11-bf39-49be-be38-8c1a3d10dc28 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:13.635809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 39/75] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:13.637090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a6a59-64b2-47ba-aaaa-70e108ef525a None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:13.637090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a6a59-64b2-47ba-aaaa-70e108ef525a None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:13.637385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a6a59-64b2-47ba-aaaa-70e108ef525a None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:13.638665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 40/76] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:13.639659 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a6a59-64b2-47ba-aaaa-70e108ef525a None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:13.717714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371563b5-dac4-4165-aca0-2c4baa5cfb39 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:13.739470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a6a59-64b2-47ba-aaaa-70e108ef525a None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:13.748858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85415a43-79a3-425e-91db-d41551e4f519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:13.749518 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85415a43-79a3-425e-91db-d41551e4f519 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:13.749802 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85415a43-79a3-425e-91db-d41551e4f519 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:13.750078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85415a43-79a3-425e-91db-d41551e4f519 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:13.750852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85415a43-79a3-425e-91db-d41551e4f519 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:13.751159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85415a43-79a3-425e-91db-d41551e4f519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:13.752540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85415a43-79a3-425e-91db-d41551e4f519 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:13.760307 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 37/77] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:17:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:13.761117 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85415a43-79a3-425e-91db-d41551e4f519 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:13.771955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803cc9f-8fdb-4181-9c16-223881eb3a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:13.772609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803cc9f-8fdb-4181-9c16-223881eb3a2b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:13.772900 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803cc9f-8fdb-4181-9c16-223881eb3a2b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:13.773182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803cc9f-8fdb-4181-9c16-223881eb3a2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:13.838595 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803cc9f-8fdb-4181-9c16-223881eb3a2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:13.840006 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803cc9f-8fdb-4181-9c16-223881eb3a2b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:13.860435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85415a43-79a3-425e-91db-d41551e4f519 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:13.892718 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e0a7d-d505-4099-87c2-7c555393ae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:13.893364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e0a7d-d505-4099-87c2-7c555393ae7a None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:13.893650 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e0a7d-d505-4099-87c2-7c555393ae7a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:13.893927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e0a7d-d505-4099-87c2-7c555393ae7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:13.935033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 41/78] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:13.936536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c5eb9-aeea-4c3b-a1e7-672dc8ba057d None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:13.936831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c5eb9-aeea-4c3b-a1e7-672dc8ba057d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:13.937116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c5eb9-aeea-4c3b-a1e7-672dc8ba057d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:13.953925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-a61c5eb9-aeea-4c3b-a1e7-672dc8ba057d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:13.955160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a61c5eb9-aeea-4c3b-a1e7-672dc8ba057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:13.960053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e0a7d-d505-4099-87c2-7c555393ae7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:13.961534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e0a7d-d505-4099-87c2-7c555393ae7a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:14.019455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 42/79] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:14.020734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36249e4-d564-42cd-99fc-5447464c7e33 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:14.021062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36249e4-d564-42cd-99fc-5447464c7e33 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:14.021344 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36249e4-d564-42cd-99fc-5447464c7e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:14.037148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-c36249e4-d564-42cd-99fc-5447464c7e33 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:14.038336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c36249e4-d564-42cd-99fc-5447464c7e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:14.057348 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 38/80] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:14.058215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e0a7d-d505-4099-87c2-7c555393ae7a None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:14.106359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 43/81] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:14.108891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36249e4-d564-42cd-99fc-5447464c7e33 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:14.156163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e0a7d-d505-4099-87c2-7c555393ae7a None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:14.188283 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474976d6-18d0-48c8-9d62-e805e192789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:14.189149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474976d6-18d0-48c8-9d62-e805e192789e None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:14.189438 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474976d6-18d0-48c8-9d62-e805e192789e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:14.189721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474976d6-18d0-48c8-9d62-e805e192789e None admin] PATH_INFO: `/v3/users/e85023b8270143b3943eb58af91e46eb` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:14.191014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474976d6-18d0-48c8-9d62-e805e192789e None admin] RBAC: Authorizing `identity:get_user(user_id=e85023b8270143b3943eb58af91e46eb)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:14.192541 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474976d6-18d0-48c8-9d62-e805e192789e None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:14.198754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 39/82] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:14 2022] GET /identity/v3/users/e85023b8270143b3943eb58af91e46eb => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:14.198754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474976d6-18d0-48c8-9d62-e805e192789e None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:14.220767 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36249e4-d564-42cd-99fc-5447464c7e33 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:14.256444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f732c5-2415-4f0e-b236-2d803beb36ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:14.257316 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f732c5-2415-4f0e-b236-2d803beb36ae None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:14.257607 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f732c5-2415-4f0e-b236-2d803beb36ae None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:14.257885 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f732c5-2415-4f0e-b236-2d803beb36ae None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:14.259159 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f732c5-2415-4f0e-b236-2d803beb36ae None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:14.260638 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f732c5-2415-4f0e-b236-2d803beb36ae None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:14.262371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 44/83] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:14 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:14.263146 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f732c5-2415-4f0e-b236-2d803beb36ae None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:14.293495 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474976d6-18d0-48c8-9d62-e805e192789e None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:14.326958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cc46b-ba46-4179-8c04-3e178cc2b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:14.327750 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cc46b-ba46-4179-8c04-3e178cc2b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:14.328038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cc46b-ba46-4179-8c04-3e178cc2b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:14.328320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cc46b-ba46-4179-8c04-3e178cc2b0e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:14.329503 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cc46b-ba46-4179-8c04-3e178cc2b0e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:14.331004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cc46b-ba46-4179-8c04-3e178cc2b0e8 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:14.332865 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 40/84] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:17:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:14.333638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cc46b-ba46-4179-8c04-3e178cc2b0e8 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:14.361629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f732c5-2415-4f0e-b236-2d803beb36ae None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:14.395471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987f406-25a7-49c7-ac1a-09a79ae24384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:14.396332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987f406-25a7-49c7-ac1a-09a79ae24384 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:14.396619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987f406-25a7-49c7-ac1a-09a79ae24384 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:14.396900 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987f406-25a7-49c7-ac1a-09a79ae24384 None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:14.398235 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987f406-25a7-49c7-ac1a-09a79ae24384 None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:14.399709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987f406-25a7-49c7-ac1a-09a79ae24384 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:14.401400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 45/85] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:14 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:14.402205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987f406-25a7-49c7-ac1a-09a79ae24384 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:14.436748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cc46b-ba46-4179-8c04-3e178cc2b0e8 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:14.469439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03bd41-e3d2-429b-9680-f50f9493e5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:14.470253 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03bd41-e3d2-429b-9680-f50f9493e5c7 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:14.470538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03bd41-e3d2-429b-9680-f50f9493e5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:14.470816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03bd41-e3d2-429b-9680-f50f9493e5c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:14.480402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03bd41-e3d2-429b-9680-f50f9493e5c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-ef03bd41-e3d2-429b-9680-f50f9493e5c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:14.489591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:14.490506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:14.491302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:14.491302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:14.491302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:14.491302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:14.491302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:14.491302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:14.491302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:14.491302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:14.491302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:14.491302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:14.491302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:14.491302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:14.491302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 41/86] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:14.491928 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03bd41-e3d2-429b-9680-f50f9493e5c7 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:14.506603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987f406-25a7-49c7-ac1a-09a79ae24384 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:14.540756 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d846c7-3276-4dd2-9821-952439fc19da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:14.541414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d846c7-3276-4dd2-9821-952439fc19da None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:14.541695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d846c7-3276-4dd2-9821-952439fc19da None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:14.541975 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d846c7-3276-4dd2-9821-952439fc19da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:14.596202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03bd41-e3d2-429b-9680-f50f9493e5c7 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:14.610890 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d846c7-3276-4dd2-9821-952439fc19da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:14.612415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d846c7-3276-4dd2-9821-952439fc19da None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:14.628312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc151b02-322f-4f9e-8179-c7df6b9b4f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:14.628967 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc151b02-322f-4f9e-8179-c7df6b9b4f8f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:14.629253 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc151b02-322f-4f9e-8179-c7df6b9b4f8f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:14.629529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc151b02-322f-4f9e-8179-c7df6b9b4f8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:14.630392 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc151b02-322f-4f9e-8179-c7df6b9b4f8f None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=903badc2e08c482fa823407b822580fc, user.id=5f9c1bba177246ada74d212c9f20dadb) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:14.630703 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc151b02-322f-4f9e-8179-c7df6b9b4f8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:14.632149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc151b02-322f-4f9e-8179-c7df6b9b4f8f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:14.637431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 42/87] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:14 2022] GET /identity/v3/role_assignments?user.id=5f9c1bba177246ada74d212c9f20dadb&scope.project.id=903badc2e08c482fa823407b822580fc&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:14.638218 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc151b02-322f-4f9e-8179-c7df6b9b4f8f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:14.715549 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 46/88] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:14.717350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d846c7-3276-4dd2-9821-952439fc19da None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:14.745257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc151b02-322f-4f9e-8179-c7df6b9b4f8f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:14.780861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce86a2-ba39-4c47-854e-2824a0e3468a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:14.781549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce86a2-ba39-4c47-854e-2824a0e3468a None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:14.781838 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce86a2-ba39-4c47-854e-2824a0e3468a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:14.782116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce86a2-ba39-4c47-854e-2824a0e3468a None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:14.782880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce86a2-ba39-4c47-854e-2824a0e3468a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:14.784381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce86a2-ba39-4c47-854e-2824a0e3468a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:14.812394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 43/89] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:17:14 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:17:14.813674 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce86a2-ba39-4c47-854e-2824a0e3468a None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:14.822218 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d846c7-3276-4dd2-9821-952439fc19da None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:14.861750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811b253-7895-4078-a669-87df3d758906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:14.862564 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811b253-7895-4078-a669-87df3d758906 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:14.862722 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811b253-7895-4078-a669-87df3d758906 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:14.866245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811b253-7895-4078-a669-87df3d758906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:14.866245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811b253-7895-4078-a669-87df3d758906 None admin] RBAC: Adding query filter params (role.id=c2cbdedfc238463d91a843ca8e5ac3ca, scope.project.id=903badc2e08c482fa823407b822580fc, user.id=e85023b8270143b3943eb58af91e46eb) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:14.866245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811b253-7895-4078-a669-87df3d758906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:14.866245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811b253-7895-4078-a669-87df3d758906 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:14.871907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 47/90] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:14 2022] GET /identity/v3/role_assignments?user.id=e85023b8270143b3943eb58af91e46eb&scope.project.id=903badc2e08c482fa823407b822580fc&role.id=c2cbdedfc238463d91a843ca8e5ac3ca => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:14.872776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811b253-7895-4078-a669-87df3d758906 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:14.928849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce86a2-ba39-4c47-854e-2824a0e3468a None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:14.967323 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715c22f-65d6-4958-b8e8-f75e9db4661d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:14.968061 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715c22f-65d6-4958-b8e8-f75e9db4661d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:14.968355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715c22f-65d6-4958-b8e8-f75e9db4661d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:14.968638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715c22f-65d6-4958-b8e8-f75e9db4661d None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:14.969415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715c22f-65d6-4958-b8e8-f75e9db4661d None admin] RBAC: Adding query filter params (name=member) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:14.969730 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715c22f-65d6-4958-b8e8-f75e9db4661d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:14.971343 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715c22f-65d6-4958-b8e8-f75e9db4661d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:14.980701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 44/91] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:14.985350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811b253-7895-4078-a669-87df3d758906 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:14.987008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715c22f-65d6-4958-b8e8-f75e9db4661d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:15.023279 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a1ac-e1cd-4272-ade4-a1ec2c799c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:15.024163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a1ac-e1cd-4272-ade4-a1ec2c799c6c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:15.024447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a1ac-e1cd-4272-ade4-a1ec2c799c6c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:15.024735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a1ac-e1cd-4272-ade4-a1ec2c799c6c None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:15.026048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70a1ac-e1cd-4272-ade4-a1ec2c799c6c None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:15.027588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70a1ac-e1cd-4272-ade4-a1ec2c799c6c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:15.029737 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 48/92] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:14 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:15.037660 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a1ac-e1cd-4272-ade4-a1ec2c799c6c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:15.128656 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715c22f-65d6-4958-b8e8-f75e9db4661d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:15.171972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717daef0-56df-47b7-866b-373790124235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:15.172866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717daef0-56df-47b7-866b-373790124235 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:15.173157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717daef0-56df-47b7-866b-373790124235 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:15.173441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717daef0-56df-47b7-866b-373790124235 None admin] PATH_INFO: `/v3/users/e85023b8270143b3943eb58af91e46eb` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:15.174717 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717daef0-56df-47b7-866b-373790124235 None admin] RBAC: Authorizing `identity:get_user(user_id=e85023b8270143b3943eb58af91e46eb)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:15.176192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717daef0-56df-47b7-866b-373790124235 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:15.177828 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 45/93] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:14 2022] GET /identity/v3/users/e85023b8270143b3943eb58af91e46eb => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:15.184076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717daef0-56df-47b7-866b-373790124235 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:15.196836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a1ac-e1cd-4272-ade4-a1ec2c799c6c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:15.237322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51438b12-8eae-4406-884e-72511850da73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:15.237996 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51438b12-8eae-4406-884e-72511850da73 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:15.238308 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51438b12-8eae-4406-884e-72511850da73 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:15.238585 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51438b12-8eae-4406-884e-72511850da73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:15.239431 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51438b12-8eae-4406-884e-72511850da73 None admin] RBAC: Adding query filter params (role.id=c010c38ef8f54067ad2da8aef99dbdcd, scope.project.id=903badc2e08c482fa823407b822580fc, user.id=e85023b8270143b3943eb58af91e46eb) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:15.239739 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51438b12-8eae-4406-884e-72511850da73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:15.241206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51438b12-8eae-4406-884e-72511850da73 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:15.248984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 49/94] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:15 2022] GET /identity/v3/role_assignments?user.id=e85023b8270143b3943eb58af91e46eb&scope.project.id=903badc2e08c482fa823407b822580fc&role.id=c010c38ef8f54067ad2da8aef99dbdcd => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:15.324801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717daef0-56df-47b7-866b-373790124235 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:15.367684 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441d774-d7d9-4290-a300-61ee54a70589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:15.368359 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441d774-d7d9-4290-a300-61ee54a70589 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:15.368689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441d774-d7d9-4290-a300-61ee54a70589 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:15.368967 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441d774-d7d9-4290-a300-61ee54a70589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:15.446123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441d774-d7d9-4290-a300-61ee54a70589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:15.447602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441d774-d7d9-4290-a300-61ee54a70589 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:15.555514 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 46/95] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:15.562082 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51438b12-8eae-4406-884e-72511850da73 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:15.674690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51438b12-8eae-4406-884e-72511850da73 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:15.710207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ea220-62b1-4062-b330-672ff6ef09e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:15.711361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ea220-62b1-4062-b330-672ff6ef09e6 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:15.711815 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ea220-62b1-4062-b330-672ff6ef09e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:15.712258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ea220-62b1-4062-b330-672ff6ef09e6 None admin] PATH_INFO: `/v3/projects/1f99de7e9b504b9ca9a78d805fd84548` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:15.713634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ea220-62b1-4062-b330-672ff6ef09e6 None admin] RBAC: Authorizing `identity:get_project(project_id=1f99de7e9b504b9ca9a78d805fd84548)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:15.715355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ea220-62b1-4062-b330-672ff6ef09e6 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:15.717776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 50/96] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:15 2022] GET /identity/v3/projects/1f99de7e9b504b9ca9a78d805fd84548 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:15.723793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441d774-d7d9-4290-a300-61ee54a70589 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:15.828639 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441d774-d7d9-4290-a300-61ee54a70589 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:15.866453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc4656-5658-49ce-9b9e-958337ee870a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:15.867399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc4656-5658-49ce-9b9e-958337ee870a None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:15.867875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc4656-5658-49ce-9b9e-958337ee870a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:15.868318 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc4656-5658-49ce-9b9e-958337ee870a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:15.869319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc4656-5658-49ce-9b9e-958337ee870a None admin] RBAC: Adding query filter params (role.id=c2cbdedfc238463d91a843ca8e5ac3ca, scope.project.id=1f99de7e9b504b9ca9a78d805fd84548, user.id=e85023b8270143b3943eb58af91e46eb) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:15.869799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc4656-5658-49ce-9b9e-958337ee870a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:15.871535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc4656-5658-49ce-9b9e-958337ee870a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:15.878457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 47/97] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:15 2022] GET /identity/v3/role_assignments?user.id=e85023b8270143b3943eb58af91e46eb&scope.project.id=1f99de7e9b504b9ca9a78d805fd84548&role.id=c2cbdedfc238463d91a843ca8e5ac3ca => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:17.428429 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e376d-03c7-4994-a690-f0cc2bac2383 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:17.428984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e376d-03c7-4994-a690-f0cc2bac2383 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:17.428984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e376d-03c7-4994-a690-f0cc2bac2383 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:17.430631 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 51/98] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:17.436373 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0a691-8261-4c4c-a41f-878438a1a7a1 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:17.437202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0a691-8261-4c4c-a41f-878438a1a7a1 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:17.437681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0a691-8261-4c4c-a41f-878438a1a7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:17.459306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-f8d0a691-8261-4c4c-a41f-878438a1a7a1 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:17.460806 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f8d0a691-8261-4c4c-a41f-878438a1a7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:17.546148 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 48/99] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:17.576285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e376d-03c7-4994-a690-f0cc2bac2383 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:17.720152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e376d-03c7-4994-a690-f0cc2bac2383 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:17.762451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e57342-177d-43f0-8332-c3e4a46808c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:17.763260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e57342-177d-43f0-8332-c3e4a46808c5 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:17.764091 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e57342-177d-43f0-8332-c3e4a46808c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:17.764612 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e57342-177d-43f0-8332-c3e4a46808c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:17.787246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e57342-177d-43f0-8332-c3e4a46808c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-b0e57342-177d-43f0-8332-c3e4a46808c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:17.795149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:17.796116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:17.796869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:17.796869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:17.796869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:17.796869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:17.796869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:17.796869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:17.796869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:17.796869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:17.796869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:17.796869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:17.796869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:17.796869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:17.796869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 52/100] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:17:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:17.802546 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0a691-8261-4c4c-a41f-878438a1a7a1 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:17.880761 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f74329-e907-4f1c-adc9-3dd45402a8bb None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:17.881412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f74329-e907-4f1c-adc9-3dd45402a8bb None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:17.881914 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f74329-e907-4f1c-adc9-3dd45402a8bb None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:17.884146 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 53/101] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:17:17.890016 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858a99c-b38e-4972-8ce2-e43ad9ac11d2 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:17.890587 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858a99c-b38e-4972-8ce2-e43ad9ac11d2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:17.891079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858a99c-b38e-4972-8ce2-e43ad9ac11d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:17.927703 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0a691-8261-4c4c-a41f-878438a1a7a1 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:17.935195 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7858a99c-b38e-4972-8ce2-e43ad9ac11d2 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:17.937125 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7858a99c-b38e-4972-8ce2-e43ad9ac11d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:17.971371 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487644e-ad41-4533-88c3-f1c4719629b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:17.971978 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487644e-ad41-4533-88c3-f1c4719629b8 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:17.972286 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487644e-ad41-4533-88c3-f1c4719629b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:17.972541 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487644e-ad41-4533-88c3-f1c4719629b8 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:17.973305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487644e-ad41-4533-88c3-f1c4719629b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:17.973612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487644e-ad41-4533-88c3-f1c4719629b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:17.975030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487644e-ad41-4533-88c3-f1c4719629b8 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:17.991745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 49/102] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:18.001170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487644e-ad41-4533-88c3-f1c4719629b8 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:18.120512 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 54/103] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:18.155391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487644e-ad41-4533-88c3-f1c4719629b8 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:18.171250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858a99c-b38e-4972-8ce2-e43ad9ac11d2 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:18.209166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb9950-ed03-40c8-8120-75ced0aa9e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:18.210104 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb9950-ed03-40c8-8120-75ced0aa9e99 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:18.210419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb9950-ed03-40c8-8120-75ced0aa9e99 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:18.210695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb9950-ed03-40c8-8120-75ced0aa9e99 None admin] PATH_INFO: `/v3/users/5f9c1bba177246ada74d212c9f20dadb` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:18.211916 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb9950-ed03-40c8-8120-75ced0aa9e99 None admin] RBAC: Authorizing `identity:get_user(user_id=5f9c1bba177246ada74d212c9f20dadb)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:18.213371 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb9950-ed03-40c8-8120-75ced0aa9e99 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:18.215018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 50/104] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:18 2022] GET /identity/v3/users/5f9c1bba177246ada74d212c9f20dadb => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:18.221206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb9950-ed03-40c8-8120-75ced0aa9e99 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:18.317757 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858a99c-b38e-4972-8ce2-e43ad9ac11d2 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:18.363100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc9246-4f74-42bf-8ed2-7e4f1d3d04c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:18.364889 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc9246-4f74-42bf-8ed2-7e4f1d3d04c6 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:18.365654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc9246-4f74-42bf-8ed2-7e4f1d3d04c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:18.366426 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc9246-4f74-42bf-8ed2-7e4f1d3d04c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:18.383443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc9246-4f74-42bf-8ed2-7e4f1d3d04c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-57dc9246-4f74-42bf-8ed2-7e4f1d3d04c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:18.397571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:18.398494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:18.399503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:18.399503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:18.399503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:18.399503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:18.399503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:18.399503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:18.399503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:18.399503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:18.399503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:18.399503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:18.399503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:18.399503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:18.401549 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 55/105] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:18.402957 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916ddef-8b6a-4279-b235-3b468810a46d None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:18.403401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916ddef-8b6a-4279-b235-3b468810a46d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:18.403832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916ddef-8b6a-4279-b235-3b468810a46d None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:18.406014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 56/106] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:18.409462 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916ddef-8b6a-4279-b235-3b468810a46d None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:18.456761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb9950-ed03-40c8-8120-75ced0aa9e99 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:18.492206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843862b-7fcc-4d18-9a5b-af2794de962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:18.493345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843862b-7fcc-4d18-9a5b-af2794de962f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:18.493784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843862b-7fcc-4d18-9a5b-af2794de962f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:18.494237 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843862b-7fcc-4d18-9a5b-af2794de962f None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:18.495679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843862b-7fcc-4d18-9a5b-af2794de962f None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:18.497302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843862b-7fcc-4d18-9a5b-af2794de962f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:18.499685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 51/107] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:18 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:18.501160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04064cb-115f-4e0a-a5a6-d3c6b86a87c7 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:18.501606 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04064cb-115f-4e0a-a5a6-d3c6b86a87c7 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:18.502029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04064cb-115f-4e0a-a5a6-d3c6b86a87c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:18.519870 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-e04064cb-115f-4e0a-a5a6-d3c6b86a87c7 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:18.521311 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e04064cb-115f-4e0a-a5a6-d3c6b86a87c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:18.590778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 52/108] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:18.592054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04064cb-115f-4e0a-a5a6-d3c6b86a87c7 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:18.599900 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916ddef-8b6a-4279-b235-3b468810a46d None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:18.659145 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58277c8-b68c-492a-8952-d1ad4d732795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:18.660402 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58277c8-b68c-492a-8952-d1ad4d732795 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:18.660402 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58277c8-b68c-492a-8952-d1ad4d732795 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:18.660610 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58277c8-b68c-492a-8952-d1ad4d732795 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:18.661359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58277c8-b68c-492a-8952-d1ad4d732795 None admin] RBAC: Adding query filter params (name=member) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:18.661674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58277c8-b68c-492a-8952-d1ad4d732795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:18.663096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58277c8-b68c-492a-8952-d1ad4d732795 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:18.686139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 57/109] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:18.690339 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58277c8-b68c-492a-8952-d1ad4d732795 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:18.699994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04064cb-115f-4e0a-a5a6-d3c6b86a87c7 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:18.738294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b12276-7b07-4080-b04e-062b63a4e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:18.740098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b12276-7b07-4080-b04e-062b63a4e346 None admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:18.741154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b12276-7b07-4080-b04e-062b63a4e346 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:18.741745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b12276-7b07-4080-b04e-062b63a4e346 None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc/users/5f9c1bba177246ada74d212c9f20dadb/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:18.745594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b12276-7b07-4080-b04e-062b63a4e346 None admin] RBAC: Authorizing `identity:create_grant(project_id=903badc2e08c482fa823407b822580fc, user_id=5f9c1bba177246ada74d212c9f20dadb, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:18.747941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b12276-7b07-4080-b04e-062b63a4e346 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:18.774375 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 53/110] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:17:18 2022] PUT /identity/v3/projects/903badc2e08c482fa823407b822580fc/users/5f9c1bba177246ada74d212c9f20dadb/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:17:18.775706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b12276-7b07-4080-b04e-062b63a4e346 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:18.891573 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58277c8-b68c-492a-8952-d1ad4d732795 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:18.938433 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a43301-fb5a-428d-bac9-b35c6a119214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:18.939546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43301-fb5a-428d-bac9-b35c6a119214 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:18.939992 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43301-fb5a-428d-bac9-b35c6a119214 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:18.940424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43301-fb5a-428d-bac9-b35c6a119214 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:18.968768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a43301-fb5a-428d-bac9-b35c6a119214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-d8a43301-fb5a-428d-bac9-b35c6a119214 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:18.977280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:18.978330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:18.979302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:18.979302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:18.979302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:18.979302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:18.979302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:18.979302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:18.979302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:18.979302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:18.979302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:18.979302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:18.979302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:18.979302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:18.992177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 58/111] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:17:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:18.994693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b12276-7b07-4080-b04e-062b63a4e346 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:18.999721 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a43301-fb5a-428d-bac9-b35c6a119214 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:19.066383 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcda45-5037-46ed-96bb-441aa047619b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:19.067277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcda45-5037-46ed-96bb-441aa047619b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:19.067612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcda45-5037-46ed-96bb-441aa047619b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:19.067893 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcda45-5037-46ed-96bb-441aa047619b None admin] PATH_INFO: `/v3/users/e85023b8270143b3943eb58af91e46eb` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:19.075146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcda45-5037-46ed-96bb-441aa047619b None admin] RBAC: Authorizing `identity:get_user(user_id=e85023b8270143b3943eb58af91e46eb)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:19.076742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcda45-5037-46ed-96bb-441aa047619b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:19.078529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 54/112] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:18 2022] GET /identity/v3/users/e85023b8270143b3943eb58af91e46eb => generated 275 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:19.089597 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcda45-5037-46ed-96bb-441aa047619b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:19.153885 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a43301-fb5a-428d-bac9-b35c6a119214 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:19.203953 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43137fce-2e17-46f4-b6eb-76ab4fd9bed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:19.204921 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43137fce-2e17-46f4-b6eb-76ab4fd9bed3 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:19.205425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43137fce-2e17-46f4-b6eb-76ab4fd9bed3 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:19.206628 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43137fce-2e17-46f4-b6eb-76ab4fd9bed3 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:19.207640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43137fce-2e17-46f4-b6eb-76ab4fd9bed3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:19.208174 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43137fce-2e17-46f4-b6eb-76ab4fd9bed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:19.210599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43137fce-2e17-46f4-b6eb-76ab4fd9bed3 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:19.222331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 59/113] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:17:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:19.224774 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253fac8-8e59-45fa-a065-ec3f6e73052a None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:19.225323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253fac8-8e59-45fa-a065-ec3f6e73052a None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:19.225774 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253fac8-8e59-45fa-a065-ec3f6e73052a None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:19.228124 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 60/114] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:19.229698 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9877e3b-51ad-45b8-a9ea-132983a7a826 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:19.230450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9877e3b-51ad-45b8-a9ea-132983a7a826 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:19.231148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9877e3b-51ad-45b8-a9ea-132983a7a826 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:19.233177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 61/115] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:19.233726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcda45-5037-46ed-96bb-441aa047619b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:19.234109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9877e3b-51ad-45b8-a9ea-132983a7a826 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:19.278471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc98a18-b303-45e9-98fd-0e94d2669430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:19.279971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc98a18-b303-45e9-98fd-0e94d2669430 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:19.280260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc98a18-b303-45e9-98fd-0e94d2669430 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:19.280539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc98a18-b303-45e9-98fd-0e94d2669430 None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:19.282382 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc98a18-b303-45e9-98fd-0e94d2669430 None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:19.284059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc98a18-b303-45e9-98fd-0e94d2669430 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:19.285975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 55/116] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:19 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:19.287399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a17899-cd27-490a-88bb-d3acdfaeee4e None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:19.287914 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a17899-cd27-490a-88bb-d3acdfaeee4e None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:19.288391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a17899-cd27-490a-88bb-d3acdfaeee4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:19.306952 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-d6a17899-cd27-490a-88bb-d3acdfaeee4e None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:19.308155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-d6a17899-cd27-490a-88bb-d3acdfaeee4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:19.367084 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9877e3b-51ad-45b8-a9ea-132983a7a826 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:19.386198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 56/117] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:19.386198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29466d2-66cd-4450-b97a-050b0cf76a06 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:19.386198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29466d2-66cd-4450-b97a-050b0cf76a06 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:19.386198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29466d2-66cd-4450-b97a-050b0cf76a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:19.403835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-d29466d2-66cd-4450-b97a-050b0cf76a06 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:19.405254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-d29466d2-66cd-4450-b97a-050b0cf76a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:19.411464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a7084-6332-4c15-9bdd-ebe40d65b5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:19.412341 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a7084-6332-4c15-9bdd-ebe40d65b5a1 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:19.412638 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a7084-6332-4c15-9bdd-ebe40d65b5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:19.412901 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a7084-6332-4c15-9bdd-ebe40d65b5a1 None admin] PATH_INFO: `/v3/users/e85023b8270143b3943eb58af91e46eb` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:19.414293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a7084-6332-4c15-9bdd-ebe40d65b5a1 None admin] RBAC: Authorizing `identity:get_user(user_id=e85023b8270143b3943eb58af91e46eb)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:19.415740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a7084-6332-4c15-9bdd-ebe40d65b5a1 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:19.417348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 62/118] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:19 2022] GET /identity/v3/users/e85023b8270143b3943eb58af91e46eb => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:19.423449 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae25d4b-6cc2-47e0-8f50-d3e1bbbc7c08 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:19.423745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae25d4b-6cc2-47e0-8f50-d3e1bbbc7c08 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:19.424026 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae25d4b-6cc2-47e0-8f50-d3e1bbbc7c08 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:19.425323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 63/119] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:19.427073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae25d4b-6cc2-47e0-8f50-d3e1bbbc7c08 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:19.476841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 57/120] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:19.478398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29466d2-66cd-4450-b97a-050b0cf76a06 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:19.532468 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae25d4b-6cc2-47e0-8f50-d3e1bbbc7c08 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:19.566492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61bea3-b14f-4063-b027-7b8f71793219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:19.567391 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61bea3-b14f-4063-b027-7b8f71793219 None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:19.567681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61bea3-b14f-4063-b027-7b8f71793219 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:19.567963 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61bea3-b14f-4063-b027-7b8f71793219 None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc/users/e85023b8270143b3943eb58af91e46eb/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:19.569948 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61bea3-b14f-4063-b027-7b8f71793219 None admin] RBAC: Authorizing `identity:create_grant(project_id=903badc2e08c482fa823407b822580fc, user_id=e85023b8270143b3943eb58af91e46eb, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:19.571475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61bea3-b14f-4063-b027-7b8f71793219 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:19.586934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 64/121] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:17:19 2022] PUT /identity/v3/projects/903badc2e08c482fa823407b822580fc/users/e85023b8270143b3943eb58af91e46eb/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:17:19.588034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61bea3-b14f-4063-b027-7b8f71793219 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:19.591134 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29466d2-66cd-4450-b97a-050b0cf76a06 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:19.630061 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544401b9-a22b-4596-a9c1-901e602f3baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:19.630695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544401b9-a22b-4596-a9c1-901e602f3baf None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:19.630984 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544401b9-a22b-4596-a9c1-901e602f3baf None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:19.631263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544401b9-a22b-4596-a9c1-901e602f3baf None admin] PATH_INFO: `/v3/domains/default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:19.632531 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544401b9-a22b-4596-a9c1-901e602f3baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:19.634031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544401b9-a22b-4596-a9c1-901e602f3baf None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:19.635946 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 58/122] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:17:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:19.637028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33654e5-b120-45a2-9da7-5a5ad96554b3 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:19.637329 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33654e5-b120-45a2-9da7-5a5ad96554b3 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:19.637611 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33654e5-b120-45a2-9da7-5a5ad96554b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:19.655517 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-d33654e5-b120-45a2-9da7-5a5ad96554b3 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:19.656662 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-d33654e5-b120-45a2-9da7-5a5ad96554b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:19.719273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61bea3-b14f-4063-b027-7b8f71793219 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:19.729210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 59/123] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:19.734488 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33654e5-b120-45a2-9da7-5a5ad96554b3 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:19.782161 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebefeb9-644d-43c8-b4ca-f076cdd52f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:19.783563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebefeb9-644d-43c8-b4ca-f076cdd52f60 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:19.784056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebefeb9-644d-43c8-b4ca-f076cdd52f60 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:19.784773 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebefeb9-644d-43c8-b4ca-f076cdd52f60 None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:19.786203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebefeb9-644d-43c8-b4ca-f076cdd52f60 None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:19.788353 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebefeb9-644d-43c8-b4ca-f076cdd52f60 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:19.790287 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 65/124] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:19 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:19.791842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebefeb9-644d-43c8-b4ca-f076cdd52f60 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:19.841184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33654e5-b120-45a2-9da7-5a5ad96554b3 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:19.883217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40c0be-0b60-4c2f-aefd-4eb3c0b28dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:19.884027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40c0be-0b60-4c2f-aefd-4eb3c0b28dfa None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:19.884316 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40c0be-0b60-4c2f-aefd-4eb3c0b28dfa None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:19.884594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40c0be-0b60-4c2f-aefd-4eb3c0b28dfa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:19.897305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40c0be-0b60-4c2f-aefd-4eb3c0b28dfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-6a40c0be-0b60-4c2f-aefd-4eb3c0b28dfa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:19.907352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:19.908189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:19.908959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:19.908959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:19.908959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:19.908959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:19.908959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:19.908959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:19.908959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:19.908959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:19.908959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:19.908959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:19.908959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:19.908959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:19.909542 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 60/125] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:19.914492 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40c0be-0b60-4c2f-aefd-4eb3c0b28dfa None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:19.918158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebefeb9-644d-43c8-b4ca-f076cdd52f60 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:19.961172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f0646-0ca2-4603-989a-48c5a1e92750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:19.962263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f0646-0ca2-4603-989a-48c5a1e92750 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:19.962561 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f0646-0ca2-4603-989a-48c5a1e92750 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:19.962845 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f0646-0ca2-4603-989a-48c5a1e92750 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:19.963887 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f0646-0ca2-4603-989a-48c5a1e92750 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:19.965817 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f0646-0ca2-4603-989a-48c5a1e92750 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:20.002848 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 66/126] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 14:17:19 2022] POST /identity/v3/projects => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:17:20.007214 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f0646-0ca2-4603-989a-48c5a1e92750 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:20.047822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40c0be-0b60-4c2f-aefd-4eb3c0b28dfa None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:20.118320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49ba2b-8064-412f-859b-099ae6e97408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:20.119151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49ba2b-8064-412f-859b-099ae6e97408 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:20.119440 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49ba2b-8064-412f-859b-099ae6e97408 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:20.119720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49ba2b-8064-412f-859b-099ae6e97408 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:20.144445 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49ba2b-8064-412f-859b-099ae6e97408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-cc49ba2b-8064-412f-859b-099ae6e97408 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:20.160203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:20.162399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:20.164450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:20.164450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:20.164450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:20.164450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:20.164450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:20.164450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:20.164450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:20.164450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:20.164450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:20.164450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:20.164450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:20.164450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:20.164450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 61/127] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:20.170216 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49ba2b-8064-412f-859b-099ae6e97408 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:20.217038 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f0646-0ca2-4603-989a-48c5a1e92750 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:20.278225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7776b-e582-4b97-8b7e-964cb262d67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:20.279202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7776b-e582-4b97-8b7e-964cb262d67a None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:20.279488 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7776b-e582-4b97-8b7e-964cb262d67a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:20.279767 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7776b-e582-4b97-8b7e-964cb262d67a None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc/users/e85023b8270143b3943eb58af91e46eb/roles/c010c38ef8f54067ad2da8aef99dbdcd` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:20.282055 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7776b-e582-4b97-8b7e-964cb262d67a None admin] RBAC: Authorizing `identity:create_grant(project_id=903badc2e08c482fa823407b822580fc, user_id=e85023b8270143b3943eb58af91e46eb, role_id=c010c38ef8f54067ad2da8aef99dbdcd)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:20.283592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7776b-e582-4b97-8b7e-964cb262d67a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:20.300473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 67/128] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:17:20 2022] PUT /identity/v3/projects/903badc2e08c482fa823407b822580fc/users/e85023b8270143b3943eb58af91e46eb/roles/c010c38ef8f54067ad2da8aef99dbdcd => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:17:20.301335 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7776b-e582-4b97-8b7e-964cb262d67a None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:20.351499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49ba2b-8064-412f-859b-099ae6e97408 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:20.433328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251389a-3d6d-469e-bf34-3b2b3d543c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:20.434476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251389a-3d6d-469e-bf34-3b2b3d543c78 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:20.434998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251389a-3d6d-469e-bf34-3b2b3d543c78 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:20.436717 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251389a-3d6d-469e-bf34-3b2b3d543c78 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:20.439739 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251389a-3d6d-469e-bf34-3b2b3d543c78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:20.441485 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251389a-3d6d-469e-bf34-3b2b3d543c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:20.443153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251389a-3d6d-469e-bf34-3b2b3d543c78 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:20.462655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 62/129] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:20.469255 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251389a-3d6d-469e-bf34-3b2b3d543c78 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:20.494455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7776b-e582-4b97-8b7e-964cb262d67a None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:20.538803 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73100e6e-9e71-4cd8-9639-3f3525d23832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:20.539817 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73100e6e-9e71-4cd8-9639-3f3525d23832 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:20.540291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73100e6e-9e71-4cd8-9639-3f3525d23832 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:20.540743 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73100e6e-9e71-4cd8-9639-3f3525d23832 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:20.541672 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73100e6e-9e71-4cd8-9639-3f3525d23832 None admin] RBAC: Adding query filter params (name=member) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:20.542276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73100e6e-9e71-4cd8-9639-3f3525d23832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:20.546469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73100e6e-9e71-4cd8-9639-3f3525d23832 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:20.565751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 68/130] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:20.571630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73100e6e-9e71-4cd8-9639-3f3525d23832 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:20.617710 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251389a-3d6d-469e-bf34-3b2b3d543c78 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:20.660486 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8658824-edd0-45b6-befd-d818bd47f561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:20.661688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8658824-edd0-45b6-befd-d818bd47f561 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:20.662218 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8658824-edd0-45b6-befd-d818bd47f561 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:20.662692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8658824-edd0-45b6-befd-d818bd47f561 None admin] PATH_INFO: `/v3/users/d056aaea467d42b187418bd5cfbc870b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:20.690837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8658824-edd0-45b6-befd-d818bd47f561 None admin] RBAC: Authorizing `identity:get_user(user_id=d056aaea467d42b187418bd5cfbc870b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:20.692627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8658824-edd0-45b6-befd-d818bd47f561 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:20.695213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 63/131] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:20 2022] GET /identity/v3/users/d056aaea467d42b187418bd5cfbc870b => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:20.701418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8658824-edd0-45b6-befd-d818bd47f561 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:20.809851 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73100e6e-9e71-4cd8-9639-3f3525d23832 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:20.818061 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8658824-edd0-45b6-befd-d818bd47f561 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:20.861626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f5394-c8ec-4d3c-84df-51a1bdb44df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:20.862318 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f5394-c8ec-4d3c-84df-51a1bdb44df8 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:20.862611 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f5394-c8ec-4d3c-84df-51a1bdb44df8 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:20.862894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f5394-c8ec-4d3c-84df-51a1bdb44df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:20.890291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b411ff-1388-424a-b15a-0e5a72b6dcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:20.891188 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b411ff-1388-424a-b15a-0e5a72b6dcb1 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:20.891480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b411ff-1388-424a-b15a-0e5a72b6dcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:20.891763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b411ff-1388-424a-b15a-0e5a72b6dcb1 None admin] PATH_INFO: `/v3/users/e85023b8270143b3943eb58af91e46eb` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:20.893221 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b411ff-1388-424a-b15a-0e5a72b6dcb1 None admin] RBAC: Authorizing `identity:get_user(user_id=e85023b8270143b3943eb58af91e46eb)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:20.894720 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b411ff-1388-424a-b15a-0e5a72b6dcb1 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:20.896384 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 69/132] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:20 2022] GET /identity/v3/users/e85023b8270143b3943eb58af91e46eb => generated 275 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:20.919615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b411ff-1388-424a-b15a-0e5a72b6dcb1 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:21.011205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f5394-c8ec-4d3c-84df-51a1bdb44df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:21.012625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f5394-c8ec-4d3c-84df-51a1bdb44df8 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:21.141070 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b411ff-1388-424a-b15a-0e5a72b6dcb1 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:21.166713 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 64/133] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 14:17:21.173887 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f5394-c8ec-4d3c-84df-51a1bdb44df8 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:21.265635 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bffff-517c-48cb-b1b1-1487f9bd7ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:21.266469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bffff-517c-48cb-b1b1-1487f9bd7ed2 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:21.266761 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bffff-517c-48cb-b1b1-1487f9bd7ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:21.267044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bffff-517c-48cb-b1b1-1487f9bd7ed2 None admin] PATH_INFO: `/v3/projects/1f99de7e9b504b9ca9a78d805fd84548` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:21.268277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bffff-517c-48cb-b1b1-1487f9bd7ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=1f99de7e9b504b9ca9a78d805fd84548)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:21.269770 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bffff-517c-48cb-b1b1-1487f9bd7ed2 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:21.271832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 70/134] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:20 2022] GET /identity/v3/projects/1f99de7e9b504b9ca9a78d805fd84548 => generated 312 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:21.278669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bffff-517c-48cb-b1b1-1487f9bd7ed2 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:21.315321 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f5394-c8ec-4d3c-84df-51a1bdb44df8 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:21.383770 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae424ccd-15ed-476b-8ed1-1422d2b941d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:21.384644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae424ccd-15ed-476b-8ed1-1422d2b941d9 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:21.384932 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae424ccd-15ed-476b-8ed1-1422d2b941d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:21.385215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae424ccd-15ed-476b-8ed1-1422d2b941d9 None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:21.386897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae424ccd-15ed-476b-8ed1-1422d2b941d9 None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:21.388956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae424ccd-15ed-476b-8ed1-1422d2b941d9 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:21.391662 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 65/135] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:21 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:21.397714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae424ccd-15ed-476b-8ed1-1422d2b941d9 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:21.480997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bffff-517c-48cb-b1b1-1487f9bd7ed2 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:21.551189 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e2874-1da5-41a0-87b4-bd5c136b7ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:21.552501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e2874-1da5-41a0-87b4-bd5c136b7ec9 None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:21.552985 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e2874-1da5-41a0-87b4-bd5c136b7ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:21.554381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e2874-1da5-41a0-87b4-bd5c136b7ec9 None admin] PATH_INFO: `/v3/projects/1f99de7e9b504b9ca9a78d805fd84548/users/e85023b8270143b3943eb58af91e46eb/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:21.560142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e2874-1da5-41a0-87b4-bd5c136b7ec9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f99de7e9b504b9ca9a78d805fd84548, user_id=e85023b8270143b3943eb58af91e46eb, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:21.563168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e2874-1da5-41a0-87b4-bd5c136b7ec9 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:21.589661 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 71/136] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:17:21 2022] PUT /identity/v3/projects/1f99de7e9b504b9ca9a78d805fd84548/users/e85023b8270143b3943eb58af91e46eb/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:17:21.591752 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b097c94-52db-49bd-9f4e-d422d2e4a529 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:21.592938 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b097c94-52db-49bd-9f4e-d422d2e4a529 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:21.593503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b097c94-52db-49bd-9f4e-d422d2e4a529 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:21.596134 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae424ccd-15ed-476b-8ed1-1422d2b941d9 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:21.597314 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 72/137] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:21.603327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785a71a-3be5-4651-a938-3ba032bcaf1d None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:21.603941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785a71a-3be5-4651-a938-3ba032bcaf1d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:21.604442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785a71a-3be5-4651-a938-3ba032bcaf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:21.643386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-5785a71a-3be5-4651-a938-3ba032bcaf1d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:21.647899 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5785a71a-3be5-4651-a938-3ba032bcaf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:21.674772 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c069c-6c0f-4674-97ed-1f4a6b236a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:21.675436 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c069c-6c0f-4674-97ed-1f4a6b236a7e None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:21.675722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c069c-6c0f-4674-97ed-1f4a6b236a7e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:21.675999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c069c-6c0f-4674-97ed-1f4a6b236a7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:21.676849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c069c-6c0f-4674-97ed-1f4a6b236a7e None admin] RBAC: Adding query filter params (role.id=5c131c170ffc4e1da14872da2dab3928, scope.project.id=903badc2e08c482fa823407b822580fc, user.id=d056aaea467d42b187418bd5cfbc870b) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:21.677164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c069c-6c0f-4674-97ed-1f4a6b236a7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:21.678658 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c069c-6c0f-4674-97ed-1f4a6b236a7e None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:21.692709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 66/138] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:21 2022] GET /identity/v3/role_assignments?user.id=d056aaea467d42b187418bd5cfbc870b&scope.project.id=903badc2e08c482fa823407b822580fc&role.id=5c131c170ffc4e1da14872da2dab3928 => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:21.778351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 73/139] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:21.823525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c069c-6c0f-4674-97ed-1f4a6b236a7e None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:21.943308 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c069c-6c0f-4674-97ed-1f4a6b236a7e None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:21.981351 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6297ba3-34ff-4e85-a682-7609957d602f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:21.982274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6297ba3-34ff-4e85-a682-7609957d602f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:21.982573 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6297ba3-34ff-4e85-a682-7609957d602f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:21.982854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6297ba3-34ff-4e85-a682-7609957d602f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:22.001463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6297ba3-34ff-4e85-a682-7609957d602f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-e6297ba3-34ff-4e85-a682-7609957d602f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:22.008996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:22.009904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:22.011163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:22.011163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:22.011163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:22.011163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:22.011163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:22.011163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:22.011163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:22.011163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:22.011163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:22.011163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:22.011163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:22.011163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:22.011163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 67/140] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:17:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:22.017286 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785a71a-3be5-4651-a938-3ba032bcaf1d None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:22.234005 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785a71a-3be5-4651-a938-3ba032bcaf1d None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:22.304056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85c1ce-3046-428f-8dd5-08ca39274aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:22.304750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85c1ce-3046-428f-8dd5-08ca39274aeb None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:22.305039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85c1ce-3046-428f-8dd5-08ca39274aeb None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:22.305324 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85c1ce-3046-428f-8dd5-08ca39274aeb None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:22.306087 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85c1ce-3046-428f-8dd5-08ca39274aeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:22.306446 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85c1ce-3046-428f-8dd5-08ca39274aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:22.307862 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85c1ce-3046-428f-8dd5-08ca39274aeb None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:22.321200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 74/141] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:22.327682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6297ba3-34ff-4e85-a682-7609957d602f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:22.439203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6297ba3-34ff-4e85-a682-7609957d602f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:22.477349 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c965de-d5f9-457b-8f86-d982e04f5943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:22.478159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c965de-d5f9-457b-8f86-d982e04f5943 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:22.478471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c965de-d5f9-457b-8f86-d982e04f5943 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:22.478762 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c965de-d5f9-457b-8f86-d982e04f5943 None admin] PATH_INFO: `/v3/users/5f9c1bba177246ada74d212c9f20dadb` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:22.483664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c965de-d5f9-457b-8f86-d982e04f5943 None admin] RBAC: Authorizing `identity:get_user(user_id=5f9c1bba177246ada74d212c9f20dadb)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:22.484899 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c965de-d5f9-457b-8f86-d982e04f5943 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:22.486545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 68/142] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:22 2022] GET /identity/v3/users/5f9c1bba177246ada74d212c9f20dadb => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:22.492283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85c1ce-3046-428f-8dd5-08ca39274aeb None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:22.620357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85c1ce-3046-428f-8dd5-08ca39274aeb None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:22.662913 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ea326-bf29-4b4f-952d-5ef844e6e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:22.663590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ea326-bf29-4b4f-952d-5ef844e6e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:22.663878 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ea326-bf29-4b4f-952d-5ef844e6e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:22.664161 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ea326-bf29-4b4f-952d-5ef844e6e6f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:22.750141 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ea326-bf29-4b4f-952d-5ef844e6e6f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:22.751583 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ea326-bf29-4b4f-952d-5ef844e6e6f4 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:22.874563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 75/143] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 14:17:22.880279 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c965de-d5f9-457b-8f86-d982e04f5943 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:22.899712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91273a80-887e-4327-86eb-d4cd5c269d47 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:22.900031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91273a80-887e-4327-86eb-d4cd5c269d47 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:22.900286 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91273a80-887e-4327-86eb-d4cd5c269d47 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:22.901719 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 76/144] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:17:22.907498 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920b40-0a07-4a4a-bb62-c3fe43310fa5 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:22.907808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920b40-0a07-4a4a-bb62-c3fe43310fa5 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:22.908067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920b40-0a07-4a4a-bb62-c3fe43310fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:22.946003 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-1f920b40-0a07-4a4a-bb62-c3fe43310fa5 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:22.948199 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1f920b40-0a07-4a4a-bb62-c3fe43310fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:23.081611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 77/145] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:23.092922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c965de-d5f9-457b-8f86-d982e04f5943 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:23.117674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f920b40-0a07-4a4a-bb62-c3fe43310fa5 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:23.159824 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767b69f-c898-4dec-88f7-1b6fc91c9e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:23.160715 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767b69f-c898-4dec-88f7-1b6fc91c9e78 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:23.161006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767b69f-c898-4dec-88f7-1b6fc91c9e78 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:23.161291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767b69f-c898-4dec-88f7-1b6fc91c9e78 None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:23.162557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767b69f-c898-4dec-88f7-1b6fc91c9e78 None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:23.164047 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767b69f-c898-4dec-88f7-1b6fc91c9e78 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:23.166073 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 69/146] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:22 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:23.172536 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767b69f-c898-4dec-88f7-1b6fc91c9e78 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:23.284897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767b69f-c898-4dec-88f7-1b6fc91c9e78 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:23.323893 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b75145-e2ec-409c-bc09-1d23294bcee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:23.324566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b75145-e2ec-409c-bc09-1d23294bcee6 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:23.324880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b75145-e2ec-409c-bc09-1d23294bcee6 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:23.325131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b75145-e2ec-409c-bc09-1d23294bcee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:23.326563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b75145-e2ec-409c-bc09-1d23294bcee6 None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=903badc2e08c482fa823407b822580fc, user.id=5f9c1bba177246ada74d212c9f20dadb) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:23.327089 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b75145-e2ec-409c-bc09-1d23294bcee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:23.328345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b75145-e2ec-409c-bc09-1d23294bcee6 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:23.338341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 70/147] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:23 2022] GET /identity/v3/role_assignments?user.id=5f9c1bba177246ada74d212c9f20dadb&scope.project.id=903badc2e08c482fa823407b822580fc&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:23.339539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beb305-fa60-4efc-9643-170f4a90cf6d None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:23.339946 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beb305-fa60-4efc-9643-170f4a90cf6d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:23.340149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beb305-fa60-4efc-9643-170f4a90cf6d None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:23.341366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 71/148] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:23.361732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f920b40-0a07-4a4a-bb62-c3fe43310fa5 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:23.373834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3a778-7f74-466a-b0c3-c719bad85f11 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:23.373965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3a778-7f74-466a-b0c3-c719bad85f11 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:23.374233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3a778-7f74-466a-b0c3-c719bad85f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:23.408536 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c8c3a778-7f74-466a-b0c3-c719bad85f11 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:23.409771 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c8c3a778-7f74-466a-b0c3-c719bad85f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:23.452221 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf8843-a2d5-4aef-a39d-24e26a1316e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:23.453080 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf8843-a2d5-4aef-a39d-24e26a1316e6 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:23.453368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf8843-a2d5-4aef-a39d-24e26a1316e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:23.453647 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf8843-a2d5-4aef-a39d-24e26a1316e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:23.479371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf8843-a2d5-4aef-a39d-24e26a1316e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-e0cf8843-a2d5-4aef-a39d-24e26a1316e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:23.488245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:23.489163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:23.490409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:23.490409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:23.490409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:23.490409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:23.490409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:23.490409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:23.490409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:23.490409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:23.490409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:23.490409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:23.490409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:23.490409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:23.490409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 78/149] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:17:23.506598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf8843-a2d5-4aef-a39d-24e26a1316e6 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:23.562527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 72/150] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:23.611490 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3a778-7f74-466a-b0c3-c719bad85f11 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:23.633199 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf8843-a2d5-4aef-a39d-24e26a1316e6 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:23.678883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14769c44-61ec-4909-9a9a-90281196d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:23.680592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14769c44-61ec-4909-9a9a-90281196d870 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:23.686962 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14769c44-61ec-4909-9a9a-90281196d870 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:23.687561 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14769c44-61ec-4909-9a9a-90281196d870 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:23.689963 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14769c44-61ec-4909-9a9a-90281196d870 None admin] RBAC: Adding query filter params (name=member) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:23.690500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14769c44-61ec-4909-9a9a-90281196d870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:23.694402 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14769c44-61ec-4909-9a9a-90281196d870 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:23.714334 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 79/151] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:23.719786 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14769c44-61ec-4909-9a9a-90281196d870 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:23.810904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3a778-7f74-466a-b0c3-c719bad85f11 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:23.847644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14769c44-61ec-4909-9a9a-90281196d870 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:23.854189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697517bc-c0d5-4723-bbcb-6839bb21fd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:23.855055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697517bc-c0d5-4723-bbcb-6839bb21fd76 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:23.855392 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697517bc-c0d5-4723-bbcb-6839bb21fd76 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:23.855680 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697517bc-c0d5-4723-bbcb-6839bb21fd76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:23.856866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697517bc-c0d5-4723-bbcb-6839bb21fd76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:23.858793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697517bc-c0d5-4723-bbcb-6839bb21fd76 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:23.861167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 73/152] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:17:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:23.862463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f286e22-21f9-45bd-bc1d-2e4ee8ab6e05 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:23.862701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f286e22-21f9-45bd-bc1d-2e4ee8ab6e05 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:23.862980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f286e22-21f9-45bd-bc1d-2e4ee8ab6e05 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:23.864212 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 74/153] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:23.868742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f286e22-21f9-45bd-bc1d-2e4ee8ab6e05 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:23.894904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e612301-be77-4b48-84d9-5b084f1a8b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:23.895792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e612301-be77-4b48-84d9-5b084f1a8b71 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:23.896081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e612301-be77-4b48-84d9-5b084f1a8b71 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:23.896363 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e612301-be77-4b48-84d9-5b084f1a8b71 None admin] PATH_INFO: `/v3/users/e85023b8270143b3943eb58af91e46eb` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:23.897582 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e612301-be77-4b48-84d9-5b084f1a8b71 None admin] RBAC: Authorizing `identity:get_user(user_id=e85023b8270143b3943eb58af91e46eb)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:23.899115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e612301-be77-4b48-84d9-5b084f1a8b71 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:23.900861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 80/154] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:23 2022] GET /identity/v3/users/e85023b8270143b3943eb58af91e46eb => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:23.902030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6529665-79b7-46d2-9376-845403baa975 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:23.903464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6529665-79b7-46d2-9376-845403baa975 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:23.903757 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6529665-79b7-46d2-9376-845403baa975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:23.927963 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-c6529665-79b7-46d2-9376-845403baa975 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:23.929611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c6529665-79b7-46d2-9376-845403baa975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:23.982581 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f286e22-21f9-45bd-bc1d-2e4ee8ab6e05 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:24.017038 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 81/155] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:24.017902 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6529665-79b7-46d2-9376-845403baa975 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:24.030107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ec19b-36c8-4210-969f-f7953cef693b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:24.030471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ec19b-36c8-4210-969f-f7953cef693b None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:24.030754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ec19b-36c8-4210-969f-f7953cef693b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:24.031023 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ec19b-36c8-4210-969f-f7953cef693b None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:24.031743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ec19b-36c8-4210-969f-f7953cef693b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:24.033208 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ec19b-36c8-4210-969f-f7953cef693b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:24.068304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 75/156] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:17:23 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:17:24.069152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ec19b-36c8-4210-969f-f7953cef693b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:24.161892 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6529665-79b7-46d2-9376-845403baa975 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:24.207635 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252d301-6bf1-42aa-98b4-99bc85b5de7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:24.208650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252d301-6bf1-42aa-98b4-99bc85b5de7c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:24.209235 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252d301-6bf1-42aa-98b4-99bc85b5de7c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:24.209530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252d301-6bf1-42aa-98b4-99bc85b5de7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:24.258203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ec19b-36c8-4210-969f-f7953cef693b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:24.316728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252d301-6bf1-42aa-98b4-99bc85b5de7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:24.318354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252d301-6bf1-42aa-98b4-99bc85b5de7c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:24.345715 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d2fab-e4d4-49dc-aba2-29444ef55b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:24.346571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d2fab-e4d4-49dc-aba2-29444ef55b31 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:24.346858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d2fab-e4d4-49dc-aba2-29444ef55b31 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:24.347138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d2fab-e4d4-49dc-aba2-29444ef55b31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:24.359199 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d2fab-e4d4-49dc-aba2-29444ef55b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-820d2fab-e4d4-49dc-aba2-29444ef55b31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:24.369631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:24.370612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:24.371781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:24.371781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:24.371781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:24.371781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:24.371781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:24.371781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:24.371781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:24.371781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:24.371781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:24.371781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:24.371781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:24.371781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:24.371781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 76/157] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:17:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:24.377536 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d2fab-e4d4-49dc-aba2-29444ef55b31 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:24.424693 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 82/158] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:24.430133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252d301-6bf1-42aa-98b4-99bc85b5de7c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:24.484776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d2fab-e4d4-49dc-aba2-29444ef55b31 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:24.526422 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf40e4e-d700-40fd-ac7f-c4242d3b5dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:24.527101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf40e4e-d700-40fd-ac7f-c4242d3b5dae None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:24.527360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf40e4e-d700-40fd-ac7f-c4242d3b5dae None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:24.527646 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf40e4e-d700-40fd-ac7f-c4242d3b5dae None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:24.528416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf40e4e-d700-40fd-ac7f-c4242d3b5dae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:24.528725 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf40e4e-d700-40fd-ac7f-c4242d3b5dae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:24.531241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf40e4e-d700-40fd-ac7f-c4242d3b5dae None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:24.535938 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252d301-6bf1-42aa-98b4-99bc85b5de7c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:24.541018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 77/159] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:17:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:24.546743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf40e4e-d700-40fd-ac7f-c4242d3b5dae None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:24.572684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b990b8e-e1be-438d-ac9a-066c057887a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:24.573606 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b990b8e-e1be-438d-ac9a-066c057887a6 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:24.573893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b990b8e-e1be-438d-ac9a-066c057887a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:24.574185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b990b8e-e1be-438d-ac9a-066c057887a6 None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:24.575415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b990b8e-e1be-438d-ac9a-066c057887a6 None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:24.577827 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b990b8e-e1be-438d-ac9a-066c057887a6 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:24.580003 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 83/160] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:24 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:24.585945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b990b8e-e1be-438d-ac9a-066c057887a6 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:24.657333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf40e4e-d700-40fd-ac7f-c4242d3b5dae None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:24.692527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b990b8e-e1be-438d-ac9a-066c057887a6 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:24.693164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e246c-9a40-40f3-baff-1beee4f47be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:24.694075 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e246c-9a40-40f3-baff-1beee4f47be4 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:24.694391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e246c-9a40-40f3-baff-1beee4f47be4 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:24.694670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e246c-9a40-40f3-baff-1beee4f47be4 None admin] PATH_INFO: `/v3/users/e85023b8270143b3943eb58af91e46eb` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:24.696011 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e246c-9a40-40f3-baff-1beee4f47be4 None admin] RBAC: Authorizing `identity:get_user(user_id=e85023b8270143b3943eb58af91e46eb)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:24.697550 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e246c-9a40-40f3-baff-1beee4f47be4 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:24.699697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 78/161] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:24 2022] GET /identity/v3/users/e85023b8270143b3943eb58af91e46eb => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:24.705644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e246c-9a40-40f3-baff-1beee4f47be4 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:24.733478 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea9438-7adf-4263-94b9-125a03832d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:24.733880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea9438-7adf-4263-94b9-125a03832d67 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:24.734254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea9438-7adf-4263-94b9-125a03832d67 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:24.734539 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea9438-7adf-4263-94b9-125a03832d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:24.735516 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea9438-7adf-4263-94b9-125a03832d67 None admin] RBAC: Adding query filter params (role.id=c2cbdedfc238463d91a843ca8e5ac3ca, scope.project.id=903badc2e08c482fa823407b822580fc, user.id=e85023b8270143b3943eb58af91e46eb) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:24.735836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea9438-7adf-4263-94b9-125a03832d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:24.737347 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea9438-7adf-4263-94b9-125a03832d67 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:24.745824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 84/162] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:24 2022] GET /identity/v3/role_assignments?user.id=e85023b8270143b3943eb58af91e46eb&scope.project.id=903badc2e08c482fa823407b822580fc&role.id=c2cbdedfc238463d91a843ca8e5ac3ca => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:24.831934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e246c-9a40-40f3-baff-1beee4f47be4 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:24.872627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d102e38-96da-4c6c-a09a-a9f4403a4830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:24.873526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d102e38-96da-4c6c-a09a-a9f4403a4830 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:24.873782 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d102e38-96da-4c6c-a09a-a9f4403a4830 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:24.873995 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d102e38-96da-4c6c-a09a-a9f4403a4830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:24.931454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc3465-5754-4366-9f7b-f6aff7abb3e9 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:24.931783 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc3465-5754-4366-9f7b-f6aff7abb3e9 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:24.932012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc3465-5754-4366-9f7b-f6aff7abb3e9 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:24.933722 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 85/163] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:24.940862 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf9b16-ef19-40a1-bb5b-5bbaef186e93 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:24.941171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf9b16-ef19-40a1-bb5b-5bbaef186e93 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:24.941418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf9b16-ef19-40a1-bb5b-5bbaef186e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:24.949646 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d102e38-96da-4c6c-a09a-a9f4403a4830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:24.951609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d102e38-96da-4c6c-a09a-a9f4403a4830 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:24.972769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-cedf9b16-ef19-40a1-bb5b-5bbaef186e93 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:24.974312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-cedf9b16-ef19-40a1-bb5b-5bbaef186e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:25.079364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 79/164] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:25.080959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8ba4a-5b77-4189-822e-79ffd086c5f2 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:25.081506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8ba4a-5b77-4189-822e-79ffd086c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:25.081786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8ba4a-5b77-4189-822e-79ffd086c5f2 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:25.083033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 86/165] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:25.087596 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf9b16-ef19-40a1-bb5b-5bbaef186e93 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:25.087976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 80/166] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:25.095070 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cdaa1-7802-4bd7-9f25-d2197987c242 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:25.095357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cdaa1-7802-4bd7-9f25-d2197987c242 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:25.095637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cdaa1-7802-4bd7-9f25-d2197987c242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:25.116050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-129cdaa1-7802-4bd7-9f25-d2197987c242 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:25.117258 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-129cdaa1-7802-4bd7-9f25-d2197987c242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:25.215646 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 81/167] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:25.216634 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cdaa1-7802-4bd7-9f25-d2197987c242 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:25.221682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf9b16-ef19-40a1-bb5b-5bbaef186e93 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:25.265307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fd4bc-b6cd-4245-9dc3-be9e394c5652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:25.266527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fd4bc-b6cd-4245-9dc3-be9e394c5652 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:25.266986 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fd4bc-b6cd-4245-9dc3-be9e394c5652 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:25.267432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fd4bc-b6cd-4245-9dc3-be9e394c5652 None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:25.268823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fd4bc-b6cd-4245-9dc3-be9e394c5652 None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:25.270488 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fd4bc-b6cd-4245-9dc3-be9e394c5652 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:25.272404 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 87/168] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:25 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:25.273520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fd4bc-b6cd-4245-9dc3-be9e394c5652 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:25.333587 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cdaa1-7802-4bd7-9f25-d2197987c242 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:25.369643 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ecec3-ff86-42ec-b3a1-dee43bd5342e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:25.370460 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ecec3-ff86-42ec-b3a1-dee43bd5342e None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:25.370739 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ecec3-ff86-42ec-b3a1-dee43bd5342e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:25.371008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ecec3-ff86-42ec-b3a1-dee43bd5342e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:25.382545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ecec3-ff86-42ec-b3a1-dee43bd5342e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-194ecec3-ff86-42ec-b3a1-dee43bd5342e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:25.391080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:25.392163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:25.393135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:25.393135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:25.393135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:25.393135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:25.393135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:25.393135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:25.393135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:25.393135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:25.393135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:25.393135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:25.393135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:25.393135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:25.395111 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 82/169] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:25.396027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ecec3-ff86-42ec-b3a1-dee43bd5342e None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:25.401292 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fd4bc-b6cd-4245-9dc3-be9e394c5652 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:25.468254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465493f-21b2-4342-a229-846901c8286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:25.468990 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465493f-21b2-4342-a229-846901c8286e None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:25.469273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465493f-21b2-4342-a229-846901c8286e None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:25.469547 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465493f-21b2-4342-a229-846901c8286e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:25.495124 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465493f-21b2-4342-a229-846901c8286e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-6465493f-21b2-4342-a229-846901c8286e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:25.503012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:25.504473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:25.505277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:25.505277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:25.505277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:25.505277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:25.505277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:25.505277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:25.505277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:25.505277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:25.505277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:25.505277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:25.505277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:25.505277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:25.505277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 88/170] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:25.521898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465493f-21b2-4342-a229-846901c8286e None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:25.580916 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ecec3-ff86-42ec-b3a1-dee43bd5342e None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:25.648087 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de888a6-c921-416e-ae5b-24dea7e2b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:25.648745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de888a6-c921-416e-ae5b-24dea7e2b220 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:25.649026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de888a6-c921-416e-ae5b-24dea7e2b220 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:25.649298 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de888a6-c921-416e-ae5b-24dea7e2b220 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:25.650146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de888a6-c921-416e-ae5b-24dea7e2b220 None admin] RBAC: Adding query filter params (role.id=c010c38ef8f54067ad2da8aef99dbdcd, scope.project.id=903badc2e08c482fa823407b822580fc, user.id=e85023b8270143b3943eb58af91e46eb) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:25.650479 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de888a6-c921-416e-ae5b-24dea7e2b220 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:25.651962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de888a6-c921-416e-ae5b-24dea7e2b220 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:25.667556 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 83/171] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:25 2022] GET /identity/v3/role_assignments?user.id=e85023b8270143b3943eb58af91e46eb&scope.project.id=903badc2e08c482fa823407b822580fc&role.id=c010c38ef8f54067ad2da8aef99dbdcd => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:25.668480 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de888a6-c921-416e-ae5b-24dea7e2b220 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:25.725636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465493f-21b2-4342-a229-846901c8286e None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:25.773958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de888a6-c921-416e-ae5b-24dea7e2b220 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:25.806940 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6220825-fb03-45c5-97ce-595351cf22af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:25.807637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6220825-fb03-45c5-97ce-595351cf22af None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:25.807922 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6220825-fb03-45c5-97ce-595351cf22af None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:25.808204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6220825-fb03-45c5-97ce-595351cf22af None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:25.808968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6220825-fb03-45c5-97ce-595351cf22af None admin] RBAC: Adding query filter params (name=member) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:25.809282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6220825-fb03-45c5-97ce-595351cf22af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:25.810970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6220825-fb03-45c5-97ce-595351cf22af None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:25.811737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0530e2a-df53-49de-9c11-a4929611fcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:25.812416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0530e2a-df53-49de-9c11-a4929611fcb2 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:25.812698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0530e2a-df53-49de-9c11-a4929611fcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:25.812977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0530e2a-df53-49de-9c11-a4929611fcb2 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:25.813744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0530e2a-df53-49de-9c11-a4929611fcb2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:25.814053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0530e2a-df53-49de-9c11-a4929611fcb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:25.815539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0530e2a-df53-49de-9c11-a4929611fcb2 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:25.824898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 84/172] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:25.832484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0530e2a-df53-49de-9c11-a4929611fcb2 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:25.835445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 89/173] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:25.861247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6220825-fb03-45c5-97ce-595351cf22af None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:26.011929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0530e2a-df53-49de-9c11-a4929611fcb2 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:26.029664 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6220825-fb03-45c5-97ce-595351cf22af None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:26.075515 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f96cc-61ad-40dc-9701-5a24b0873b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:26.076715 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d536340-1e25-4c96-bfe4-5d417ce72020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:26.076982 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f96cc-61ad-40dc-9701-5a24b0873b60 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:26.077261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f96cc-61ad-40dc-9701-5a24b0873b60 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:26.077536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f96cc-61ad-40dc-9701-5a24b0873b60 None admin] PATH_INFO: `/v3/users/e85023b8270143b3943eb58af91e46eb` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:26.078543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d536340-1e25-4c96-bfe4-5d417ce72020 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:26.078777 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f96cc-61ad-40dc-9701-5a24b0873b60 None admin] RBAC: Authorizing `identity:get_user(user_id=e85023b8270143b3943eb58af91e46eb)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:26.079273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d536340-1e25-4c96-bfe4-5d417ce72020 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:26.079731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d536340-1e25-4c96-bfe4-5d417ce72020 None admin] PATH_INFO: `/v3/users/d056aaea467d42b187418bd5cfbc870b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:26.080279 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f96cc-61ad-40dc-9701-5a24b0873b60 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:26.086210 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 90/174] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:25 2022] GET /identity/v3/users/e85023b8270143b3943eb58af91e46eb => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:26.087169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d536340-1e25-4c96-bfe4-5d417ce72020 None admin] RBAC: Authorizing `identity:get_user(user_id=d056aaea467d42b187418bd5cfbc870b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:26.087730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f96cc-61ad-40dc-9701-5a24b0873b60 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:26.089045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d536340-1e25-4c96-bfe4-5d417ce72020 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:26.090951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 85/175] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:25 2022] GET /identity/v3/users/d056aaea467d42b187418bd5cfbc870b => generated 289 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:26.099305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d536340-1e25-4c96-bfe4-5d417ce72020 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:26.261800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f96cc-61ad-40dc-9701-5a24b0873b60 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:26.275501 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d536340-1e25-4c96-bfe4-5d417ce72020 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:26.320236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2537dfc-7416-4fb2-a0e4-6d5d32ce47da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:26.321572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2537dfc-7416-4fb2-a0e4-6d5d32ce47da None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:26.322071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2537dfc-7416-4fb2-a0e4-6d5d32ce47da None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:26.322563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2537dfc-7416-4fb2-a0e4-6d5d32ce47da None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:26.324012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2537dfc-7416-4fb2-a0e4-6d5d32ce47da None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:26.326704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2537dfc-7416-4fb2-a0e4-6d5d32ce47da None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:26.332567 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 86/176] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:26 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:26.337781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2537dfc-7416-4fb2-a0e4-6d5d32ce47da None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:26.342045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d78607-843a-4608-9425-a59c674b696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:26.343173 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d78607-843a-4608-9425-a59c674b696f None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:26.344420 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d78607-843a-4608-9425-a59c674b696f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:26.344897 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d78607-843a-4608-9425-a59c674b696f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:26.426514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d78607-843a-4608-9425-a59c674b696f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:26.428434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d78607-843a-4608-9425-a59c674b696f None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:26.532605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 91/177] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 14:17:26.537335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2537dfc-7416-4fb2-a0e4-6d5d32ce47da None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:26.538842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d78607-843a-4608-9425-a59c674b696f None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:26.611021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d7a7c-1ad9-4c8d-ae06-39df50f24689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:26.612018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d7a7c-1ad9-4c8d-ae06-39df50f24689 None admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:26.612311 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d7a7c-1ad9-4c8d-ae06-39df50f24689 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:26.612583 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d7a7c-1ad9-4c8d-ae06-39df50f24689 None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc/users/d056aaea467d42b187418bd5cfbc870b/roles/5c131c170ffc4e1da14872da2dab3928` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:26.614832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d7a7c-1ad9-4c8d-ae06-39df50f24689 None admin] RBAC: Authorizing `identity:create_grant(project_id=903badc2e08c482fa823407b822580fc, user_id=d056aaea467d42b187418bd5cfbc870b, role_id=5c131c170ffc4e1da14872da2dab3928)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:26.616325 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d7a7c-1ad9-4c8d-ae06-39df50f24689 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:26.640947 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 87/178] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:17:26 2022] PUT /identity/v3/projects/903badc2e08c482fa823407b822580fc/users/d056aaea467d42b187418bd5cfbc870b/roles/5c131c170ffc4e1da14872da2dab3928 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:17:26.644895 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d78607-843a-4608-9425-a59c674b696f None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:26.682641 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866016e-9a99-4359-a0f9-cee3f73f4fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:26.683898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866016e-9a99-4359-a0f9-cee3f73f4fbd None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:26.684417 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866016e-9a99-4359-a0f9-cee3f73f4fbd None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:26.684887 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866016e-9a99-4359-a0f9-cee3f73f4fbd None admin] PATH_INFO: `/v3/projects/1f99de7e9b504b9ca9a78d805fd84548` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:26.686895 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866016e-9a99-4359-a0f9-cee3f73f4fbd None admin] RBAC: Authorizing `identity:get_project(project_id=1f99de7e9b504b9ca9a78d805fd84548)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:26.688547 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866016e-9a99-4359-a0f9-cee3f73f4fbd None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:26.690484 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 92/179] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:26 2022] GET /identity/v3/projects/1f99de7e9b504b9ca9a78d805fd84548 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:26.698323 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d7a7c-1ad9-4c8d-ae06-39df50f24689 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:26.850305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d7a7c-1ad9-4c8d-ae06-39df50f24689 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:26.907289 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202907e-93f6-45f1-b5fd-c42bb90ede89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:26.907977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202907e-93f6-45f1-b5fd-c42bb90ede89 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:26.908265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202907e-93f6-45f1-b5fd-c42bb90ede89 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:26.908547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202907e-93f6-45f1-b5fd-c42bb90ede89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:26.909402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202907e-93f6-45f1-b5fd-c42bb90ede89 None admin] RBAC: Adding query filter params (role.id=c2cbdedfc238463d91a843ca8e5ac3ca, scope.project.id=1f99de7e9b504b9ca9a78d805fd84548, user.id=e85023b8270143b3943eb58af91e46eb) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:26.909717 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202907e-93f6-45f1-b5fd-c42bb90ede89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:26.911223 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202907e-93f6-45f1-b5fd-c42bb90ede89 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:26.923376 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 88/180] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:26 2022] GET /identity/v3/role_assignments?user.id=e85023b8270143b3943eb58af91e46eb&scope.project.id=1f99de7e9b504b9ca9a78d805fd84548&role.id=c2cbdedfc238463d91a843ca8e5ac3ca => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:27.586332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2348d4b-e9a9-495b-9745-37450415d9d9 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:27.586839 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2348d4b-e9a9-495b-9745-37450415d9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:27.586839 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2348d4b-e9a9-495b-9745-37450415d9d9 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:27.588214 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 93/181] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:27.593716 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d11b1-aa58-45d2-a97a-f668c264eeb8 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:27.594243 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d11b1-aa58-45d2-a97a-f668c264eeb8 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:27.594353 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d11b1-aa58-45d2-a97a-f668c264eeb8 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:27.595941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 89/182] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:27.599461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d408d-f991-45d9-aae8-db61c41a89d9 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:27.599830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d408d-f991-45d9-aae8-db61c41a89d9 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:27.600121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d408d-f991-45d9-aae8-db61c41a89d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:27.601438 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745235c-7026-4fd7-9f5e-d33ad66dc3c5 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:27.601700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745235c-7026-4fd7-9f5e-d33ad66dc3c5 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:27.601976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745235c-7026-4fd7-9f5e-d33ad66dc3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:27.623240 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-ec9d408d-f991-45d9-aae8-db61c41a89d9 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:27.624820 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ec9d408d-f991-45d9-aae8-db61c41a89d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:27.626275 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-d745235c-7026-4fd7-9f5e-d33ad66dc3c5 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:27.627651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-d745235c-7026-4fd7-9f5e-d33ad66dc3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:27.694347 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 94/183] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:27.711798 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 90/184] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:27.718611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d408d-f991-45d9-aae8-db61c41a89d9 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:27.735498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745235c-7026-4fd7-9f5e-d33ad66dc3c5 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:27.835075 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745235c-7026-4fd7-9f5e-d33ad66dc3c5 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:27.841018 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d408d-f991-45d9-aae8-db61c41a89d9 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:27.870742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3d56e-019a-484d-a0d8-db87da5e76ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:27.871564 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d56e-019a-484d-a0d8-db87da5e76ea None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:27.871845 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d56e-019a-484d-a0d8-db87da5e76ea None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:27.872096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d56e-019a-484d-a0d8-db87da5e76ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:27.876306 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dd10d-a435-4532-a351-a7695280f878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:27.877104 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dd10d-a435-4532-a351-a7695280f878 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:27.877383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dd10d-a435-4532-a351-a7695280f878 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:27.877652 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dd10d-a435-4532-a351-a7695280f878 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:27.882090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3d56e-019a-484d-a0d8-db87da5e76ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:27.887429 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dd10d-a435-4532-a351-a7695280f878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-d0d3d56e-019a-484d-a0d8-db87da5e76ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:27.889733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:27.890625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:27.891409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:27.891409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:27.891409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:27.891409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:27.891409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:27.891409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:27.891409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:27.891409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:27.891409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:27.891409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:27.891409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:27.891409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:27.891409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 91/185] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:17:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:17:27.897398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa79b45-47f3-476e-b151-0df03e29d713 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:27.897398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa79b45-47f3-476e-b151-0df03e29d713 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:27.897398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa79b45-47f3-476e-b151-0df03e29d713 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:27.897398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 92/186] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-2e1dd10d-a435-4532-a351-a7695280f878 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:27.897676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:27.898676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:27.899454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:27.899454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:27.899454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:27.899454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:27.899454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:27.899454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:27.899454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:27.899454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:27.899454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:27.899454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:27.899454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:27.899454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:27.899454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 95/187] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:17:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:27.902146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa79b45-47f3-476e-b151-0df03e29d713 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:27.902552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbff3cf-9fd2-45dd-9cf1-712c998ad181 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:27.902837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbff3cf-9fd2-45dd-9cf1-712c998ad181 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:27.903114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbff3cf-9fd2-45dd-9cf1-712c998ad181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:27.920286 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-3dbff3cf-9fd2-45dd-9cf1-712c998ad181 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:27.921456 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3dbff3cf-9fd2-45dd-9cf1-712c998ad181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:27.993109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 96/188] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:27.994149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbff3cf-9fd2-45dd-9cf1-712c998ad181 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:28.020794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa79b45-47f3-476e-b151-0df03e29d713 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:28.053711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce044319-b181-4ff6-af11-d21eef5976af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:28.054403 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce044319-b181-4ff6-af11-d21eef5976af None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:28.054678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce044319-b181-4ff6-af11-d21eef5976af None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:28.054956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce044319-b181-4ff6-af11-d21eef5976af None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:28.055699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce044319-b181-4ff6-af11-d21eef5976af None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:28.055998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce044319-b181-4ff6-af11-d21eef5976af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:28.057381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce044319-b181-4ff6-af11-d21eef5976af None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:28.072552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 93/189] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:28.072552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce044319-b181-4ff6-af11-d21eef5976af None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:28.098259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbff3cf-9fd2-45dd-9cf1-712c998ad181 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:28.132886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2fc15-b5c3-4d3a-b35a-2ff06907f1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:28.133913 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2fc15-b5c3-4d3a-b35a-2ff06907f1bd None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:28.134432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2fc15-b5c3-4d3a-b35a-2ff06907f1bd None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:28.134934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2fc15-b5c3-4d3a-b35a-2ff06907f1bd None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:28.135918 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2fc15-b5c3-4d3a-b35a-2ff06907f1bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:28.136404 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2fc15-b5c3-4d3a-b35a-2ff06907f1bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:28.138000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2fc15-b5c3-4d3a-b35a-2ff06907f1bd None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:28.146567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 97/190] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:17:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:28.147644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2fc15-b5c3-4d3a-b35a-2ff06907f1bd None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:28.187682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce044319-b181-4ff6-af11-d21eef5976af None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:28.221132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d092f-57e6-4177-bc83-b5e49f533ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:28.221930 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d092f-57e6-4177-bc83-b5e49f533ada None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:28.222239 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d092f-57e6-4177-bc83-b5e49f533ada None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:28.222520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d092f-57e6-4177-bc83-b5e49f533ada None admin] PATH_INFO: `/v3/domains/default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:28.223709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d092f-57e6-4177-bc83-b5e49f533ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:28.225169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d092f-57e6-4177-bc83-b5e49f533ada None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:28.226819 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 94/191] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:17:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:28.227585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d092f-57e6-4177-bc83-b5e49f533ada None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:28.256360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2fc15-b5c3-4d3a-b35a-2ff06907f1bd None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:28.289082 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c55fe5-8711-479b-b730-4e3c83957df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:28.289960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c55fe5-8711-479b-b730-4e3c83957df5 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:28.290271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c55fe5-8711-479b-b730-4e3c83957df5 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:28.290552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c55fe5-8711-479b-b730-4e3c83957df5 None admin] PATH_INFO: `/v3/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:28.305101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c55fe5-8711-479b-b730-4e3c83957df5 None admin] RBAC: Authorizing `identity:get_user(user_id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:28.306609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c55fe5-8711-479b-b730-4e3c83957df5 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:28.308296 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 98/192] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:28 2022] GET /identity/v3/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:28.309073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c55fe5-8711-479b-b730-4e3c83957df5 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:28.334540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d092f-57e6-4177-bc83-b5e49f533ada None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:28.368804 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7eefd-2130-4d56-9ab4-33871e4321ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:28.369680 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7eefd-2130-4d56-9ab4-33871e4321ad None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:28.369966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7eefd-2130-4d56-9ab4-33871e4321ad None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:28.370293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7eefd-2130-4d56-9ab4-33871e4321ad None admin] PATH_INFO: `/v3/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:28.371492 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7eefd-2130-4d56-9ab4-33871e4321ad None admin] RBAC: Authorizing `identity:get_user(user_id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:28.373017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7eefd-2130-4d56-9ab4-33871e4321ad None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:28.374853 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 95/193] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:28 2022] GET /identity/v3/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:28.379940 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7eefd-2130-4d56-9ab4-33871e4321ad None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:28.408102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c55fe5-8711-479b-b730-4e3c83957df5 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:28.440808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78cbfb-2110-4f53-b49c-f4145c529be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:28.441476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78cbfb-2110-4f53-b49c-f4145c529be1 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:28.441761 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78cbfb-2110-4f53-b49c-f4145c529be1 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:28.442034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78cbfb-2110-4f53-b49c-f4145c529be1 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:28.442781 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78cbfb-2110-4f53-b49c-f4145c529be1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:28.444221 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78cbfb-2110-4f53-b49c-f4145c529be1 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:28.465467 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 99/194] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:17:28 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:17:28.466789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78cbfb-2110-4f53-b49c-f4145c529be1 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:28.498269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7eefd-2130-4d56-9ab4-33871e4321ad None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:28.569115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0464160-0e2c-4e37-97a7-e28a3a6a8667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:28.570099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0464160-0e2c-4e37-97a7-e28a3a6a8667 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:28.570593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0464160-0e2c-4e37-97a7-e28a3a6a8667 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:28.571005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0464160-0e2c-4e37-97a7-e28a3a6a8667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:28.606595 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78cbfb-2110-4f53-b49c-f4145c529be1 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:28.645068 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b88e44-6a5a-44a6-abb9-045faf1c5d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:28.646143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b88e44-6a5a-44a6-abb9-045faf1c5d95 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:28.646661 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b88e44-6a5a-44a6-abb9-045faf1c5d95 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:28.647152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b88e44-6a5a-44a6-abb9-045faf1c5d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:28.688645 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0464160-0e2c-4e37-97a7-e28a3a6a8667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:28.691345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0464160-0e2c-4e37-97a7-e28a3a6a8667 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:28.722956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b88e44-6a5a-44a6-abb9-045faf1c5d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:28.724796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b88e44-6a5a-44a6-abb9-045faf1c5d95 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:28.848662 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 96/195] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:28.858316 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0464160-0e2c-4e37-97a7-e28a3a6a8667 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:28.876955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 100/196] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:28.882662 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b88e44-6a5a-44a6-abb9-045faf1c5d95 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:28.984505 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0464160-0e2c-4e37-97a7-e28a3a6a8667 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:29.008675 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b88e44-6a5a-44a6-abb9-045faf1c5d95 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:29.025664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e21da-1f83-4c89-b93d-a531d466b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:29.026709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e21da-1f83-4c89-b93d-a531d466b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:29.026993 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e21da-1f83-4c89-b93d-a531d466b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:29.027265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e21da-1f83-4c89-b93d-a531d466b8e3 None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:29.029426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e21da-1f83-4c89-b93d-a531d466b8e3 None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:29.030398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e21da-1f83-4c89-b93d-a531d466b8e3 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:29.032429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 97/197] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:28 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:29.038106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e21da-1f83-4c89-b93d-a531d466b8e3 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:29.049053 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee28f48-bc3b-4357-8aab-ca8746b1aa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:29.050272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee28f48-bc3b-4357-8aab-ca8746b1aa84 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:29.050760 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee28f48-bc3b-4357-8aab-ca8746b1aa84 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:29.051232 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee28f48-bc3b-4357-8aab-ca8746b1aa84 None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:29.052674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee28f48-bc3b-4357-8aab-ca8746b1aa84 None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:29.054384 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee28f48-bc3b-4357-8aab-ca8746b1aa84 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:29.056295 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 101/198] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:28 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:29.067156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee28f48-bc3b-4357-8aab-ca8746b1aa84 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:29.161798 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e21da-1f83-4c89-b93d-a531d466b8e3 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:29.205589 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0d97c-f3a6-4581-929b-4720c686b403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:29.207934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0d97c-f3a6-4581-929b-4720c686b403 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:29.208595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0d97c-f3a6-4581-929b-4720c686b403 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:29.210262 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0d97c-f3a6-4581-929b-4720c686b403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:29.211990 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0d97c-f3a6-4581-929b-4720c686b403 None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=ca31edde9c134f528cd3f229ac72e713, user.id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:29.213137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0d97c-f3a6-4581-929b-4720c686b403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:29.215007 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0d97c-f3a6-4581-929b-4720c686b403 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:29.228932 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 98/199] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:29 2022] GET /identity/v3/role_assignments?user.id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7&scope.project.id=ca31edde9c134f528cd3f229ac72e713&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:29.287302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee28f48-bc3b-4357-8aab-ca8746b1aa84 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:29.346868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9527d-0458-4f56-8d91-6946f64e3ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:29.347917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9527d-0458-4f56-8d91-6946f64e3ecc None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:29.348404 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9527d-0458-4f56-8d91-6946f64e3ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:29.348906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9527d-0458-4f56-8d91-6946f64e3ecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:29.350012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9527d-0458-4f56-8d91-6946f64e3ecc None admin] RBAC: Adding query filter params (role.id=c010c38ef8f54067ad2da8aef99dbdcd, scope.project.id=ca31edde9c134f528cd3f229ac72e713, user.id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:29.350621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9527d-0458-4f56-8d91-6946f64e3ecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:29.352365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9527d-0458-4f56-8d91-6946f64e3ecc None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:29.359661 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 102/200] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:29 2022] GET /identity/v3/role_assignments?user.id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7&scope.project.id=ca31edde9c134f528cd3f229ac72e713&role.id=c010c38ef8f54067ad2da8aef99dbdcd => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:29.431620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03974475-bc2d-4b4e-a081-e87126b5e737 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:29.432300 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03974475-bc2d-4b4e-a081-e87126b5e737 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:29.432785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03974475-bc2d-4b4e-a081-e87126b5e737 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:29.434628 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 99/201] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:29.441162 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c47b4-e67a-486b-9709-d1e1f2104834 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:29.441828 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c47b4-e67a-486b-9709-d1e1f2104834 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:29.442345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c47b4-e67a-486b-9709-d1e1f2104834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:29.465997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-af8c47b4-e67a-486b-9709-d1e1f2104834 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:29.468241 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-af8c47b4-e67a-486b-9709-d1e1f2104834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:29.550031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 103/202] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:29.573265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03974475-bc2d-4b4e-a081-e87126b5e737 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:29.687242 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03974475-bc2d-4b4e-a081-e87126b5e737 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:29.724070 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc58c2-609b-44fa-b1c8-cf626dfd7544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:29.725667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc58c2-609b-44fa-b1c8-cf626dfd7544 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:29.726163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc58c2-609b-44fa-b1c8-cf626dfd7544 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:29.726668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc58c2-609b-44fa-b1c8-cf626dfd7544 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:29.738448 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc58c2-609b-44fa-b1c8-cf626dfd7544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-42bc58c2-609b-44fa-b1c8-cf626dfd7544 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:29.746697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:29.747641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:29.748499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:29.748499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:29.748499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:29.748499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:29.748499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:29.748499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:29.748499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:29.748499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:29.748499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:29.748499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:29.748499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:29.748499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:29.750912 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 100/203] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:29.756793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c47b4-e67a-486b-9709-d1e1f2104834 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:29.892264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c47b4-e67a-486b-9709-d1e1f2104834 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:29.945237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e5fca-a479-4d9d-8cdb-58f4dab6832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:29.945921 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e5fca-a479-4d9d-8cdb-58f4dab6832d None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:29.946225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e5fca-a479-4d9d-8cdb-58f4dab6832d None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:29.946512 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e5fca-a479-4d9d-8cdb-58f4dab6832d None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:29.947314 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e5fca-a479-4d9d-8cdb-58f4dab6832d None admin] RBAC: Adding query filter params (name=reader) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:29.947638 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e5fca-a479-4d9d-8cdb-58f4dab6832d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:29.949038 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e5fca-a479-4d9d-8cdb-58f4dab6832d None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:29.958569 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 104/204] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:29.965130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc58c2-609b-44fa-b1c8-cf626dfd7544 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:30.150488 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc58c2-609b-44fa-b1c8-cf626dfd7544 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:30.201802 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cd2dc-881c-498a-88d0-81291afdedff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:30.202729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cd2dc-881c-498a-88d0-81291afdedff None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:30.203014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cd2dc-881c-498a-88d0-81291afdedff None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:30.203288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cd2dc-881c-498a-88d0-81291afdedff None admin] PATH_INFO: `/v3/users/d056aaea467d42b187418bd5cfbc870b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:30.207015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cd2dc-881c-498a-88d0-81291afdedff None admin] RBAC: Authorizing `identity:get_user(user_id=d056aaea467d42b187418bd5cfbc870b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:30.208487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cd2dc-881c-498a-88d0-81291afdedff None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:30.210471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 101/205] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:29 2022] GET /identity/v3/users/d056aaea467d42b187418bd5cfbc870b => generated 289 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:30.215626 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e5fca-a479-4d9d-8cdb-58f4dab6832d None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:30.359318 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e5fca-a479-4d9d-8cdb-58f4dab6832d None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:30.401610 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3eee7-a6a1-4889-9226-dda9ea2716a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:30.402676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3eee7-a6a1-4889-9226-dda9ea2716a1 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:30.403230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3eee7-a6a1-4889-9226-dda9ea2716a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:30.403766 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3eee7-a6a1-4889-9226-dda9ea2716a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:30.489726 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3eee7-a6a1-4889-9226-dda9ea2716a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:30.491591 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3eee7-a6a1-4889-9226-dda9ea2716a1 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:30.637556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 105/206] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:30.643417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cd2dc-881c-498a-88d0-81291afdedff None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:30.783131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cd2dc-881c-498a-88d0-81291afdedff None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:30.832037 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfebdf-81dd-4a4c-99ae-efec7bcc90dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:30.832904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfebdf-81dd-4a4c-99ae-efec7bcc90dc None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:30.833197 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfebdf-81dd-4a4c-99ae-efec7bcc90dc None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:30.833461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfebdf-81dd-4a4c-99ae-efec7bcc90dc None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:30.834694 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfebdf-81dd-4a4c-99ae-efec7bcc90dc None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:30.836160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfebdf-81dd-4a4c-99ae-efec7bcc90dc None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:30.838039 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 102/207] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:30 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:30.843835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3eee7-a6a1-4889-9226-dda9ea2716a1 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:30.970211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3eee7-a6a1-4889-9226-dda9ea2716a1 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:31.011910 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5d14c-cd50-4583-8122-458b45f62d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:31.012589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5d14c-cd50-4583-8122-458b45f62d2e None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:31.012877 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5d14c-cd50-4583-8122-458b45f62d2e None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:31.013405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5d14c-cd50-4583-8122-458b45f62d2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:31.014380 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5d14c-cd50-4583-8122-458b45f62d2e None admin] RBAC: Adding query filter params (role.id=5c131c170ffc4e1da14872da2dab3928, scope.project.id=903badc2e08c482fa823407b822580fc, user.id=d056aaea467d42b187418bd5cfbc870b) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:31.014699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5d14c-cd50-4583-8122-458b45f62d2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:31.016216 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5d14c-cd50-4583-8122-458b45f62d2e None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:31.022706 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 106/208] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:30 2022] GET /identity/v3/role_assignments?user.id=d056aaea467d42b187418bd5cfbc870b&scope.project.id=903badc2e08c482fa823407b822580fc&role.id=5c131c170ffc4e1da14872da2dab3928 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:31.335728 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbad1f-b3f9-4c65-948a-19e4e7ae3077 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:31.336244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbad1f-b3f9-4c65-948a-19e4e7ae3077 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:31.336784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbad1f-b3f9-4c65-948a-19e4e7ae3077 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:31.338395 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 103/209] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:31.344898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21db998-2ce8-47ed-9ca8-274fff087300 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:31.345191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21db998-2ce8-47ed-9ca8-274fff087300 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:31.345473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21db998-2ce8-47ed-9ca8-274fff087300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:31.364404 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b21db998-2ce8-47ed-9ca8-274fff087300 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:31.365593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b21db998-2ce8-47ed-9ca8-274fff087300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:31.402117 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f6108-2da4-4f42-b88e-6e9afdf697ec None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:31.402743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f6108-2da4-4f42-b88e-6e9afdf697ec None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:31.403212 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f6108-2da4-4f42-b88e-6e9afdf697ec None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:31.405531 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 104/210] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:17:31.413387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202ff26-907c-4216-ac1b-278238291ead None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:31.413913 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202ff26-907c-4216-ac1b-278238291ead None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:31.414420 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202ff26-907c-4216-ac1b-278238291ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:31.435622 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-7202ff26-907c-4216-ac1b-278238291ead None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:31.437077 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7202ff26-907c-4216-ac1b-278238291ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:31.448153 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 107/211] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:31.478061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21db998-2ce8-47ed-9ca8-274fff087300 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:31.510331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 105/212] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:31.538750 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202ff26-907c-4216-ac1b-278238291ead None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:31.593805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21db998-2ce8-47ed-9ca8-274fff087300 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:31.628573 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43081223-1085-47c8-9a8e-11fefebd7a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:31.629389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43081223-1085-47c8-9a8e-11fefebd7a33 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:31.629671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43081223-1085-47c8-9a8e-11fefebd7a33 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:31.629949 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43081223-1085-47c8-9a8e-11fefebd7a33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:31.641147 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43081223-1085-47c8-9a8e-11fefebd7a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:31.644873 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202ff26-907c-4216-ac1b-278238291ead None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-43081223-1085-47c8-9a8e-11fefebd7a33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:31.648958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:31.649826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:31.650636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:31.650636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:31.650636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:31.650636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:31.650636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:31.650636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:31.650636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:31.650636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:31.650636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:31.650636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:31.650636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:31.650636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:31.650636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 108/213] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:17:31.660245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43081223-1085-47c8-9a8e-11fefebd7a33 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:31.687087 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb028c-0e3e-46e2-8696-15625518c55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:31.688181 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb028c-0e3e-46e2-8696-15625518c55b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:31.688473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb028c-0e3e-46e2-8696-15625518c55b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:31.688751 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb028c-0e3e-46e2-8696-15625518c55b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:31.690125 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb028c-0e3e-46e2-8696-15625518c55b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:31.692391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb028c-0e3e-46e2-8696-15625518c55b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:31.694576 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 106/214] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:17:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:31.701076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb028c-0e3e-46e2-8696-15625518c55b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:31.784506 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43081223-1085-47c8-9a8e-11fefebd7a33 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:31.809034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb028c-0e3e-46e2-8696-15625518c55b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:31.827993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90961135-8336-48b0-a165-2a88f622150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:31.829188 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90961135-8336-48b0-a165-2a88f622150a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:31.830060 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90961135-8336-48b0-a165-2a88f622150a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:31.830565 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90961135-8336-48b0-a165-2a88f622150a None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:31.831793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90961135-8336-48b0-a165-2a88f622150a None admin] RBAC: Adding query filter params (name=member) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:31.832326 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90961135-8336-48b0-a165-2a88f622150a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:31.834007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90961135-8336-48b0-a165-2a88f622150a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:31.843194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 109/215] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:31.849223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90961135-8336-48b0-a165-2a88f622150a None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:31.852052 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc00e79-a7b2-4b34-abb2-5b006d94a466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:31.852926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc00e79-a7b2-4b34-abb2-5b006d94a466 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:31.853221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc00e79-a7b2-4b34-abb2-5b006d94a466 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:31.853501 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc00e79-a7b2-4b34-abb2-5b006d94a466 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:31.855107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc00e79-a7b2-4b34-abb2-5b006d94a466 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:31.856578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc00e79-a7b2-4b34-abb2-5b006d94a466 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:31.886152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 107/216] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:17:31 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:17:31.970364 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90961135-8336-48b0-a165-2a88f622150a None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:32.007370 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58589ef7-55da-422b-b3d0-91b424b0bb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:32.008280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58589ef7-55da-422b-b3d0-91b424b0bb1c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:32.008567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58589ef7-55da-422b-b3d0-91b424b0bb1c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:32.008847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58589ef7-55da-422b-b3d0-91b424b0bb1c None admin] PATH_INFO: `/v3/users/79ce7d8036614eb282d929ce8392e612` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:32.025636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58589ef7-55da-422b-b3d0-91b424b0bb1c None admin] RBAC: Authorizing `identity:get_user(user_id=79ce7d8036614eb282d929ce8392e612)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:32.027232 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58589ef7-55da-422b-b3d0-91b424b0bb1c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:32.029615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 110/217] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:31 2022] GET /identity/v3/users/79ce7d8036614eb282d929ce8392e612 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:32.035599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc00e79-a7b2-4b34-abb2-5b006d94a466 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:32.152042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc00e79-a7b2-4b34-abb2-5b006d94a466 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:32.186913 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae67a75-d465-467d-9172-7274b6896edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:32.187574 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae67a75-d465-467d-9172-7274b6896edc None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:32.187874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae67a75-d465-467d-9172-7274b6896edc None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:32.188144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae67a75-d465-467d-9172-7274b6896edc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:32.225638 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45dba4-e6ef-4c0b-9086-20d7cc86d012 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:32.225959 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45dba4-e6ef-4c0b-9086-20d7cc86d012 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:32.226371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45dba4-e6ef-4c0b-9086-20d7cc86d012 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:32.227899 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 111/218] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:17:32.233172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fd134-24f7-4154-ba64-97b688a3c256 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:32.233542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fd134-24f7-4154-ba64-97b688a3c256 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:32.233895 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fd134-24f7-4154-ba64-97b688a3c256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:32.257554 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-484fd134-24f7-4154-ba64-97b688a3c256 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:32.258774 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-484fd134-24f7-4154-ba64-97b688a3c256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:32.282389 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae67a75-d465-467d-9172-7274b6896edc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:32.284757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae67a75-d465-467d-9172-7274b6896edc None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:32.351028 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 112/219] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:32.352374 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a097b4-c820-4467-a459-074f1cd3f2e1 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:32.352684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a097b4-c820-4467-a459-074f1cd3f2e1 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:32.352948 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a097b4-c820-4467-a459-074f1cd3f2e1 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:32.354394 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 113/220] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:32.360675 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633573d-7c63-49db-a656-5705e6e65e37 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:32.360969 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633573d-7c63-49db-a656-5705e6e65e37 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:32.361273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633573d-7c63-49db-a656-5705e6e65e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:32.382415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b633573d-7c63-49db-a656-5705e6e65e37 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:32.384228 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b633573d-7c63-49db-a656-5705e6e65e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:32.413733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 108/221] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:32.415045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae67a75-d465-467d-9172-7274b6896edc None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:32.477061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 114/222] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:32.478368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633573d-7c63-49db-a656-5705e6e65e37 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:32.542264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae67a75-d465-467d-9172-7274b6896edc None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:32.586894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6597654-d059-46d9-9046-5d723106d297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:32.588062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6597654-d059-46d9-9046-5d723106d297 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:32.588536 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6597654-d059-46d9-9046-5d723106d297 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:32.588662 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633573d-7c63-49db-a656-5705e6e65e37 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:32.589117 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6597654-d059-46d9-9046-5d723106d297 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:32.603101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6597654-d059-46d9-9046-5d723106d297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-a6597654-d059-46d9-9046-5d723106d297 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:32.613625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:32.614585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:32.615381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:32.615381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:32.615381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:32.615381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:32.615381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:32.615381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:32.615381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:32.615381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:32.615381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:32.615381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:32.615381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:32.615381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:32.616745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 109/223] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:17:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:32.619251 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6597654-d059-46d9-9046-5d723106d297 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:32.630256 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf06ba-75ef-4d04-9eb7-e0e7506c3ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:32.631424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf06ba-75ef-4d04-9eb7-e0e7506c3ccf None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:32.631424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf06ba-75ef-4d04-9eb7-e0e7506c3ccf None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:32.631700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf06ba-75ef-4d04-9eb7-e0e7506c3ccf None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:32.632903 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf06ba-75ef-4d04-9eb7-e0e7506c3ccf None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:32.634393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf06ba-75ef-4d04-9eb7-e0e7506c3ccf None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:32.641340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 115/224] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:32 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:32.641340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf06ba-75ef-4d04-9eb7-e0e7506c3ccf None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:32.738906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6597654-d059-46d9-9046-5d723106d297 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:32.740358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf06ba-75ef-4d04-9eb7-e0e7506c3ccf None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:32.773059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f02d4d-3384-4cdd-97d1-3882280befa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:32.774089 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f02d4d-3384-4cdd-97d1-3882280befa0 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:32.774635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f02d4d-3384-4cdd-97d1-3882280befa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:32.775073 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f02d4d-3384-4cdd-97d1-3882280befa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:32.775319 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f969b-2e68-4408-9dd3-88eca0d921c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:32.776269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f969b-2e68-4408-9dd3-88eca0d921c7 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:32.776643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f969b-2e68-4408-9dd3-88eca0d921c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:32.777012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f969b-2e68-4408-9dd3-88eca0d921c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:32.777854 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f969b-2e68-4408-9dd3-88eca0d921c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:32.778350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f969b-2e68-4408-9dd3-88eca0d921c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:32.780078 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f969b-2e68-4408-9dd3-88eca0d921c7 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:32.786660 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f02d4d-3384-4cdd-97d1-3882280befa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:32.788520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 116/225] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:17:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:32.789576 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f969b-2e68-4408-9dd3-88eca0d921c7 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-e2f02d4d-3384-4cdd-97d1-3882280befa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:32.795538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:32.796624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:32.797463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:32.797463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:32.797463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:32.797463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:32.797463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:32.797463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:32.797463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:32.797463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:32.797463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:32.797463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:32.797463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:32.797463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:32.799726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 110/226] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:17:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:32.800711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f02d4d-3384-4cdd-97d1-3882280befa0 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:32.898541 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f969b-2e68-4408-9dd3-88eca0d921c7 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:32.900280 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f02d4d-3384-4cdd-97d1-3882280befa0 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:32.933917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a6a79-1959-4f64-89ab-cfddb703e174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:32.934824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a6a79-1959-4f64-89ab-cfddb703e174 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:32.935175 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a6a79-1959-4f64-89ab-cfddb703e174 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:32.935541 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a6a79-1959-4f64-89ab-cfddb703e174 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:32.935963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af38277-bd9b-4f08-a664-a293dbc4f6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:32.936709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a6a79-1959-4f64-89ab-cfddb703e174 None admin] RBAC: Adding query filter params (role.id=c2cbdedfc238463d91a843ca8e5ac3ca, scope.project.id=ca31edde9c134f528cd3f229ac72e713, user.id=79ce7d8036614eb282d929ce8392e612) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:32.937135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a6a79-1959-4f64-89ab-cfddb703e174 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:32.937426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af38277-bd9b-4f08-a664-a293dbc4f6e4 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:32.937868 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af38277-bd9b-4f08-a664-a293dbc4f6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:32.938337 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af38277-bd9b-4f08-a664-a293dbc4f6e4 None admin] PATH_INFO: `/v3/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:32.938919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a6a79-1959-4f64-89ab-cfddb703e174 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:32.939941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af38277-bd9b-4f08-a664-a293dbc4f6e4 None admin] RBAC: Authorizing `identity:get_user(user_id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:32.941586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af38277-bd9b-4f08-a664-a293dbc4f6e4 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:32.943429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 111/227] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:32 2022] GET /identity/v3/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:32.944479 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af38277-bd9b-4f08-a664-a293dbc4f6e4 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:32.947961 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 117/228] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:32 2022] GET /identity/v3/role_assignments?user.id=79ce7d8036614eb282d929ce8392e612&scope.project.id=ca31edde9c134f528cd3f229ac72e713&role.id=c2cbdedfc238463d91a843ca8e5ac3ca => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:32.952984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a6a79-1959-4f64-89ab-cfddb703e174 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:33.077629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a6a79-1959-4f64-89ab-cfddb703e174 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:33.118192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383d4aa-a9d8-4a5e-98b4-e29a0ae94783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:33.119098 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383d4aa-a9d8-4a5e-98b4-e29a0ae94783 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:33.119383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383d4aa-a9d8-4a5e-98b4-e29a0ae94783 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:33.119659 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383d4aa-a9d8-4a5e-98b4-e29a0ae94783 None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:33.121022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383d4aa-a9d8-4a5e-98b4-e29a0ae94783 None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:33.123537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383d4aa-a9d8-4a5e-98b4-e29a0ae94783 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:33.125725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 118/229] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:32 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:33.132372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383d4aa-a9d8-4a5e-98b4-e29a0ae94783 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:33.164557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af38277-bd9b-4f08-a664-a293dbc4f6e4 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:33.251943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383d4aa-a9d8-4a5e-98b4-e29a0ae94783 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:33.266973 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed9180-32ac-42f1-b867-785bba067f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:33.267665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed9180-32ac-42f1-b867-785bba067f18 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:33.267942 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed9180-32ac-42f1-b867-785bba067f18 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:33.268209 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed9180-32ac-42f1-b867-785bba067f18 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:33.268980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed9180-32ac-42f1-b867-785bba067f18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:33.269284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed9180-32ac-42f1-b867-785bba067f18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:33.270726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed9180-32ac-42f1-b867-785bba067f18 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:33.288451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 112/230] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:33.297182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a409aa-58cd-4d9e-a3ba-ac98dc9e3615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:33.298091 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a409aa-58cd-4d9e-a3ba-ac98dc9e3615 None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:33.298430 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a409aa-58cd-4d9e-a3ba-ac98dc9e3615 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:33.298669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a409aa-58cd-4d9e-a3ba-ac98dc9e3615 None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7/roles/c010c38ef8f54067ad2da8aef99dbdcd` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:33.299115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed9180-32ac-42f1-b867-785bba067f18 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:33.300916 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a409aa-58cd-4d9e-a3ba-ac98dc9e3615 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca31edde9c134f528cd3f229ac72e713, user_id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7, role_id=c010c38ef8f54067ad2da8aef99dbdcd)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:33.302430 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a409aa-58cd-4d9e-a3ba-ac98dc9e3615 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:33.323109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 119/231] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:17:33 2022] PUT /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7/roles/c010c38ef8f54067ad2da8aef99dbdcd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:17:33.462374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed9180-32ac-42f1-b867-785bba067f18 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:33.529669 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a4748-c61f-4ad8-8504-1bc90805a061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:33.530980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a4748-c61f-4ad8-8504-1bc90805a061 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:33.531482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a4748-c61f-4ad8-8504-1bc90805a061 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:33.531954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a4748-c61f-4ad8-8504-1bc90805a061 None admin] PATH_INFO: `/v3/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:33.533399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a4748-c61f-4ad8-8504-1bc90805a061 None admin] RBAC: Authorizing `identity:get_user(user_id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:33.535109 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a4748-c61f-4ad8-8504-1bc90805a061 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:33.537258 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 113/232] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:33 2022] GET /identity/v3/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7 => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:33.542408 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a409aa-58cd-4d9e-a3ba-ac98dc9e3615 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:33.656847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a409aa-58cd-4d9e-a3ba-ac98dc9e3615 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:33.702246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be8370-bb7f-43da-8663-52cfe7634dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:33.703125 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be8370-bb7f-43da-8663-52cfe7634dfa None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:33.703408 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be8370-bb7f-43da-8663-52cfe7634dfa None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:33.703685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be8370-bb7f-43da-8663-52cfe7634dfa None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:33.704889 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be8370-bb7f-43da-8663-52cfe7634dfa None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:33.706611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be8370-bb7f-43da-8663-52cfe7634dfa None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:33.708297 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 120/233] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:33 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:33.714135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a4748-c61f-4ad8-8504-1bc90805a061 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:33.862095 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a4748-c61f-4ad8-8504-1bc90805a061 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:33.910050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eef7ca-e433-4557-b927-9559e420ed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:33.911752 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eef7ca-e433-4557-b927-9559e420ed36 None admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:33.912261 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eef7ca-e433-4557-b927-9559e420ed36 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:33.912736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eef7ca-e433-4557-b927-9559e420ed36 None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:33.915013 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eef7ca-e433-4557-b927-9559e420ed36 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca31edde9c134f528cd3f229ac72e713, user_id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:33.916686 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eef7ca-e433-4557-b927-9559e420ed36 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:33.946089 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 114/234] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:17:33 2022] PUT /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:17:34.519920 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1cf86-2aa4-4fc0-977e-7f18839d54f5 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:34.520406 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1cf86-2aa4-4fc0-977e-7f18839d54f5 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:34.520406 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1cf86-2aa4-4fc0-977e-7f18839d54f5 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:34.521917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 121/235] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:34.527028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f46324-c3b5-4d06-a330-fca0e41ceacb None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:34.527563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f46324-c3b5-4d06-a330-fca0e41ceacb None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:34.528045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f46324-c3b5-4d06-a330-fca0e41ceacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:34.555127 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-69f46324-c3b5-4d06-a330-fca0e41ceacb None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:34.556634 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-69f46324-c3b5-4d06-a330-fca0e41ceacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:34.638609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 115/236] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:34.676063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1cf86-2aa4-4fc0-977e-7f18839d54f5 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:34.841804 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1cf86-2aa4-4fc0-977e-7f18839d54f5 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:34.885591 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36e80d-a7d7-46ae-b6b2-9cc580be8f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:34.886766 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36e80d-a7d7-46ae-b6b2-9cc580be8f3e None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:34.887270 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36e80d-a7d7-46ae-b6b2-9cc580be8f3e None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:34.887741 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36e80d-a7d7-46ae-b6b2-9cc580be8f3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:34.891315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36e80d-a7d7-46ae-b6b2-9cc580be8f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:34.893002 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36e80d-a7d7-46ae-b6b2-9cc580be8f3e None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:34.894898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 122/237] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:17:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:34.900299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f46324-c3b5-4d06-a330-fca0e41ceacb None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:34.910135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63342bda-815c-4256-9d30-d2c723a798d7 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:34.910734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63342bda-815c-4256-9d30-d2c723a798d7 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:34.911209 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63342bda-815c-4256-9d30-d2c723a798d7 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:34.912760 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 123/238] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:34.917528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a0d5c-84c9-4b81-a154-e388b1c1e4a2 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:34.918043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a0d5c-84c9-4b81-a154-e388b1c1e4a2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:34.918545 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a0d5c-84c9-4b81-a154-e388b1c1e4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:34.948814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-098a0d5c-84c9-4b81-a154-e388b1c1e4a2 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:34.952737 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-098a0d5c-84c9-4b81-a154-e388b1c1e4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:35.047491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f46324-c3b5-4d06-a330-fca0e41ceacb None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:35.058915 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 124/239] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:35.088932 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26837d9-6b52-45cd-9cf2-b53faa7eee11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:35.089937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26837d9-6b52-45cd-9cf2-b53faa7eee11 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:35.090453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26837d9-6b52-45cd-9cf2-b53faa7eee11 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:35.091027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26837d9-6b52-45cd-9cf2-b53faa7eee11 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:35.092000 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26837d9-6b52-45cd-9cf2-b53faa7eee11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:35.093667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26837d9-6b52-45cd-9cf2-b53faa7eee11 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:35.109077 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a0d5c-84c9-4b81-a154-e388b1c1e4a2 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:35.131976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 116/240] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:17:34 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:17:35.236650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a0d5c-84c9-4b81-a154-e388b1c1e4a2 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:35.291692 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece10e7-6e47-471c-8dc9-12aa6c263a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:35.292876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece10e7-6e47-471c-8dc9-12aa6c263a33 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:35.293360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece10e7-6e47-471c-8dc9-12aa6c263a33 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:35.293859 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece10e7-6e47-471c-8dc9-12aa6c263a33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:35.311247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece10e7-6e47-471c-8dc9-12aa6c263a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-3ece10e7-6e47-471c-8dc9-12aa6c263a33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:35.319618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:35.320593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:35.321381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:35.321381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:35.321381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:35.321381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:35.321381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:35.321381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:35.321381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:35.321381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:35.321381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:35.321381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:35.321381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:35.321381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:35.323923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 125/241] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:17:35.330091 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26837d9-6b52-45cd-9cf2-b53faa7eee11 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:35.456753 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26837d9-6b52-45cd-9cf2-b53faa7eee11 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:35.494457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd41416-b0a7-4e5b-a07d-c23f7c53ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:35.495483 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd41416-b0a7-4e5b-a07d-c23f7c53ff9b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:35.495996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd41416-b0a7-4e5b-a07d-c23f7c53ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:35.496482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd41416-b0a7-4e5b-a07d-c23f7c53ff9b None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:35.497988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd41416-b0a7-4e5b-a07d-c23f7c53ff9b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:35.498527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd41416-b0a7-4e5b-a07d-c23f7c53ff9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:35.500128 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd41416-b0a7-4e5b-a07d-c23f7c53ff9b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:35.509218 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 117/242] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:35.515269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece10e7-6e47-471c-8dc9-12aa6c263a33 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:35.626010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece10e7-6e47-471c-8dc9-12aa6c263a33 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:35.667078 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea4017-5ec4-4d11-9884-3a88147e89c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:35.668311 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea4017-5ec4-4d11-9884-3a88147e89c4 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:35.668795 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea4017-5ec4-4d11-9884-3a88147e89c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:35.669813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea4017-5ec4-4d11-9884-3a88147e89c4 None admin] PATH_INFO: `/v3/users/404e9e60ea67446d96ce47df881f1b22` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:35.685419 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea4017-5ec4-4d11-9884-3a88147e89c4 None admin] RBAC: Authorizing `identity:get_user(user_id=404e9e60ea67446d96ce47df881f1b22)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:35.687250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea4017-5ec4-4d11-9884-3a88147e89c4 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:35.689169 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 126/243] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:35 2022] GET /identity/v3/users/404e9e60ea67446d96ce47df881f1b22 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:35.694843 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd41416-b0a7-4e5b-a07d-c23f7c53ff9b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:35.807965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd41416-b0a7-4e5b-a07d-c23f7c53ff9b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:35.826600 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19e668-e7fc-4603-bc78-0a88a49e2146 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:35.827284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19e668-e7fc-4603-bc78-0a88a49e2146 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:35.827780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19e668-e7fc-4603-bc78-0a88a49e2146 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:35.829238 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 127/244] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:17:35.835725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fe780-3249-42b9-a1df-c9803fbccc80 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:35.836144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fe780-3249-42b9-a1df-c9803fbccc80 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:35.836521 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fe780-3249-42b9-a1df-c9803fbccc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:35.853309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863191e-9d92-4773-bcbe-dd2dd726644e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:35.853309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863191e-9d92-4773-bcbe-dd2dd726644e None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:35.853309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863191e-9d92-4773-bcbe-dd2dd726644e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:35.853309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863191e-9d92-4773-bcbe-dd2dd726644e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:35.860917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-c05fe780-3249-42b9-a1df-c9803fbccc80 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:35.862399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c05fe780-3249-42b9-a1df-c9803fbccc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:35.936369 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863191e-9d92-4773-bcbe-dd2dd726644e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:35.938700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863191e-9d92-4773-bcbe-dd2dd726644e None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:35.950862 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 128/245] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:35.973436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fe780-3249-42b9-a1df-c9803fbccc80 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:36.067696 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 118/246] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:36.075667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863191e-9d92-4773-bcbe-dd2dd726644e None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:36.096807 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fe780-3249-42b9-a1df-c9803fbccc80 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:36.134688 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816f521-bfdd-417d-a793-a58d08e3b3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:36.135501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816f521-bfdd-417d-a793-a58d08e3b3aa None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:36.135785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816f521-bfdd-417d-a793-a58d08e3b3aa None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:36.136064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816f521-bfdd-417d-a793-a58d08e3b3aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:36.166061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816f521-bfdd-417d-a793-a58d08e3b3aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-2816f521-bfdd-417d-a793-a58d08e3b3aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:36.174713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:36.175603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:36.176399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:36.176399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:36.176399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:36.176399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:36.176399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:36.176399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:36.176399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:36.176399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:36.176399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:36.176399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:36.176399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:36.176399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:36.187811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 129/247] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:36.188722 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816f521-bfdd-417d-a793-a58d08e3b3aa None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:36.224609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863191e-9d92-4773-bcbe-dd2dd726644e None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:36.270896 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f84312-e00b-4ab4-9a4f-7aa6b4491450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:36.271774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f84312-e00b-4ab4-9a4f-7aa6b4491450 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:36.272052 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f84312-e00b-4ab4-9a4f-7aa6b4491450 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:36.272332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f84312-e00b-4ab4-9a4f-7aa6b4491450 None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:36.274273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f84312-e00b-4ab4-9a4f-7aa6b4491450 None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:36.275027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f84312-e00b-4ab4-9a4f-7aa6b4491450 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:36.277033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 119/248] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:36 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:36.278347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf976c-10df-4871-af14-b0493cf3534b None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:36.279175 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf976c-10df-4871-af14-b0493cf3534b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:36.279444 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf976c-10df-4871-af14-b0493cf3534b None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:36.280688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 120/249] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:36.287134 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf976c-10df-4871-af14-b0493cf3534b None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:36.317626 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816f521-bfdd-417d-a793-a58d08e3b3aa None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:36.362267 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9913d09-3fbf-42f1-bd12-1158f7ca5700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:36.363495 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9913d09-3fbf-42f1-bd12-1158f7ca5700 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:36.364075 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9913d09-3fbf-42f1-bd12-1158f7ca5700 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:36.364667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9913d09-3fbf-42f1-bd12-1158f7ca5700 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:36.366040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9913d09-3fbf-42f1-bd12-1158f7ca5700 None admin] RBAC: Adding query filter params (name=member) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:36.366588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9913d09-3fbf-42f1-bd12-1158f7ca5700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:36.368203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9913d09-3fbf-42f1-bd12-1158f7ca5700 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:36.383711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 130/250] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:36.385387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a2d86-7e24-42d3-88bf-f22473b1565a None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:36.385877 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a2d86-7e24-42d3-88bf-f22473b1565a None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:36.386376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a2d86-7e24-42d3-88bf-f22473b1565a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:36.405172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b94a2d86-7e24-42d3-88bf-f22473b1565a None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:36.406712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b94a2d86-7e24-42d3-88bf-f22473b1565a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:36.479187 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 131/251] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:36.480370 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a2d86-7e24-42d3-88bf-f22473b1565a None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:36.504033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf976c-10df-4871-af14-b0493cf3534b None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:36.562511 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d146a-d86c-4d32-91f6-18190a9cec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:36.563178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d146a-d86c-4d32-91f6-18190a9cec1b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:36.563463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d146a-d86c-4d32-91f6-18190a9cec1b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:36.564102 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d146a-d86c-4d32-91f6-18190a9cec1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:36.564580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d146a-d86c-4d32-91f6-18190a9cec1b None admin] RBAC: Adding query filter params (role.id=5c131c170ffc4e1da14872da2dab3928, scope.project.id=ca31edde9c134f528cd3f229ac72e713, user.id=404e9e60ea67446d96ce47df881f1b22) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:36.564894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d146a-d86c-4d32-91f6-18190a9cec1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:36.566386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d146a-d86c-4d32-91f6-18190a9cec1b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:36.578400 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 121/252] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:36 2022] GET /identity/v3/role_assignments?user.id=404e9e60ea67446d96ce47df881f1b22&scope.project.id=ca31edde9c134f528cd3f229ac72e713&role.id=5c131c170ffc4e1da14872da2dab3928 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:36.579193 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d146a-d86c-4d32-91f6-18190a9cec1b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:36.617257 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a2d86-7e24-42d3-88bf-f22473b1565a None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:36.664277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f10b5-c3a5-4661-8da3-96f6c2da47b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:36.666385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f10b5-c3a5-4661-8da3-96f6c2da47b1 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:36.667062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f10b5-c3a5-4661-8da3-96f6c2da47b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:36.667538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f10b5-c3a5-4661-8da3-96f6c2da47b1 None admin] PATH_INFO: `/v3/users/79ce7d8036614eb282d929ce8392e612` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:36.669212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f10b5-c3a5-4661-8da3-96f6c2da47b1 None admin] RBAC: Authorizing `identity:get_user(user_id=79ce7d8036614eb282d929ce8392e612)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:36.671542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f10b5-c3a5-4661-8da3-96f6c2da47b1 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:36.673449 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 132/253] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:36 2022] GET /identity/v3/users/79ce7d8036614eb282d929ce8392e612 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:36.683244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f10b5-c3a5-4661-8da3-96f6c2da47b1 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:36.852497 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d146a-d86c-4d32-91f6-18190a9cec1b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:36.860118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f10b5-c3a5-4661-8da3-96f6c2da47b1 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:36.897381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f03a-f0cf-4cf7-b5d2-fbc42df3c93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:36.898629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f03a-f0cf-4cf7-b5d2-fbc42df3c93e None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:36.899118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f03a-f0cf-4cf7-b5d2-fbc42df3c93e None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:36.899591 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f03a-f0cf-4cf7-b5d2-fbc42df3c93e None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:36.901150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588f03a-f0cf-4cf7-b5d2-fbc42df3c93e None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:36.902951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588f03a-f0cf-4cf7-b5d2-fbc42df3c93e None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:36.906801 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 133/254] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:36 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:36.911985 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f03a-f0cf-4cf7-b5d2-fbc42df3c93e None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:36.931897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d74e25-39c2-4ea6-b53c-e92685e1f8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:36.932693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d74e25-39c2-4ea6-b53c-e92685e1f8e6 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:36.932975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d74e25-39c2-4ea6-b53c-e92685e1f8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:36.933250 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d74e25-39c2-4ea6-b53c-e92685e1f8e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:36.956657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d74e25-39c2-4ea6-b53c-e92685e1f8e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-84d74e25-39c2-4ea6-b53c-e92685e1f8e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:36.972743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:36.973699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:36.979004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:36.979004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:36.979004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:36.979004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:36.979004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:36.979004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:36.979004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:36.979004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:36.979004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:36.979004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:36.979004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:36.979004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:36.979004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 122/255] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:17:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:36.996328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d74e25-39c2-4ea6-b53c-e92685e1f8e6 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:37.044128 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f03a-f0cf-4cf7-b5d2-fbc42df3c93e None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:37.082142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0e01c-8d40-4c0e-b898-4572d7ba0b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:37.083448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0e01c-8d40-4c0e-b898-4572d7ba0b6f None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:37.083929 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0e01c-8d40-4c0e-b898-4572d7ba0b6f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:37.084398 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0e01c-8d40-4c0e-b898-4572d7ba0b6f None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713/users/79ce7d8036614eb282d929ce8392e612/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:37.086679 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0e01c-8d40-4c0e-b898-4572d7ba0b6f None admin] RBAC: Authorizing `identity:create_grant(project_id=ca31edde9c134f528cd3f229ac72e713, user_id=79ce7d8036614eb282d929ce8392e612, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:37.088359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0e01c-8d40-4c0e-b898-4572d7ba0b6f None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:37.111869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 134/256] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:17:36 2022] PUT /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713/users/79ce7d8036614eb282d929ce8392e612/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:17:37.199562 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d74e25-39c2-4ea6-b53c-e92685e1f8e6 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:37.246877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cc78a-f5fe-407b-9d1b-2fd36aa3f666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:37.247729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cc78a-f5fe-407b-9d1b-2fd36aa3f666 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:37.248307 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cc78a-f5fe-407b-9d1b-2fd36aa3f666 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:37.248430 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cc78a-f5fe-407b-9d1b-2fd36aa3f666 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:37.251182 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61cc78a-f5fe-407b-9d1b-2fd36aa3f666 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:37.251182 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61cc78a-f5fe-407b-9d1b-2fd36aa3f666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:37.251182 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61cc78a-f5fe-407b-9d1b-2fd36aa3f666 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:37.262141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 123/257] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:17:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:37.268991 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0e01c-8d40-4c0e-b898-4572d7ba0b6f None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:37.408773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46117e-3852-46bb-aacf-0cb3e763e1a9 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:37.409095 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46117e-3852-46bb-aacf-0cb3e763e1a9 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:37.409335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46117e-3852-46bb-aacf-0cb3e763e1a9 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:37.411023 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 124/258] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:37.423934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1863a-8b00-4b34-841a-318ca37a7899 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:37.424277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1863a-8b00-4b34-841a-318ca37a7899 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:37.424564 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1863a-8b00-4b34-841a-318ca37a7899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:37.433801 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0e01c-8d40-4c0e-b898-4572d7ba0b6f None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:37.460105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-38a1863a-8b00-4b34-841a-318ca37a7899 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:37.462472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-38a1863a-8b00-4b34-841a-318ca37a7899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:37.505188 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233138fe-48fc-45cf-aa2c-e652c53a670b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:37.506421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233138fe-48fc-45cf-aa2c-e652c53a670b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:37.507921 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233138fe-48fc-45cf-aa2c-e652c53a670b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:37.508372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233138fe-48fc-45cf-aa2c-e652c53a670b None admin] PATH_INFO: `/v3/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:37.509930 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233138fe-48fc-45cf-aa2c-e652c53a670b None admin] RBAC: Authorizing `identity:get_user(user_id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:37.513427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233138fe-48fc-45cf-aa2c-e652c53a670b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:37.518315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 135/259] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:37 2022] GET /identity/v3/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:37.523098 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233138fe-48fc-45cf-aa2c-e652c53a670b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:37.581779 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 125/260] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:37.612931 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1863a-8b00-4b34-841a-318ca37a7899 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:37.686919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233138fe-48fc-45cf-aa2c-e652c53a670b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:37.753113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5a51d-7313-4407-82d7-c24e2989acab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:37.754111 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5a51d-7313-4407-82d7-c24e2989acab None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:37.755883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5a51d-7313-4407-82d7-c24e2989acab None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:37.756354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5a51d-7313-4407-82d7-c24e2989acab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:37.821793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1863a-8b00-4b34-841a-318ca37a7899 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:37.829645 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5a51d-7313-4407-82d7-c24e2989acab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:37.831694 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5a51d-7313-4407-82d7-c24e2989acab None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:37.906894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81187123-6dd4-467f-b410-3c5ccf3b0d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:37.907703 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81187123-6dd4-467f-b410-3c5ccf3b0d52 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:37.907986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81187123-6dd4-467f-b410-3c5ccf3b0d52 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:37.908264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81187123-6dd4-467f-b410-3c5ccf3b0d52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:37.923558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81187123-6dd4-467f-b410-3c5ccf3b0d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:37.933686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 136/261] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-81187123-6dd4-467f-b410-3c5ccf3b0d52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:37.939293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:37.940187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:37.941324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:37.941324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:37.941324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:37.941324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:37.941324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:37.941324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:37.941324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:37.941324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:37.941324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:37.941324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:37.941324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:37.941324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:37.941324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 126/262] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:17:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:17:37.942524 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5a51d-7313-4407-82d7-c24e2989acab None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:37.967713 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81187123-6dd4-467f-b410-3c5ccf3b0d52 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:38.051705 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5a51d-7313-4407-82d7-c24e2989acab None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:38.087305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33291cd7-f25d-4092-a1ea-ac17adfd6018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:38.088517 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33291cd7-f25d-4092-a1ea-ac17adfd6018 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:38.089014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33291cd7-f25d-4092-a1ea-ac17adfd6018 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:38.089477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33291cd7-f25d-4092-a1ea-ac17adfd6018 None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:38.092051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33291cd7-f25d-4092-a1ea-ac17adfd6018 None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:38.093819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33291cd7-f25d-4092-a1ea-ac17adfd6018 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:38.100552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 137/263] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:37 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:38.102046 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33291cd7-f25d-4092-a1ea-ac17adfd6018 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:38.164084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81187123-6dd4-467f-b410-3c5ccf3b0d52 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:38.206530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33291cd7-f25d-4092-a1ea-ac17adfd6018 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:38.242418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60a6bd-fff5-4f07-a7f4-f31e1286d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:38.243642 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60a6bd-fff5-4f07-a7f4-f31e1286d421 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:38.244136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60a6bd-fff5-4f07-a7f4-f31e1286d421 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:38.244603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60a6bd-fff5-4f07-a7f4-f31e1286d421 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:38.244793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef69dd-9308-4347-abef-974ea319179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:38.245472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef69dd-9308-4347-abef-974ea319179d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:38.245757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef69dd-9308-4347-abef-974ea319179d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:38.246033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef69dd-9308-4347-abef-974ea319179d None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:38.246790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60a6bd-fff5-4f07-a7f4-f31e1286d421 None admin] RBAC: Adding query filter params (role.id=c010c38ef8f54067ad2da8aef99dbdcd, scope.project.id=ca31edde9c134f528cd3f229ac72e713, user.id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:38.246892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef69dd-9308-4347-abef-974ea319179d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:38.248033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60a6bd-fff5-4f07-a7f4-f31e1286d421 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:38.249881 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60a6bd-fff5-4f07-a7f4-f31e1286d421 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:38.253432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef69dd-9308-4347-abef-974ea319179d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:38.260094 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 138/264] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:38 2022] GET /identity/v3/role_assignments?user.id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7&scope.project.id=ca31edde9c134f528cd3f229ac72e713&role.id=c010c38ef8f54067ad2da8aef99dbdcd => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:38.262933 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef69dd-9308-4347-abef-974ea319179d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:38.277601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 127/265] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:38.284321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60a6bd-fff5-4f07-a7f4-f31e1286d421 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:38.416315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60a6bd-fff5-4f07-a7f4-f31e1286d421 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:38.453556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a06bd-eed7-4fe8-ac38-a859106f47de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:38.454877 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a06bd-eed7-4fe8-ac38-a859106f47de None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:38.455382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a06bd-eed7-4fe8-ac38-a859106f47de None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:38.455868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a06bd-eed7-4fe8-ac38-a859106f47de None admin] PATH_INFO: `/v3/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:38.457580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a06bd-eed7-4fe8-ac38-a859106f47de None admin] RBAC: Authorizing `identity:get_user(user_id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:38.459430 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a06bd-eed7-4fe8-ac38-a859106f47de None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:38.465653 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 139/266] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:38 2022] GET /identity/v3/users/b86c51b60e6f4ad39e8dd2dd0f8bd9b7 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:38.467950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef69dd-9308-4347-abef-974ea319179d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:38.609413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef69dd-9308-4347-abef-974ea319179d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:38.650036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f340a53-3220-45f3-b4d5-70100a24ce15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:38.650735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f340a53-3220-45f3-b4d5-70100a24ce15 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:38.651024 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f340a53-3220-45f3-b4d5-70100a24ce15 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:38.651304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f340a53-3220-45f3-b4d5-70100a24ce15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:38.737684 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f340a53-3220-45f3-b4d5-70100a24ce15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:38.739149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f340a53-3220-45f3-b4d5-70100a24ce15 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:38.878794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 128/267] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 14:17:38.884562 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a06bd-eed7-4fe8-ac38-a859106f47de None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:39.023361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a06bd-eed7-4fe8-ac38-a859106f47de None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:39.027811 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daeb16-42d7-4747-98aa-ed8ec1b34466 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:39.028104 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daeb16-42d7-4747-98aa-ed8ec1b34466 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:39.028461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daeb16-42d7-4747-98aa-ed8ec1b34466 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:39.030008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 129/268] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:39.037562 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0cb11-1b7a-4b3a-8c1a-dd330a9cc0a9 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:39.037853 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0cb11-1b7a-4b3a-8c1a-dd330a9cc0a9 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:39.038139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0cb11-1b7a-4b3a-8c1a-dd330a9cc0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:39.061297 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72627f1b-6937-49e6-9743-ebaddadbb41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:39.062528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72627f1b-6937-49e6-9743-ebaddadbb41b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:39.063008 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72627f1b-6937-49e6-9743-ebaddadbb41b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:39.063506 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72627f1b-6937-49e6-9743-ebaddadbb41b None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:39.064886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72627f1b-6937-49e6-9743-ebaddadbb41b None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:39.066550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72627f1b-6937-49e6-9743-ebaddadbb41b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:39.073135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 140/269] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:38 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:39.074578 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72627f1b-6937-49e6-9743-ebaddadbb41b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:39.090419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-cce0cb11-1b7a-4b3a-8c1a-dd330a9cc0a9 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:39.092329 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-cce0cb11-1b7a-4b3a-8c1a-dd330a9cc0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:39.177802 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72627f1b-6937-49e6-9743-ebaddadbb41b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:39.225416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 130/270] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:39.259094 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0cb11-1b7a-4b3a-8c1a-dd330a9cc0a9 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:39.262960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56fca3-c625-45f8-aca9-60ea83a1cb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:39.264000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56fca3-c625-45f8-aca9-60ea83a1cb21 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:39.264949 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56fca3-c625-45f8-aca9-60ea83a1cb21 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:39.265428 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56fca3-c625-45f8-aca9-60ea83a1cb21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:39.267302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56fca3-c625-45f8-aca9-60ea83a1cb21 None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=ca31edde9c134f528cd3f229ac72e713, user.id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:39.272082 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56fca3-c625-45f8-aca9-60ea83a1cb21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:39.273906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56fca3-c625-45f8-aca9-60ea83a1cb21 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:39.284085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 141/271] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:39 2022] GET /identity/v3/role_assignments?user.id=b86c51b60e6f4ad39e8dd2dd0f8bd9b7&scope.project.id=ca31edde9c134f528cd3f229ac72e713&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:39.398685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26a12e-3fa1-4803-9b86-b87fdd02d1e6 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:39.399367 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26a12e-3fa1-4803-9b86-b87fdd02d1e6 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:39.399832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26a12e-3fa1-4803-9b86-b87fdd02d1e6 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:39.401508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 142/272] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:17:39.409385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fdc07-22ae-4573-80f5-0bf15043dcde None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:39.410021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fdc07-22ae-4573-80f5-0bf15043dcde None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:39.410413 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fdc07-22ae-4573-80f5-0bf15043dcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:39.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0cb11-1b7a-4b3a-8c1a-dd330a9cc0a9 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:39.449130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-6f4fdc07-22ae-4573-80f5-0bf15043dcde None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:39.450403 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6f4fdc07-22ae-4573-80f5-0bf15043dcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:39.475742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79923695-0bb8-406f-86f9-4e691dcd45e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:39.476892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79923695-0bb8-406f-86f9-4e691dcd45e1 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:39.477352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79923695-0bb8-406f-86f9-4e691dcd45e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:39.477796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79923695-0bb8-406f-86f9-4e691dcd45e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:39.491553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79923695-0bb8-406f-86f9-4e691dcd45e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-79923695-0bb8-406f-86f9-4e691dcd45e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:39.501830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:39.502821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:39.503621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:39.503621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:39.503621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:39.503621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:39.503621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:39.503621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:39.503621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:39.503621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:39.503621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:39.503621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:39.503621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:39.503621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:39.506204 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 131/273] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:39.512513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79923695-0bb8-406f-86f9-4e691dcd45e1 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:39.561968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 143/274] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:39.580664 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad567cba-0451-409e-a776-e6ad9b511eb2 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:39.580959 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad567cba-0451-409e-a776-e6ad9b511eb2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:39.581493 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad567cba-0451-409e-a776-e6ad9b511eb2 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:39.583973 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 144/275] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:17:39.589190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3482d3-abde-468a-a2c7-988dfea746b0 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:39.589486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3482d3-abde-468a-a2c7-988dfea746b0 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:39.589769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3482d3-abde-468a-a2c7-988dfea746b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:39.607293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-8e3482d3-abde-468a-a2c7-988dfea746b0 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:39.608491 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-8e3482d3-abde-468a-a2c7-988dfea746b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:39.639473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79923695-0bb8-406f-86f9-4e691dcd45e1 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:39.674495 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123d6ad-8b0d-4596-a761-5263a68b5237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:39.675161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123d6ad-8b0d-4596-a761-5263a68b5237 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:39.675440 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123d6ad-8b0d-4596-a761-5263a68b5237 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:39.675712 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123d6ad-8b0d-4596-a761-5263a68b5237 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:39.676301 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 145/276] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:39.676539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123d6ad-8b0d-4596-a761-5263a68b5237 None admin] RBAC: Adding query filter params (name=member) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:39.676846 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123d6ad-8b0d-4596-a761-5263a68b5237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:39.677013 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3482d3-abde-468a-a2c7-988dfea746b0 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:39.678286 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123d6ad-8b0d-4596-a761-5263a68b5237 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:39.688320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 132/277] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:39.693728 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123d6ad-8b0d-4596-a761-5263a68b5237 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:39.782627 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3482d3-abde-468a-a2c7-988dfea746b0 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:39.795417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123d6ad-8b0d-4596-a761-5263a68b5237 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:39.816798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb663a0-11a2-4728-8d0b-48fba44a0fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:39.817529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb663a0-11a2-4728-8d0b-48fba44a0fac None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:39.817812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb663a0-11a2-4728-8d0b-48fba44a0fac None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:39.818090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb663a0-11a2-4728-8d0b-48fba44a0fac None admin] PATH_INFO: `/v3/domains/default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:39.819283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb663a0-11a2-4728-8d0b-48fba44a0fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:39.820743 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb663a0-11a2-4728-8d0b-48fba44a0fac None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:39.823471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 146/278] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:17:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:39.823471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb663a0-11a2-4728-8d0b-48fba44a0fac None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:39.834901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e9f16-6adb-4258-9e5b-04e85041f2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:39.836019 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e9f16-6adb-4258-9e5b-04e85041f2cc None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:39.836453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e9f16-6adb-4258-9e5b-04e85041f2cc None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:39.836729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e9f16-6adb-4258-9e5b-04e85041f2cc None admin] PATH_INFO: `/v3/users/e3a1b51385674d18beded10672e61ee7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:39.851963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e9f16-6adb-4258-9e5b-04e85041f2cc None admin] RBAC: Authorizing `identity:get_user(user_id=e3a1b51385674d18beded10672e61ee7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:39.853445 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e9f16-6adb-4258-9e5b-04e85041f2cc None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:39.855362 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 133/279] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:39 2022] GET /identity/v3/users/e3a1b51385674d18beded10672e61ee7 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:39.861223 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e9f16-6adb-4258-9e5b-04e85041f2cc None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:39.941737 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb663a0-11a2-4728-8d0b-48fba44a0fac None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:39.980818 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48503a70-c218-4617-9974-271442a3b02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:39.982026 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503a70-c218-4617-9974-271442a3b02c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:39.982453 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503a70-c218-4617-9974-271442a3b02c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:39.982730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503a70-c218-4617-9974-271442a3b02c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:39.989494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e9f16-6adb-4258-9e5b-04e85041f2cc None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:39.996923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48503a70-c218-4617-9974-271442a3b02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-48503a70-c218-4617-9974-271442a3b02c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:40.008040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:40.008923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:40.009731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:40.009731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:40.009731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:40.009731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:40.009731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:40.009731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:40.009731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:40.009731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:40.009731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:40.009731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:40.009731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:40.009731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:40.016989 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 147/280] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:40.016989 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48503a70-c218-4617-9974-271442a3b02c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:40.036380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4670244-0820-4889-99f6-da0858adb03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:40.037224 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4670244-0820-4889-99f6-da0858adb03b None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:40.037510 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4670244-0820-4889-99f6-da0858adb03b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:40.037786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4670244-0820-4889-99f6-da0858adb03b None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:40.038576 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4670244-0820-4889-99f6-da0858adb03b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:40.040010 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4670244-0820-4889-99f6-da0858adb03b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:40.065339 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 134/281] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:17:39 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:17:40.066016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4670244-0820-4889-99f6-da0858adb03b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:40.135676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48503a70-c218-4617-9974-271442a3b02c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:40.175103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21af4f7-24fb-49d1-843f-c0a46ea64bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:40.176189 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21af4f7-24fb-49d1-843f-c0a46ea64bda None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:40.176702 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21af4f7-24fb-49d1-843f-c0a46ea64bda None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:40.177178 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21af4f7-24fb-49d1-843f-c0a46ea64bda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:40.178267 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21af4f7-24fb-49d1-843f-c0a46ea64bda None admin] RBAC: Adding query filter params (role.id=c2cbdedfc238463d91a843ca8e5ac3ca, user.id=e3a1b51385674d18beded10672e61ee7, scope.system=all) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:40.178809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21af4f7-24fb-49d1-843f-c0a46ea64bda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:40.180537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21af4f7-24fb-49d1-843f-c0a46ea64bda None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:40.192399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4670244-0820-4889-99f6-da0858adb03b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:40.202353 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 148/282] 10.222.0.48 () {56 vars in 1308 bytes} [Tue May 17 14:17:40 2022] GET /identity/v3/role_assignments?user.id=e3a1b51385674d18beded10672e61ee7&scope.system=all&role.id=c2cbdedfc238463d91a843ca8e5ac3ca => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:40.241218 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8ec09-8121-4767-9ba6-e046b99e69d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:40.242203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8ec09-8121-4767-9ba6-e046b99e69d9 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:40.242890 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8ec09-8121-4767-9ba6-e046b99e69d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:40.243651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8ec09-8121-4767-9ba6-e046b99e69d9 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:40.245762 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8ec09-8121-4767-9ba6-e046b99e69d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:40.246263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8ec09-8121-4767-9ba6-e046b99e69d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:40.251055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8ec09-8121-4767-9ba6-e046b99e69d9 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:40.260629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 135/283] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:40.268700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21af4f7-24fb-49d1-843f-c0a46ea64bda None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:40.425886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21af4f7-24fb-49d1-843f-c0a46ea64bda None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:40.459181 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff0d01-a5d9-4a76-8afe-f95728c779a1 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:40.459492 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff0d01-a5d9-4a76-8afe-f95728c779a1 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:40.459735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff0d01-a5d9-4a76-8afe-f95728c779a1 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:40.461094 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 136/284] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:17:40.466487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb3c4e-92e3-4288-9660-7ac727e68151 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:40.466850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb3c4e-92e3-4288-9660-7ac727e68151 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:40.467038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb3c4e-92e3-4288-9660-7ac727e68151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:40.478469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbd61b-b2c7-48df-ae3e-53f7573c3583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:40.478469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbd61b-b2c7-48df-ae3e-53f7573c3583 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:40.478469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbd61b-b2c7-48df-ae3e-53f7573c3583 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:40.478469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbd61b-b2c7-48df-ae3e-53f7573c3583 None admin] PATH_INFO: `/v3/users/404e9e60ea67446d96ce47df881f1b22` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:40.478827 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbd61b-b2c7-48df-ae3e-53f7573c3583 None admin] RBAC: Authorizing `identity:get_user(user_id=404e9e60ea67446d96ce47df881f1b22)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:40.479292 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbd61b-b2c7-48df-ae3e-53f7573c3583 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:40.483057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 149/285] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:40 2022] GET /identity/v3/users/404e9e60ea67446d96ce47df881f1b22 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:40.485613 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-7abb3c4e-92e3-4288-9660-7ac727e68151 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:40.486861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7abb3c4e-92e3-4288-9660-7ac727e68151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:40.487883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbd61b-b2c7-48df-ae3e-53f7573c3583 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:40.579908 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 137/286] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:40.601092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbd61b-b2c7-48df-ae3e-53f7573c3583 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:40.604906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb3c4e-92e3-4288-9660-7ac727e68151 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:40.645101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bdbc2-0455-4e7a-87ba-fdc646f41037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:40.646360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bdbc2-0455-4e7a-87ba-fdc646f41037 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:40.647018 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bdbc2-0455-4e7a-87ba-fdc646f41037 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:40.647487 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bdbc2-0455-4e7a-87ba-fdc646f41037 None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:40.649712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bdbc2-0455-4e7a-87ba-fdc646f41037 None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:40.651413 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bdbc2-0455-4e7a-87ba-fdc646f41037 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:40.654191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 150/287] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:40 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:40.660812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bdbc2-0455-4e7a-87ba-fdc646f41037 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:40.769161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb3c4e-92e3-4288-9660-7ac727e68151 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:40.826283 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa26e16-aa60-487e-bff3-25e60901ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:40.828424 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa26e16-aa60-487e-bff3-25e60901ec32 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:40.829559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa26e16-aa60-487e-bff3-25e60901ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:40.830727 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa26e16-aa60-487e-bff3-25e60901ec32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:40.840276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bdbc2-0455-4e7a-87ba-fdc646f41037 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:40.854870 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa26e16-aa60-487e-bff3-25e60901ec32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-baa26e16-aa60-487e-bff3-25e60901ec32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:40.867319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:40.868260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:40.869084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:40.869084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:40.869084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:40.869084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:40.869084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:40.869084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:40.869084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:40.869084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:40.869084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:40.869084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:40.869084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:40.869084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:40.873322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 138/288] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:17:40.885908 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa26e16-aa60-487e-bff3-25e60901ec32 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:40.909950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c73263-7a60-47f8-8d40-3c606ff09ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:40.911112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c73263-7a60-47f8-8d40-3c606ff09ba4 None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:40.911569 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c73263-7a60-47f8-8d40-3c606ff09ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:40.911994 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c73263-7a60-47f8-8d40-3c606ff09ba4 None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713/users/404e9e60ea67446d96ce47df881f1b22/roles/5c131c170ffc4e1da14872da2dab3928` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:40.914131 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c73263-7a60-47f8-8d40-3c606ff09ba4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca31edde9c134f528cd3f229ac72e713, user_id=404e9e60ea67446d96ce47df881f1b22, role_id=5c131c170ffc4e1da14872da2dab3928)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:40.915824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c73263-7a60-47f8-8d40-3c606ff09ba4 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:40.943705 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 151/289] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:17:40 2022] PUT /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713/users/404e9e60ea67446d96ce47df881f1b22/roles/5c131c170ffc4e1da14872da2dab3928 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:17:41.016564 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa26e16-aa60-487e-bff3-25e60901ec32 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:41.053840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4801b2-1745-4b97-833a-43671c0bfce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:41.054935 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4801b2-1745-4b97-833a-43671c0bfce5 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:41.055427 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4801b2-1745-4b97-833a-43671c0bfce5 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:41.055918 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4801b2-1745-4b97-833a-43671c0bfce5 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:41.056920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4801b2-1745-4b97-833a-43671c0bfce5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:41.057427 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4801b2-1745-4b97-833a-43671c0bfce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:41.059150 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4801b2-1745-4b97-833a-43671c0bfce5 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:41.069093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 139/290] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:41.074833 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c73263-7a60-47f8-8d40-3c606ff09ba4 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:41.210564 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c73263-7a60-47f8-8d40-3c606ff09ba4 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:41.269559 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ddc81-83f5-49ee-9b14-29d13f542cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:41.270465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ddc81-83f5-49ee-9b14-29d13f542cdf None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:41.270745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ddc81-83f5-49ee-9b14-29d13f542cdf None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:41.271015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ddc81-83f5-49ee-9b14-29d13f542cdf None admin] PATH_INFO: `/v3/users/79ce7d8036614eb282d929ce8392e612` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:41.272229 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ddc81-83f5-49ee-9b14-29d13f542cdf None admin] RBAC: Authorizing `identity:get_user(user_id=79ce7d8036614eb282d929ce8392e612)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:41.273683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ddc81-83f5-49ee-9b14-29d13f542cdf None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:41.275717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 152/291] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:41 2022] GET /identity/v3/users/79ce7d8036614eb282d929ce8392e612 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:41.281559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4801b2-1745-4b97-833a-43671c0bfce5 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:41.392332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4801b2-1745-4b97-833a-43671c0bfce5 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:41.430772 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb549915-fbaa-4276-827a-62d0f2312e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:41.431771 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb549915-fbaa-4276-827a-62d0f2312e78 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:41.432254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb549915-fbaa-4276-827a-62d0f2312e78 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:41.432729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb549915-fbaa-4276-827a-62d0f2312e78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:41.502706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb549915-fbaa-4276-827a-62d0f2312e78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:41.504537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb549915-fbaa-4276-827a-62d0f2312e78 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:41.607120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 140/292] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:41.612972 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ddc81-83f5-49ee-9b14-29d13f542cdf None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:41.716659 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ddc81-83f5-49ee-9b14-29d13f542cdf None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:41.751533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9cc8b-52c4-4bcc-9a41-6e84d9cd17db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:41.752754 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9cc8b-52c4-4bcc-9a41-6e84d9cd17db None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:41.753240 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9cc8b-52c4-4bcc-9a41-6e84d9cd17db None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:41.753730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9cc8b-52c4-4bcc-9a41-6e84d9cd17db None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:41.755516 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9cc8b-52c4-4bcc-9a41-6e84d9cd17db None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:41.757219 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9cc8b-52c4-4bcc-9a41-6e84d9cd17db None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:41.759432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 153/293] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:41 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:41.766034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb549915-fbaa-4276-827a-62d0f2312e78 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:41.870197 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb549915-fbaa-4276-827a-62d0f2312e78 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:41.909544 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3081f-2593-4225-ad69-903dc677b7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:41.910641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3081f-2593-4225-ad69-903dc677b7be None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:41.911122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3081f-2593-4225-ad69-903dc677b7be None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:41.911638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3081f-2593-4225-ad69-903dc677b7be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:41.912670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3081f-2593-4225-ad69-903dc677b7be None admin] RBAC: Adding query filter params (role.id=c2cbdedfc238463d91a843ca8e5ac3ca, scope.project.id=ca31edde9c134f528cd3f229ac72e713, user.id=79ce7d8036614eb282d929ce8392e612) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:41.913192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3081f-2593-4225-ad69-903dc677b7be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:41.914869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3081f-2593-4225-ad69-903dc677b7be None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:41.922129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 141/294] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:41 2022] GET /identity/v3/role_assignments?user.id=79ce7d8036614eb282d929ce8392e612&scope.project.id=ca31edde9c134f528cd3f229ac72e713&role.id=c2cbdedfc238463d91a843ca8e5ac3ca => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:42.781453 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ff7b9-c415-490a-ad9b-5ba597359c6e None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:42.782041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ff7b9-c415-490a-ad9b-5ba597359c6e None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:42.782041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ff7b9-c415-490a-ad9b-5ba597359c6e None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:42.783980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 154/295] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:42.790535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44761bf7-4de1-49ac-aaa5-c7716024b3dd None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:42.791413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44761bf7-4de1-49ac-aaa5-c7716024b3dd None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:42.791895 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44761bf7-4de1-49ac-aaa5-c7716024b3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:42.810076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-44761bf7-4de1-49ac-aaa5-c7716024b3dd None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:42.811668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-44761bf7-4de1-49ac-aaa5-c7716024b3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:42.882288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 142/296] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:42.902089 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ff7b9-c415-490a-ad9b-5ba597359c6e None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:42.946889 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd92507-499a-40f3-a257-b7966d185d9e None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:42.947232 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd92507-499a-40f3-a257-b7966d185d9e None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:42.948047 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd92507-499a-40f3-a257-b7966d185d9e None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:42.948879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 143/297] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:17:42.955067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99587ee6-0b7c-4aa5-8acc-41567559e019 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:42.955477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99587ee6-0b7c-4aa5-8acc-41567559e019 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:42.955858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99587ee6-0b7c-4aa5-8acc-41567559e019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:42.973483 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-99587ee6-0b7c-4aa5-8acc-41567559e019 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:42.974867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-99587ee6-0b7c-4aa5-8acc-41567559e019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:43.027276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ff7b9-c415-490a-ad9b-5ba597359c6e None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:43.061106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 144/298] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:43.076823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1aec93-7e0d-472f-aeb7-37900b24165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:43.077807 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aec93-7e0d-472f-aeb7-37900b24165c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:43.078260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aec93-7e0d-472f-aeb7-37900b24165c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:43.078678 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aec93-7e0d-472f-aeb7-37900b24165c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:43.083061 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99587ee6-0b7c-4aa5-8acc-41567559e019 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:43.098810 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1aec93-7e0d-472f-aeb7-37900b24165c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-7f1aec93-7e0d-472f-aeb7-37900b24165c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:43.109665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:43.110598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:43.111395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:43.111395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:43.111395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:43.111395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:43.111395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:43.111395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:43.111395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:43.111395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:43.111395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:43.111395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:43.111395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:43.111395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:43.111995 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 155/299] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:43.118832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1aec93-7e0d-472f-aeb7-37900b24165c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:43.188607 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99587ee6-0b7c-4aa5-8acc-41567559e019 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:43.223198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ae0a4-3b2d-4515-9e01-712f074e4a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:43.223987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ae0a4-3b2d-4515-9e01-712f074e4a3d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:43.224261 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ae0a4-3b2d-4515-9e01-712f074e4a3d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:43.224541 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ae0a4-3b2d-4515-9e01-712f074e4a3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:43.225697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ae0a4-3b2d-4515-9e01-712f074e4a3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:43.227175 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ae0a4-3b2d-4515-9e01-712f074e4a3d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:43.227343 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1aec93-7e0d-472f-aeb7-37900b24165c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:43.228777 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 145/300] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:17:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:43.230029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b317a-b22f-4370-890c-d9d7e65668da None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:43.230335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b317a-b22f-4370-890c-d9d7e65668da None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:43.230608 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b317a-b22f-4370-890c-d9d7e65668da None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:43.237217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 146/301] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:43.237217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b317a-b22f-4370-890c-d9d7e65668da None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:43.273556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978fb7f-49a1-4ae1-a3b1-c910f3223071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:43.274283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978fb7f-49a1-4ae1-a3b1-c910f3223071 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:43.274570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978fb7f-49a1-4ae1-a3b1-c910f3223071 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:43.274847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978fb7f-49a1-4ae1-a3b1-c910f3223071 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:43.275595 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978fb7f-49a1-4ae1-a3b1-c910f3223071 None admin] RBAC: Adding query filter params (name=member) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:43.275901 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978fb7f-49a1-4ae1-a3b1-c910f3223071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:43.277272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978fb7f-49a1-4ae1-a3b1-c910f3223071 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:43.287052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 156/302] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:43.288446 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01edb8-d2a5-483f-bc6d-73966d7d7d6d None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:43.288737 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01edb8-d2a5-483f-bc6d-73966d7d7d6d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:43.289015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01edb8-d2a5-483f-bc6d-73966d7d7d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:43.311819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-6c01edb8-d2a5-483f-bc6d-73966d7d7d6d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:43.313279 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6c01edb8-d2a5-483f-bc6d-73966d7d7d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:43.344836 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b317a-b22f-4370-890c-d9d7e65668da None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:43.380393 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c0b0b-0919-4fdc-bab9-75af55107d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:43.381068 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c0b0b-0919-4fdc-bab9-75af55107d9e None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:43.381349 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c0b0b-0919-4fdc-bab9-75af55107d9e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:43.381514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 157/303] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:43.390434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c0b0b-0919-4fdc-bab9-75af55107d9e None admin] PATH_INFO: `/v3/groups` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:43.390434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c0b0b-0919-4fdc-bab9-75af55107d9e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:43.390579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01edb8-d2a5-483f-bc6d-73966d7d7d6d None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:43.390667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c0b0b-0919-4fdc-bab9-75af55107d9e None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:43.408237 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 147/304] 10.222.0.48 () {60 vars in 1134 bytes} [Tue May 17 14:17:43 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:17:43.409440 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c0b0b-0919-4fdc-bab9-75af55107d9e None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:43.514815 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01edb8-d2a5-483f-bc6d-73966d7d7d6d None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:43.532415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c0b0b-0919-4fdc-bab9-75af55107d9e None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:43.551669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c4622-1ef4-46ee-93c9-d1e84f136f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:43.552614 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c4622-1ef4-46ee-93c9-d1e84f136f25 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:43.552899 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c4622-1ef4-46ee-93c9-d1e84f136f25 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:43.553177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c4622-1ef4-46ee-93c9-d1e84f136f25 None admin] PATH_INFO: `/v3/users/e3a1b51385674d18beded10672e61ee7` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:43.554557 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c4622-1ef4-46ee-93c9-d1e84f136f25 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a1b51385674d18beded10672e61ee7)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:43.556056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c4622-1ef4-46ee-93c9-d1e84f136f25 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:43.557820 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 158/305] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:43 2022] GET /identity/v3/users/e3a1b51385674d18beded10672e61ee7 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:43.564345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c4622-1ef4-46ee-93c9-d1e84f136f25 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:43.573627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a987202-fe12-4d6f-972a-04b3ea6f7dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:43.574487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a987202-fe12-4d6f-972a-04b3ea6f7dc3 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:43.574768 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a987202-fe12-4d6f-972a-04b3ea6f7dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:43.575107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a987202-fe12-4d6f-972a-04b3ea6f7dc3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:43.590124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a987202-fe12-4d6f-972a-04b3ea6f7dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-2a987202-fe12-4d6f-972a-04b3ea6f7dc3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:43.601166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:43.602554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:43.603924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:43.603924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:43.603924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:43.603924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:43.603924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:43.603924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:43.603924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:43.603924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:43.603924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:43.603924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:43.603924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:43.603924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:43.603924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 148/306] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:43.611178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a987202-fe12-4d6f-972a-04b3ea6f7dc3 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:43.693376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c4622-1ef4-46ee-93c9-d1e84f136f25 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:43.734838 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a987202-fe12-4d6f-972a-04b3ea6f7dc3 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:43.739018 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e33b76-f92c-4dcb-b982-0cccdae17a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:43.739893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e33b76-f92c-4dcb-b982-0cccdae17a02 None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:43.740177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e33b76-f92c-4dcb-b982-0cccdae17a02 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:43.740452 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e33b76-f92c-4dcb-b982-0cccdae17a02 None admin] PATH_INFO: `/v3/system/users/e3a1b51385674d18beded10672e61ee7/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:43.742427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e33b76-f92c-4dcb-b982-0cccdae17a02 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e3a1b51385674d18beded10672e61ee7, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:43.744236 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e33b76-f92c-4dcb-b982-0cccdae17a02 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:43.757527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 159/307] 10.222.0.48 () {58 vars in 1334 bytes} [Tue May 17 14:17:43 2022] PUT /identity/v3/system/users/e3a1b51385674d18beded10672e61ee7/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:17:43.786489 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edf0ba-dc90-418c-acaa-b3d91db23bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:43.787234 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edf0ba-dc90-418c-acaa-b3d91db23bf8 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:43.787525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edf0ba-dc90-418c-acaa-b3d91db23bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:43.787809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edf0ba-dc90-418c-acaa-b3d91db23bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:43.788598 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edf0ba-dc90-418c-acaa-b3d91db23bf8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:43.788911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edf0ba-dc90-418c-acaa-b3d91db23bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:43.790381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edf0ba-dc90-418c-acaa-b3d91db23bf8 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:43.802288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 149/308] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:43.806933 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e33b76-f92c-4dcb-b982-0cccdae17a02 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:43.819778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c4a03-8703-4546-8382-094e67a9aec3 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:43.820063 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c4a03-8703-4546-8382-094e67a9aec3 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:43.820254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c4a03-8703-4546-8382-094e67a9aec3 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:43.821809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 150/309] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:43.828131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa67cb-fa30-4029-a15a-8986af4fd826 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:43.828438 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa67cb-fa30-4029-a15a-8986af4fd826 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:43.828682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa67cb-fa30-4029-a15a-8986af4fd826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:43.851465 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-78fa67cb-fa30-4029-a15a-8986af4fd826 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:43.853210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-78fa67cb-fa30-4029-a15a-8986af4fd826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:43.930240 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e33b76-f92c-4dcb-b982-0cccdae17a02 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:43.934797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 151/310] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:43.953176 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa67cb-fa30-4029-a15a-8986af4fd826 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:43.966834 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a8c19-1b1e-42c9-9768-4e8a76e59c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:43.967855 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a8c19-1b1e-42c9-9768-4e8a76e59c80 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:43.968147 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a8c19-1b1e-42c9-9768-4e8a76e59c80 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:43.968429 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a8c19-1b1e-42c9-9768-4e8a76e59c80 None admin] PATH_INFO: `/v3/users/1cfd9b92b679459b8b25ec131b63e186` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:43.987695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a8c19-1b1e-42c9-9768-4e8a76e59c80 None admin] RBAC: Authorizing `identity:get_user(user_id=1cfd9b92b679459b8b25ec131b63e186)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:43.990041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a8c19-1b1e-42c9-9768-4e8a76e59c80 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:43.993001 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 160/311] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:43 2022] GET /identity/v3/users/1cfd9b92b679459b8b25ec131b63e186 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:44.002202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a8c19-1b1e-42c9-9768-4e8a76e59c80 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:44.071293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa67cb-fa30-4029-a15a-8986af4fd826 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:44.101150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a8c19-1b1e-42c9-9768-4e8a76e59c80 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:44.117768 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ad15c-5236-4b32-8d1f-a0079437b1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:44.119068 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ad15c-5236-4b32-8d1f-a0079437b1e0 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:44.119358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ad15c-5236-4b32-8d1f-a0079437b1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:44.119639 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ad15c-5236-4b32-8d1f-a0079437b1e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:44.132754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ad15c-5236-4b32-8d1f-a0079437b1e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:44.137105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee0e27-6501-4814-bc8d-a6df8af11b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:44.138331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee0e27-6501-4814-bc8d-a6df8af11b71 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:44.138617 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee0e27-6501-4814-bc8d-a6df8af11b71 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:44.138891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee0e27-6501-4814-bc8d-a6df8af11b71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:44.139728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee0e27-6501-4814-bc8d-a6df8af11b71 None admin] RBAC: Adding query filter params (role.id=5c131c170ffc4e1da14872da2dab3928, user.id=1cfd9b92b679459b8b25ec131b63e186, scope.system=all) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:44.140038 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee0e27-6501-4814-bc8d-a6df8af11b71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:44.141489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee0e27-6501-4814-bc8d-a6df8af11b71 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-fb2ad15c-5236-4b32-8d1f-a0079437b1e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:44.142391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:44.143256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:44.144059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:44.144059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:44.144059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:44.144059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:44.144059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:44.144059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:44.144059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:44.144059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:44.144059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:44.144059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:44.144059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:44.144059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:44.144672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 152/312] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:17:44.150357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ad15c-5236-4b32-8d1f-a0079437b1e0 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:44.151207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 161/313] 10.222.0.48 () {56 vars in 1308 bytes} [Tue May 17 14:17:43 2022] GET /identity/v3/role_assignments?user.id=1cfd9b92b679459b8b25ec131b63e186&scope.system=all&role.id=5c131c170ffc4e1da14872da2dab3928 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:44.268308 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ad15c-5236-4b32-8d1f-a0079437b1e0 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:44.305159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc333a-9876-4198-b961-4000b6364fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:44.305846 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc333a-9876-4198-b961-4000b6364fca None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:44.306131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc333a-9876-4198-b961-4000b6364fca None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:44.306442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc333a-9876-4198-b961-4000b6364fca None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:44.307219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc333a-9876-4198-b961-4000b6364fca None admin] RBAC: Adding query filter params (name=reader) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:44.307528 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc333a-9876-4198-b961-4000b6364fca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:44.308958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc333a-9876-4198-b961-4000b6364fca None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:44.319434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 153/314] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:44.325206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee0e27-6501-4814-bc8d-a6df8af11b71 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:44.428685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee0e27-6501-4814-bc8d-a6df8af11b71 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:44.462507 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d09530-329a-47f4-ab81-6c9134613f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:44.463381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d09530-329a-47f4-ab81-6c9134613f96 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:44.463659 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d09530-329a-47f4-ab81-6c9134613f96 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:44.463931 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d09530-329a-47f4-ab81-6c9134613f96 None admin] PATH_INFO: `/v3/users/404e9e60ea67446d96ce47df881f1b22` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:44.465124 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d09530-329a-47f4-ab81-6c9134613f96 None admin] RBAC: Authorizing `identity:get_user(user_id=404e9e60ea67446d96ce47df881f1b22)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:44.467145 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d09530-329a-47f4-ab81-6c9134613f96 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:44.468965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 162/315] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:44 2022] GET /identity/v3/users/404e9e60ea67446d96ce47df881f1b22 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:44.474529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc333a-9876-4198-b961-4000b6364fca None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:44.576953 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc333a-9876-4198-b961-4000b6364fca None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:44.611337 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def12926-39d6-49eb-ab53-f313fbdd315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:44.611987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def12926-39d6-49eb-ab53-f313fbdd315b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:44.612268 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def12926-39d6-49eb-ab53-f313fbdd315b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:44.612542 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def12926-39d6-49eb-ab53-f313fbdd315b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:44.683844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def12926-39d6-49eb-ab53-f313fbdd315b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:44.685637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def12926-39d6-49eb-ab53-f313fbdd315b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:44.790402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 154/316] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:44.791898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d09530-329a-47f4-ab81-6c9134613f96 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:44.892029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d09530-329a-47f4-ab81-6c9134613f96 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:44.927527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3632c-533e-4373-b1f3-1b30adbf4371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:44.928387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3632c-533e-4373-b1f3-1b30adbf4371 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:44.928664 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3632c-533e-4373-b1f3-1b30adbf4371 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:44.928936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3632c-533e-4373-b1f3-1b30adbf4371 None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:44.930103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3632c-533e-4373-b1f3-1b30adbf4371 None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:44.931587 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3632c-533e-4373-b1f3-1b30adbf4371 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:44.933653 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 163/317] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:44 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:44.939444 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def12926-39d6-49eb-ab53-f313fbdd315b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:45.042524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def12926-39d6-49eb-ab53-f313fbdd315b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:45.077866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45bc50-c96a-4fa0-bd5c-38cc2c2708af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:45.078886 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45bc50-c96a-4fa0-bd5c-38cc2c2708af None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:45.079367 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45bc50-c96a-4fa0-bd5c-38cc2c2708af None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:45.079835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45bc50-c96a-4fa0-bd5c-38cc2c2708af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:45.080857 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45bc50-c96a-4fa0-bd5c-38cc2c2708af None admin] RBAC: Adding query filter params (role.id=5c131c170ffc4e1da14872da2dab3928, scope.project.id=ca31edde9c134f528cd3f229ac72e713, user.id=404e9e60ea67446d96ce47df881f1b22) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:45.081666 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45bc50-c96a-4fa0-bd5c-38cc2c2708af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:45.083336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45bc50-c96a-4fa0-bd5c-38cc2c2708af None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:45.089999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 155/318] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:17:44 2022] GET /identity/v3/role_assignments?user.id=404e9e60ea67446d96ce47df881f1b22&scope.project.id=ca31edde9c134f528cd3f229ac72e713&role.id=5c131c170ffc4e1da14872da2dab3928 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:45.772977 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd390faa-ed81-4b9f-8edb-dcb8ae3309fe None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:45.773267 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd390faa-ed81-4b9f-8edb-dcb8ae3309fe None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:45.773711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd390faa-ed81-4b9f-8edb-dcb8ae3309fe None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:45.775253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 164/319] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:45.780803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7ffbd-c699-4cb2-828d-0871ba186057 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:45.781092 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7ffbd-c699-4cb2-828d-0871ba186057 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:45.781374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7ffbd-c699-4cb2-828d-0871ba186057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:45.802786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-0fb7ffbd-c699-4cb2-828d-0871ba186057 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:45.803960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-0fb7ffbd-c699-4cb2-828d-0871ba186057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:45.868726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 156/320] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:45.891954 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd390faa-ed81-4b9f-8edb-dcb8ae3309fe None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:45.992900 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd390faa-ed81-4b9f-8edb-dcb8ae3309fe None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:46.026518 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adc509-a6c2-4b13-92b0-9d9eecb5e724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:46.027242 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adc509-a6c2-4b13-92b0-9d9eecb5e724 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:46.027523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adc509-a6c2-4b13-92b0-9d9eecb5e724 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:46.027795 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adc509-a6c2-4b13-92b0-9d9eecb5e724 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:46.029200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adc509-a6c2-4b13-92b0-9d9eecb5e724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:46.030680 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adc509-a6c2-4b13-92b0-9d9eecb5e724 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:46.032447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 165/321] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:17:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:46.037900 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7ffbd-c699-4cb2-828d-0871ba186057 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:46.084348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228abd6e-49f4-4481-be8c-fff788cd108b None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:46.084668 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228abd6e-49f4-4481-be8c-fff788cd108b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:46.084915 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228abd6e-49f4-4481-be8c-fff788cd108b None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:46.086432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 166/322] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:17:46.092207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa8401-5fc5-4af9-957e-7d47b7b1f14b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:46.092503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa8401-5fc5-4af9-957e-7d47b7b1f14b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:46.092790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa8401-5fc5-4af9-957e-7d47b7b1f14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:46.109748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-5faa8401-5fc5-4af9-957e-7d47b7b1f14b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:46.110960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5faa8401-5fc5-4af9-957e-7d47b7b1f14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:46.155185 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7ffbd-c699-4cb2-828d-0871ba186057 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:46.176783 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 167/323] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:46.187532 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8a694-6896-4cf9-a7b8-be13808a1419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:46.188281 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8a694-6896-4cf9-a7b8-be13808a1419 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:46.188566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8a694-6896-4cf9-a7b8-be13808a1419 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:46.188834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8a694-6896-4cf9-a7b8-be13808a1419 None admin] PATH_INFO: `/v3/groups` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:46.189518 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8a694-6896-4cf9-a7b8-be13808a1419 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:46.191008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8a694-6896-4cf9-a7b8-be13808a1419 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:46.201105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa8401-5fc5-4af9-957e-7d47b7b1f14b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:46.208382 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 157/324] 10.222.0.48 () {60 vars in 1134 bytes} [Tue May 17 14:17:46 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:17:46.312365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa8401-5fc5-4af9-957e-7d47b7b1f14b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:46.348549 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03710d8-32e6-476b-8559-90d31c3cd3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:46.349696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03710d8-32e6-476b-8559-90d31c3cd3af None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:46.350149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03710d8-32e6-476b-8559-90d31c3cd3af None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:46.350798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03710d8-32e6-476b-8559-90d31c3cd3af None admin] PATH_INFO: `/v3/roles/member` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:46.363160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03710d8-32e6-476b-8559-90d31c3cd3af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-f03710d8-32e6-476b-8559-90d31c3cd3af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:46.371511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:46.372816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:46.373792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:46.373792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:46.373792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:46.373792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:46.373792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:46.373792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:46.373792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:46.373792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:46.373792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:46.373792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:46.373792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:46.373792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:46.376241 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 168/325] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:46.381801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8a694-6896-4cf9-a7b8-be13808a1419 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:46.489411 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4e3bd-0b7c-4f5a-a34b-0e047cf62ba7 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:46.489599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8a694-6896-4cf9-a7b8-be13808a1419 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:46.489700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4e3bd-0b7c-4f5a-a34b-0e047cf62ba7 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:46.489967 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4e3bd-0b7c-4f5a-a34b-0e047cf62ba7 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:46.491520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 169/326] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:17:46.496704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9191e-ca7a-405f-901c-2ac999763e78 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:46.497035 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9191e-ca7a-405f-901c-2ac999763e78 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:46.497332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9191e-ca7a-405f-901c-2ac999763e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:46.517758 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-eec9191e-ca7a-405f-901c-2ac999763e78 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:46.519365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-eec9191e-ca7a-405f-901c-2ac999763e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:46.529383 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fd02d-ef68-434c-af26-7ed287358821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:46.530130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fd02d-ef68-434c-af26-7ed287358821 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:46.530435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fd02d-ef68-434c-af26-7ed287358821 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:46.530708 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fd02d-ef68-434c-af26-7ed287358821 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:46.531922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fd02d-ef68-434c-af26-7ed287358821 None admin] RBAC: Adding query filter params (name=member) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:46.532227 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fd02d-ef68-434c-af26-7ed287358821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:46.533618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fd02d-ef68-434c-af26-7ed287358821 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:46.542440 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 158/327] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:46.547548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fd02d-ef68-434c-af26-7ed287358821 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:46.596256 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 170/328] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:46.621070 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9191e-ca7a-405f-901c-2ac999763e78 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:46.656790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fd02d-ef68-434c-af26-7ed287358821 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:46.695228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4835677-9f57-427f-9e16-2437ddaa59a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:46.696106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4835677-9f57-427f-9e16-2437ddaa59a6 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:46.696391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4835677-9f57-427f-9e16-2437ddaa59a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:46.696666 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4835677-9f57-427f-9e16-2437ddaa59a6 None admin] PATH_INFO: `/v3/users/e3a1b51385674d18beded10672e61ee7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:46.698006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4835677-9f57-427f-9e16-2437ddaa59a6 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a1b51385674d18beded10672e61ee7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:46.699499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4835677-9f57-427f-9e16-2437ddaa59a6 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:46.701879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 159/329] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:46 2022] GET /identity/v3/users/e3a1b51385674d18beded10672e61ee7 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:46.707925 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4835677-9f57-427f-9e16-2437ddaa59a6 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:46.736431 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9191e-ca7a-405f-901c-2ac999763e78 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:46.772390 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d6d30-dd3c-4daa-b273-59c1392782cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:46.773451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d6d30-dd3c-4daa-b273-59c1392782cc None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:46.773869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d6d30-dd3c-4daa-b273-59c1392782cc None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:46.774304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d6d30-dd3c-4daa-b273-59c1392782cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:46.785700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d6d30-dd3c-4daa-b273-59c1392782cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-005d6d30-dd3c-4daa-b273-59c1392782cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:46.793853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:46.794951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:46.795965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:46.795965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:46.795965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:46.795965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:46.795965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:46.795965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:46.795965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:46.795965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:46.795965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:46.795965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:46.795965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:46.795965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:46.797834 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 171/330] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:46.805191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d6d30-dd3c-4daa-b273-59c1392782cc None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:46.823221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4835677-9f57-427f-9e16-2437ddaa59a6 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:46.858636 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a999a-bf85-4e29-a6c9-cc4c3c12b4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:46.859303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a999a-bf85-4e29-a6c9-cc4c3c12b4c5 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:46.859586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a999a-bf85-4e29-a6c9-cc4c3c12b4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:46.859864 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a999a-bf85-4e29-a6c9-cc4c3c12b4c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:46.860698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a999a-bf85-4e29-a6c9-cc4c3c12b4c5 None admin] RBAC: Adding query filter params (role.id=c2cbdedfc238463d91a843ca8e5ac3ca, user.id=e3a1b51385674d18beded10672e61ee7, scope.system=all) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:46.861012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a999a-bf85-4e29-a6c9-cc4c3c12b4c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:46.862490 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a999a-bf85-4e29-a6c9-cc4c3c12b4c5 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:46.874695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 160/331] 10.222.0.48 () {56 vars in 1308 bytes} [Tue May 17 14:17:46 2022] GET /identity/v3/role_assignments?user.id=e3a1b51385674d18beded10672e61ee7&scope.system=all&role.id=c2cbdedfc238463d91a843ca8e5ac3ca => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:46.915695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d6d30-dd3c-4daa-b273-59c1392782cc None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:46.955403 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8693e-7597-41fd-9bb4-a9fa6139b125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:46.956341 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8693e-7597-41fd-9bb4-a9fa6139b125 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:46.956621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8693e-7597-41fd-9bb4-a9fa6139b125 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:46.956896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8693e-7597-41fd-9bb4-a9fa6139b125 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:46.957654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8693e-7597-41fd-9bb4-a9fa6139b125 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:46.957960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8693e-7597-41fd-9bb4-a9fa6139b125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:46.959430 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8693e-7597-41fd-9bb4-a9fa6139b125 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:46.969558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 172/332] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:46.974929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a999a-bf85-4e29-a6c9-cc4c3c12b4c5 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:47.097879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a999a-bf85-4e29-a6c9-cc4c3c12b4c5 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:47.136040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2023d22-4509-4c36-b381-4e34734e8781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:47.137207 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2023d22-4509-4c36-b381-4e34734e8781 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:47.138028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2023d22-4509-4c36-b381-4e34734e8781 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:47.138337 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2023d22-4509-4c36-b381-4e34734e8781 None admin] PATH_INFO: `/v3/users/1cfd9b92b679459b8b25ec131b63e186` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:47.139574 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2023d22-4509-4c36-b381-4e34734e8781 None admin] RBAC: Authorizing `identity:get_user(user_id=1cfd9b92b679459b8b25ec131b63e186)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:47.141027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2023d22-4509-4c36-b381-4e34734e8781 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:47.143018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 161/333] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:46 2022] GET /identity/v3/users/1cfd9b92b679459b8b25ec131b63e186 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:47.149340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8693e-7597-41fd-9bb4-a9fa6139b125 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:47.262022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8693e-7597-41fd-9bb4-a9fa6139b125 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:47.297024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045778a-b950-4afd-8f0b-0d85ec86c79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:47.297895 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045778a-b950-4afd-8f0b-0d85ec86c79d None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:47.298208 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045778a-b950-4afd-8f0b-0d85ec86c79d None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:47.298496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045778a-b950-4afd-8f0b-0d85ec86c79d None admin] PATH_INFO: `/v3/system/users/1cfd9b92b679459b8b25ec131b63e186/roles/5c131c170ffc4e1da14872da2dab3928` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:47.300020 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045778a-b950-4afd-8f0b-0d85ec86c79d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1cfd9b92b679459b8b25ec131b63e186, role_id=5c131c170ffc4e1da14872da2dab3928)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:47.301416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045778a-b950-4afd-8f0b-0d85ec86c79d None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:47.311071 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 173/334] 10.222.0.48 () {58 vars in 1334 bytes} [Tue May 17 14:17:47 2022] PUT /identity/v3/system/users/1cfd9b92b679459b8b25ec131b63e186/roles/5c131c170ffc4e1da14872da2dab3928 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:17:49.277633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be187e-b19f-481e-81b5-d5f32dbe3270 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:49.278872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be187e-b19f-481e-81b5-d5f32dbe3270 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:49.279364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be187e-b19f-481e-81b5-d5f32dbe3270 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:49.281230 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 162/335] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:49.286359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9ba78-e51d-458a-b676-74959fd1b05f None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:49.286808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9ba78-e51d-458a-b676-74959fd1b05f None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:49.286990 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9ba78-e51d-458a-b676-74959fd1b05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:49.311134 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7fe9ba78-e51d-458a-b676-74959fd1b05f None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:49.312372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7fe9ba78-e51d-458a-b676-74959fd1b05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:49.393654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 174/336] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:49.416080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f72e7-37e1-4a94-ab31-544c30820440 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:49.416720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f72e7-37e1-4a94-ab31-544c30820440 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:49.417210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f72e7-37e1-4a94-ab31-544c30820440 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:49.418870 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 163/337] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:49.426794 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda98c6a-4b9b-4a53-ae2c-87a73e9da066 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:49.427087 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda98c6a-4b9b-4a53-ae2c-87a73e9da066 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:49.427366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda98c6a-4b9b-4a53-ae2c-87a73e9da066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:49.434491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f72e7-37e1-4a94-ab31-544c30820440 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:49.451554 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-dda98c6a-4b9b-4a53-ae2c-87a73e9da066 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:49.452974 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-dda98c6a-4b9b-4a53-ae2c-87a73e9da066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:49.604050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 175/338] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:49.647783 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda98c6a-4b9b-4a53-ae2c-87a73e9da066 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:49.662206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f72e7-37e1-4a94-ab31-544c30820440 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:49.722453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6a770-8de1-489f-a189-cb02c3d9e65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:49.723344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6a770-8de1-489f-a189-cb02c3d9e65f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:49.723627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6a770-8de1-489f-a189-cb02c3d9e65f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:49.723904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6a770-8de1-489f-a189-cb02c3d9e65f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:49.743350 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6a770-8de1-489f-a189-cb02c3d9e65f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-4eb6a770-8de1-489f-a189-cb02c3d9e65f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:49.752825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:49.753961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:49.758939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:49.758939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:49.758939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:49.758939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:49.758939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:49.758939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:49.758939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:49.758939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:49.758939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:49.758939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:49.758939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:49.758939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:49.761395 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 164/339] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:17:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:49.767828 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6a770-8de1-489f-a189-cb02c3d9e65f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:49.813670 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda98c6a-4b9b-4a53-ae2c-87a73e9da066 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:49.863481 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a3efb-4668-4494-b104-e501ad3c6ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:49.864299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a3efb-4668-4494-b104-e501ad3c6ec3 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:49.864585 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a3efb-4668-4494-b104-e501ad3c6ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:49.864860 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a3efb-4668-4494-b104-e501ad3c6ec3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:49.887299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a3efb-4668-4494-b104-e501ad3c6ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:49.897618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6a770-8de1-489f-a189-cb02c3d9e65f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-0d5a3efb-4668-4494-b104-e501ad3c6ec3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:49.903853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:49.905015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:49.906000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:49.906000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:49.906000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:49.906000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:49.906000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:49.906000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:49.906000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:49.906000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:49.906000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:49.906000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:49.906000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:49.906000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:49.906000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 176/340] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:17:49.927350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a3efb-4668-4494-b104-e501ad3c6ec3 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:49.954520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4d1a6-626e-4031-a628-a225d56a0b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:49.955460 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4d1a6-626e-4031-a628-a225d56a0b6a None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:49.955898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4d1a6-626e-4031-a628-a225d56a0b6a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:49.956565 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4d1a6-626e-4031-a628-a225d56a0b6a None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:49.957484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4d1a6-626e-4031-a628-a225d56a0b6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:49.957949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4d1a6-626e-4031-a628-a225d56a0b6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:49.959701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4d1a6-626e-4031-a628-a225d56a0b6a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:49.973318 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 165/341] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:17:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:49.978915 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4d1a6-626e-4031-a628-a225d56a0b6a None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:50.045689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a3efb-4668-4494-b104-e501ad3c6ec3 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:50.092511 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4d1a6-626e-4031-a628-a225d56a0b6a None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:50.095560 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fd6ad-0f60-485c-a1c0-15a5e15a54dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:50.096167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fd6ad-0f60-485c-a1c0-15a5e15a54dd None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:50.096452 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fd6ad-0f60-485c-a1c0-15a5e15a54dd None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:50.096733 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fd6ad-0f60-485c-a1c0-15a5e15a54dd None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:50.097496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fd6ad-0f60-485c-a1c0-15a5e15a54dd None admin] RBAC: Adding query filter params (name=member) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:50.097808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fd6ad-0f60-485c-a1c0-15a5e15a54dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:50.099260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fd6ad-0f60-485c-a1c0-15a5e15a54dd None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:50.112493 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 177/342] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:50.113909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f3184-cfc6-4da2-83a4-ddb5416caaf2 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:50.118209 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f3184-cfc6-4da2-83a4-ddb5416caaf2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:50.118209 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f3184-cfc6-4da2-83a4-ddb5416caaf2 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:50.118966 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 178/343] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:50.124391 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336f9ce-4b43-4228-8520-5f4b34d8073e None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:50.124665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336f9ce-4b43-4228-8520-5f4b34d8073e None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:50.124952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336f9ce-4b43-4228-8520-5f4b34d8073e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:50.141360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b84c98-6662-4857-b139-edd0f3608e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:50.142264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b84c98-6662-4857-b139-edd0f3608e08 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:50.142712 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b84c98-6662-4857-b139-edd0f3608e08 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:50.143140 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b84c98-6662-4857-b139-edd0f3608e08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:50.155471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-0336f9ce-4b43-4228-8520-5f4b34d8073e None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:50.156409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0336f9ce-4b43-4228-8520-5f4b34d8073e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:50.220374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b84c98-6662-4857-b139-edd0f3608e08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:50.222316 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b84c98-6662-4857-b139-edd0f3608e08 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:50.286497 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 179/344] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:50.287112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336f9ce-4b43-4228-8520-5f4b34d8073e None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:50.330283 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 166/345] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 14:17:50.332543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1935-02be-4dcd-902d-eb46c0801066 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:50.333034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1935-02be-4dcd-902d-eb46c0801066 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:50.333524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1935-02be-4dcd-902d-eb46c0801066 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:50.335394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 167/346] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:50.336332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc1935-02be-4dcd-902d-eb46c0801066 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:50.401218 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336f9ce-4b43-4228-8520-5f4b34d8073e None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:50.441490 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15f6f3-58c6-4197-9d12-c81be29d7f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:50.442432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc1935-02be-4dcd-902d-eb46c0801066 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:50.442578 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15f6f3-58c6-4197-9d12-c81be29d7f70 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:50.442794 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15f6f3-58c6-4197-9d12-c81be29d7f70 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:50.443231 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15f6f3-58c6-4197-9d12-c81be29d7f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:50.479437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf15d4-b899-45e4-ac80-5033bc2653ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:50.480397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf15d4-b899-45e4-ac80-5033bc2653ef None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:50.480784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf15d4-b899-45e4-ac80-5033bc2653ef None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:50.481233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf15d4-b899-45e4-ac80-5033bc2653ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:50.492340 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf15d4-b899-45e4-ac80-5033bc2653ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-d5cf15d4-b899-45e4-ac80-5033bc2653ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:50.500835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:50.501911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:50.502759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:50.502759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:50.502759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:50.502759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:50.502759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:50.502759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:50.502759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:50.502759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:50.502759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:50.502759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:50.502759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:50.502759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:50.503393 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 168/347] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:50.504498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec85c3-bd3b-4a68-9d49-8ca137bd3b06 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:50.504943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec85c3-bd3b-4a68-9d49-8ca137bd3b06 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:50.505322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec85c3-bd3b-4a68-9d49-8ca137bd3b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:50.522500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-5eec85c3-bd3b-4a68-9d49-8ca137bd3b06 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:50.523419 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15f6f3-58c6-4197-9d12-c81be29d7f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:50.523986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5eec85c3-bd3b-4a68-9d49-8ca137bd3b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:50.525364 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15f6f3-58c6-4197-9d12-c81be29d7f70 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:50.594804 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 169/348] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:50.595807 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec85c3-bd3b-4a68-9d49-8ca137bd3b06 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:50.633382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 180/349] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:50.634810 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15f6f3-58c6-4197-9d12-c81be29d7f70 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:50.703651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec85c3-bd3b-4a68-9d49-8ca137bd3b06 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:50.739205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59044e-e977-4459-9bcf-4b060cd54e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:50.740205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59044e-e977-4459-9bcf-4b060cd54e60 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:50.740591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59044e-e977-4459-9bcf-4b060cd54e60 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:50.740940 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59044e-e977-4459-9bcf-4b060cd54e60 None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:50.741816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15f6f3-58c6-4197-9d12-c81be29d7f70 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:50.742314 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59044e-e977-4459-9bcf-4b060cd54e60 None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:50.743839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59044e-e977-4459-9bcf-4b060cd54e60 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:50.745845 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 170/350] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:50 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:50.750198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59044e-e977-4459-9bcf-4b060cd54e60 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:50.784566 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230c7fc-a2d7-4f95-abef-9ccf791b6d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:50.785576 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c7fc-a2d7-4f95-abef-9ccf791b6d68 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:50.786034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c7fc-a2d7-4f95-abef-9ccf791b6d68 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:50.786523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c7fc-a2d7-4f95-abef-9ccf791b6d68 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:50.787464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230c7fc-a2d7-4f95-abef-9ccf791b6d68 None admin] RBAC: Adding query filter params (name=member) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:50.787963 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230c7fc-a2d7-4f95-abef-9ccf791b6d68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:50.789581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230c7fc-a2d7-4f95-abef-9ccf791b6d68 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:50.800084 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 181/351] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:50.801249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230c7fc-a2d7-4f95-abef-9ccf791b6d68 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:50.854927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59044e-e977-4459-9bcf-4b060cd54e60 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:50.892805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463d138-9d61-42ac-8b1f-c2e1e82706fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:50.893603 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463d138-9d61-42ac-8b1f-c2e1e82706fd None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:50.893957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463d138-9d61-42ac-8b1f-c2e1e82706fd None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:50.894330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463d138-9d61-42ac-8b1f-c2e1e82706fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:50.907561 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463d138-9d61-42ac-8b1f-c2e1e82706fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-c463d138-9d61-42ac-8b1f-c2e1e82706fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:50.917894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:50.919637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:50.920466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:50.920466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:50.920466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:50.920466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:50.920466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:50.920466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:50.920466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:50.920466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:50.920466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:50.920466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:50.920466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 14:17:50.920466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:50.920466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 171/352] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:50.920466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463d138-9d61-42ac-8b1f-c2e1e82706fd None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:50.936798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230c7fc-a2d7-4f95-abef-9ccf791b6d68 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:50.979260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e361f9-6712-4949-b7f4-852abc0a45b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:50.980449 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e361f9-6712-4949-b7f4-852abc0a45b6 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:50.980916 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e361f9-6712-4949-b7f4-852abc0a45b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:50.982577 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e361f9-6712-4949-b7f4-852abc0a45b6 None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:50.985892 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e361f9-6712-4949-b7f4-852abc0a45b6 None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:50.987638 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e361f9-6712-4949-b7f4-852abc0a45b6 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:50.989571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 182/353] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:50 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:50.990629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e361f9-6712-4949-b7f4-852abc0a45b6 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:51.056172 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463d138-9d61-42ac-8b1f-c2e1e82706fd None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:51.096040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f938b-9e2b-4955-b5a9-70642301650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:51.096892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f938b-9e2b-4955-b5a9-70642301650e None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:51.097172 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f938b-9e2b-4955-b5a9-70642301650e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:51.097447 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f938b-9e2b-4955-b5a9-70642301650e None admin] PATH_INFO: `/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:51.105188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f938b-9e2b-4955-b5a9-70642301650e None admin] RBAC: Authorizing `identity:get_group(group_id=63ec8e83fd5f44e2ac5fee308a183ba7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:51.107058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f938b-9e2b-4955-b5a9-70642301650e None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:51.109196 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 172/354] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 14:17:50 2022] GET /identity/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:51.110990 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f938b-9e2b-4955-b5a9-70642301650e None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:51.122989 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e361f9-6712-4949-b7f4-852abc0a45b6 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:51.158497 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa50ed5-685c-48b2-965a-ddc914cf83e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:51.159153 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa50ed5-685c-48b2-965a-ddc914cf83e5 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:51.159431 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa50ed5-685c-48b2-965a-ddc914cf83e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:51.159700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa50ed5-685c-48b2-965a-ddc914cf83e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:51.244665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f938b-9e2b-4955-b5a9-70642301650e None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:51.245813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa50ed5-685c-48b2-965a-ddc914cf83e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:51.248055 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa50ed5-685c-48b2-965a-ddc914cf83e5 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:51.289398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc4a4f-fd92-4690-8202-2a2b2d6f3ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:51.290073 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc4a4f-fd92-4690-8202-2a2b2d6f3ff1 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:51.290398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc4a4f-fd92-4690-8202-2a2b2d6f3ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:51.290641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc4a4f-fd92-4690-8202-2a2b2d6f3ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:51.291392 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc4a4f-fd92-4690-8202-2a2b2d6f3ff1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:51.291697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc4a4f-fd92-4690-8202-2a2b2d6f3ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:51.293067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc4a4f-fd92-4690-8202-2a2b2d6f3ff1 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:51.301586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 173/355] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:51.302422 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc4a4f-fd92-4690-8202-2a2b2d6f3ff1 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:51.380941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 183/356] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:51.386266 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cffb77-5c10-4b10-8717-fa06f61ceac6 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:51.386266 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cffb77-5c10-4b10-8717-fa06f61ceac6 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:51.386266 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cffb77-5c10-4b10-8717-fa06f61ceac6 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:51.386266 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 184/357] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:51.386266 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cffb77-5c10-4b10-8717-fa06f61ceac6 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:51.420468 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc4a4f-fd92-4690-8202-2a2b2d6f3ff1 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:51.468526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeff8fb-7c8d-497f-975c-b97130cb82fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:51.469691 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeff8fb-7c8d-497f-975c-b97130cb82fa None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:51.469974 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeff8fb-7c8d-497f-975c-b97130cb82fa None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:51.470310 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeff8fb-7c8d-497f-975c-b97130cb82fa None admin] PATH_INFO: `/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:51.471498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeff8fb-7c8d-497f-975c-b97130cb82fa None admin] RBAC: Authorizing `identity:get_group(group_id=63ec8e83fd5f44e2ac5fee308a183ba7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:51.472943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeff8fb-7c8d-497f-975c-b97130cb82fa None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:51.474586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 174/358] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 14:17:51 2022] GET /identity/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:51.475349 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeff8fb-7c8d-497f-975c-b97130cb82fa None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:51.511594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cffb77-5c10-4b10-8717-fa06f61ceac6 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:51.558962 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd46d9e-b90a-4df0-ba00-82cb807fa958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:51.560941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd46d9e-b90a-4df0-ba00-82cb807fa958 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:51.561238 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd46d9e-b90a-4df0-ba00-82cb807fa958 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:51.561505 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd46d9e-b90a-4df0-ba00-82cb807fa958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:51.562377 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd46d9e-b90a-4df0-ba00-82cb807fa958 None admin] RBAC: Adding query filter params (group.id=63ec8e83fd5f44e2ac5fee308a183ba7, role.id=c010c38ef8f54067ad2da8aef99dbdcd, scope.project.id=903badc2e08c482fa823407b822580fc) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:51.562689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd46d9e-b90a-4df0-ba00-82cb807fa958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:51.564151 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd46d9e-b90a-4df0-ba00-82cb807fa958 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:51.571729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 185/359] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 14:17:51 2022] GET /identity/v3/role_assignments?group.id=63ec8e83fd5f44e2ac5fee308a183ba7&scope.project.id=903badc2e08c482fa823407b822580fc&role.id=c010c38ef8f54067ad2da8aef99dbdcd => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:51.572981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd5c50-4bad-424a-b37c-fb86bf6fdde7 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:51.573267 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd5c50-4bad-424a-b37c-fb86bf6fdde7 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:51.573553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd5c50-4bad-424a-b37c-fb86bf6fdde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:51.594816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-eecd5c50-4bad-424a-b37c-fb86bf6fdde7 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:51.596074 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-eecd5c50-4bad-424a-b37c-fb86bf6fdde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:51.596637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeff8fb-7c8d-497f-975c-b97130cb82fa None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:51.643854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bca923-80ce-4445-9061-fdd4476b23f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:51.644723 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bca923-80ce-4445-9061-fdd4476b23f9 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:51.645003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bca923-80ce-4445-9061-fdd4476b23f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:51.645311 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bca923-80ce-4445-9061-fdd4476b23f9 None admin] PATH_INFO: `/v3/users/1cfd9b92b679459b8b25ec131b63e186` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:51.647041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bca923-80ce-4445-9061-fdd4476b23f9 None admin] RBAC: Authorizing `identity:get_user(user_id=1cfd9b92b679459b8b25ec131b63e186)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:51.649006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bca923-80ce-4445-9061-fdd4476b23f9 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:51.650459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 175/360] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:17:51 2022] GET /identity/v3/users/1cfd9b92b679459b8b25ec131b63e186 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:51.651241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bca923-80ce-4445-9061-fdd4476b23f9 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:51.691001 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 186/361] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:51.691944 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd5c50-4bad-424a-b37c-fb86bf6fdde7 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:51.801100 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bca923-80ce-4445-9061-fdd4476b23f9 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:51.825803 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd5c50-4bad-424a-b37c-fb86bf6fdde7 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:51.846949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4c786-6e28-428d-998c-7b6aaf886510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:51.848163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4c786-6e28-428d-998c-7b6aaf886510 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:51.848677 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4c786-6e28-428d-998c-7b6aaf886510 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:51.849585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4c786-6e28-428d-998c-7b6aaf886510 None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:51.851101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4c786-6e28-428d-998c-7b6aaf886510 None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:51.852584 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4c786-6e28-428d-998c-7b6aaf886510 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:51.854361 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 176/362] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:51 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:51.855782 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871e0cb-bfa9-4107-b20d-a8e18c1f8bbb None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:51.856725 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871e0cb-bfa9-4107-b20d-a8e18c1f8bbb None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:51.857096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871e0cb-bfa9-4107-b20d-a8e18c1f8bbb None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:51.858549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 177/363] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:51.862954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871e0cb-bfa9-4107-b20d-a8e18c1f8bbb None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:51.873451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0452688-3f8c-4f6c-93e8-fa2f72cf1a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:51.874133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0452688-3f8c-4f6c-93e8-fa2f72cf1a13 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:51.874461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0452688-3f8c-4f6c-93e8-fa2f72cf1a13 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:51.874740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0452688-3f8c-4f6c-93e8-fa2f72cf1a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:51.875592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0452688-3f8c-4f6c-93e8-fa2f72cf1a13 None admin] RBAC: Adding query filter params (group.id=63ec8e83fd5f44e2ac5fee308a183ba7, role.id=c2cbdedfc238463d91a843ca8e5ac3ca, scope.project.id=903badc2e08c482fa823407b822580fc) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:51.875910 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0452688-3f8c-4f6c-93e8-fa2f72cf1a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:51.877364 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0452688-3f8c-4f6c-93e8-fa2f72cf1a13 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:51.886430 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 187/364] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 14:17:51 2022] GET /identity/v3/role_assignments?group.id=63ec8e83fd5f44e2ac5fee308a183ba7&scope.project.id=903badc2e08c482fa823407b822580fc&role.id=c2cbdedfc238463d91a843ca8e5ac3ca => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:51.887544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0452688-3f8c-4f6c-93e8-fa2f72cf1a13 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:52.016513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871e0cb-bfa9-4107-b20d-a8e18c1f8bbb None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:52.026145 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0452688-3f8c-4f6c-93e8-fa2f72cf1a13 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:52.064564 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db230a-e92e-45b3-9878-70bbeef40c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:52.065687 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db230a-e92e-45b3-9878-70bbeef40c50 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:52.066217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db230a-e92e-45b3-9878-70bbeef40c50 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:52.066850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db230a-e92e-45b3-9878-70bbeef40c50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:52.067988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db230a-e92e-45b3-9878-70bbeef40c50 None admin] RBAC: Adding query filter params (role.id=5c131c170ffc4e1da14872da2dab3928, user.id=1cfd9b92b679459b8b25ec131b63e186, scope.system=all) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:52.068095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41f593-2034-41df-ad3d-88eae01a746a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:52.068597 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db230a-e92e-45b3-9878-70bbeef40c50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:52.068990 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41f593-2034-41df-ad3d-88eae01a746a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:52.069346 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41f593-2034-41df-ad3d-88eae01a746a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:52.069696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41f593-2034-41df-ad3d-88eae01a746a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:52.071030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db230a-e92e-45b3-9878-70bbeef40c50 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:52.083027 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41f593-2034-41df-ad3d-88eae01a746a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:52.086203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 178/365] 10.222.0.48 () {56 vars in 1308 bytes} [Tue May 17 14:17:51 2022] GET /identity/v3/role_assignments?user.id=1cfd9b92b679459b8b25ec131b63e186&scope.system=all&role.id=5c131c170ffc4e1da14872da2dab3928 => generated 510 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:52.087315 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db230a-e92e-45b3-9878-70bbeef40c50 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-3e41f593-2034-41df-ad3d-88eae01a746a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:52.092057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:52.093049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:52.093836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:52.093836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:52.093836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:52.093836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:52.093836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:52.093836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:52.093836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:52.093836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:52.093836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:52.093836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:52.093836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:52.093836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:52.093836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 188/366] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:17:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:52.095002 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b23b1-a1c0-410b-a4bc-c3a9eb82ef48 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:52.095002 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b23b1-a1c0-410b-a4bc-c3a9eb82ef48 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:52.095128 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b23b1-a1c0-410b-a4bc-c3a9eb82ef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:52.118252 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-326b23b1-a1c0-410b-a4bc-c3a9eb82ef48 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:52.118252 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-326b23b1-a1c0-410b-a4bc-c3a9eb82ef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:52.257569 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 189/367] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:52.258564 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b23b1-a1c0-410b-a4bc-c3a9eb82ef48 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:52.287163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db230a-e92e-45b3-9878-70bbeef40c50 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:52.358664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd660a1-b40d-4e3a-8eb6-0fcbd169cb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:52.359542 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd660a1-b40d-4e3a-8eb6-0fcbd169cb6e None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:52.359824 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd660a1-b40d-4e3a-8eb6-0fcbd169cb6e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:52.360103 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd660a1-b40d-4e3a-8eb6-0fcbd169cb6e None admin] PATH_INFO: `/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:52.361918 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd660a1-b40d-4e3a-8eb6-0fcbd169cb6e None admin] RBAC: Authorizing `identity:get_group(group_id=63ec8e83fd5f44e2ac5fee308a183ba7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:52.363429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd660a1-b40d-4e3a-8eb6-0fcbd169cb6e None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:52.365511 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 179/368] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 14:17:52 2022] GET /identity/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:52.366529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd660a1-b40d-4e3a-8eb6-0fcbd169cb6e None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:52.415797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b23b1-a1c0-410b-a4bc-c3a9eb82ef48 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:52.457542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c523c-5834-4373-9753-720fe788b7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:52.458324 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c523c-5834-4373-9753-720fe788b7d2 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:52.458751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c523c-5834-4373-9753-720fe788b7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:52.459035 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c523c-5834-4373-9753-720fe788b7d2 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:52.459795 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c523c-5834-4373-9753-720fe788b7d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:52.460102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c523c-5834-4373-9753-720fe788b7d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:52.461511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c523c-5834-4373-9753-720fe788b7d2 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:52.471284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 190/369] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:17:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:52.472133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c523c-5834-4373-9753-720fe788b7d2 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:52.476193 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd660a1-b40d-4e3a-8eb6-0fcbd169cb6e None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:52.511747 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6174917-600b-4363-9846-4748a177a550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:52.513157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6174917-600b-4363-9846-4748a177a550 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:52.513439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6174917-600b-4363-9846-4748a177a550 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:52.513718 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6174917-600b-4363-9846-4748a177a550 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:52.525140 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6174917-600b-4363-9846-4748a177a550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-e6174917-600b-4363-9846-4748a177a550 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:52.533169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:52.535355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:52.537284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:52.537284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:52.537284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:52.537284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:52.537284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:52.537284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:52.537284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:52.537284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:52.537284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:52.537284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:52.537284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:52.537284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:52.538774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 180/370] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:17:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:52.538774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6174917-600b-4363-9846-4748a177a550 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:52.578844 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c523c-5834-4373-9753-720fe788b7d2 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:52.615936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ff3fa-7647-42b7-a1d4-9074ce1dff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:52.616608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ff3fa-7647-42b7-a1d4-9074ce1dff68 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:52.616898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ff3fa-7647-42b7-a1d4-9074ce1dff68 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:52.617178 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ff3fa-7647-42b7-a1d4-9074ce1dff68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:52.618019 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ff3fa-7647-42b7-a1d4-9074ce1dff68 None admin] RBAC: Adding query filter params (group.id=63ec8e83fd5f44e2ac5fee308a183ba7, role.id=c2cbdedfc238463d91a843ca8e5ac3ca, scope.project.id=ca31edde9c134f528cd3f229ac72e713) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:52.618375 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ff3fa-7647-42b7-a1d4-9074ce1dff68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:52.619828 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ff3fa-7647-42b7-a1d4-9074ce1dff68 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:52.626442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 191/371] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 14:17:52 2022] GET /identity/v3/role_assignments?group.id=63ec8e83fd5f44e2ac5fee308a183ba7&scope.project.id=ca31edde9c134f528cd3f229ac72e713&role.id=c2cbdedfc238463d91a843ca8e5ac3ca => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:52.627093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ff3fa-7647-42b7-a1d4-9074ce1dff68 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:52.647306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6174917-600b-4363-9846-4748a177a550 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:52.685516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4636ce-177f-4e2a-8ec5-ed5383e2f569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:52.686385 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4636ce-177f-4e2a-8ec5-ed5383e2f569 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:52.686682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4636ce-177f-4e2a-8ec5-ed5383e2f569 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:52.687007 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4636ce-177f-4e2a-8ec5-ed5383e2f569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:52.737440 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ff3fa-7647-42b7-a1d4-9074ce1dff68 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:52.760217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4636ce-177f-4e2a-8ec5-ed5383e2f569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:52.761693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4636ce-177f-4e2a-8ec5-ed5383e2f569 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:52.774285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e5202-8a89-4038-8aec-1992f98cdd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:52.774981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e5202-8a89-4038-8aec-1992f98cdd4d None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:52.775268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e5202-8a89-4038-8aec-1992f98cdd4d None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:52.775549 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e5202-8a89-4038-8aec-1992f98cdd4d None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:52.776357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e5202-8a89-4038-8aec-1992f98cdd4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:52.776656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e5202-8a89-4038-8aec-1992f98cdd4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:52.778799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e5202-8a89-4038-8aec-1992f98cdd4d None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:52.787930 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 192/372] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:52.793278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e5202-8a89-4038-8aec-1992f98cdd4d None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:52.868066 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 181/373] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:52.874976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4636ce-177f-4e2a-8ec5-ed5383e2f569 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:52.904595 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e5202-8a89-4038-8aec-1992f98cdd4d None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:52.943313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecc387-e226-4a54-ae81-d80aa5f8a002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:52.943978 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecc387-e226-4a54-ae81-d80aa5f8a002 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:52.944261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecc387-e226-4a54-ae81-d80aa5f8a002 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:52.944544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecc387-e226-4a54-ae81-d80aa5f8a002 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:52.981672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4636ce-177f-4e2a-8ec5-ed5383e2f569 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:53.020193 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caaadd-d8d2-4b94-9315-7f2460b1b076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:53.021060 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caaadd-d8d2-4b94-9315-7f2460b1b076 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:53.021345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caaadd-d8d2-4b94-9315-7f2460b1b076 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:53.021622 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caaadd-d8d2-4b94-9315-7f2460b1b076 None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:53.022268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecc387-e226-4a54-ae81-d80aa5f8a002 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:53.022859 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60caaadd-d8d2-4b94-9315-7f2460b1b076 None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:53.023820 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecc387-e226-4a54-ae81-d80aa5f8a002 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:53.024336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60caaadd-d8d2-4b94-9315-7f2460b1b076 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:53.030356 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 182/374] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:52 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:53.032295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caaadd-d8d2-4b94-9315-7f2460b1b076 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:53.128809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 193/375] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 14:17:53.134254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecc387-e226-4a54-ae81-d80aa5f8a002 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:53.137747 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caaadd-d8d2-4b94-9315-7f2460b1b076 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:53.173068 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5712ceb-9cb0-4e35-9e08-edbe18665800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:53.173926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5712ceb-9cb0-4e35-9e08-edbe18665800 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:53.174228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5712ceb-9cb0-4e35-9e08-edbe18665800 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:53.174507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5712ceb-9cb0-4e35-9e08-edbe18665800 None admin] PATH_INFO: `/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:53.175724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5712ceb-9cb0-4e35-9e08-edbe18665800 None admin] RBAC: Authorizing `identity:get_group(group_id=63ec8e83fd5f44e2ac5fee308a183ba7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:53.177178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5712ceb-9cb0-4e35-9e08-edbe18665800 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:53.182107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 183/376] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 14:17:53 2022] GET /identity/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:53.186799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5712ceb-9cb0-4e35-9e08-edbe18665800 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:53.244668 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecc387-e226-4a54-ae81-d80aa5f8a002 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:53.297608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37ab4c-f806-4cea-a294-3dd86a8bfdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:53.298554 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37ab4c-f806-4cea-a294-3dd86a8bfdc8 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:53.298842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37ab4c-f806-4cea-a294-3dd86a8bfdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:53.299120 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37ab4c-f806-4cea-a294-3dd86a8bfdc8 None admin] PATH_INFO: `/v3/projects/c7c1abe20ef64ed9a7be8720622420f6` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:53.300916 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37ab4c-f806-4cea-a294-3dd86a8bfdc8 None admin] RBAC: Authorizing `identity:get_project(project_id=c7c1abe20ef64ed9a7be8720622420f6)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:53.302409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37ab4c-f806-4cea-a294-3dd86a8bfdc8 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:53.304114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 194/377] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:53 2022] GET /identity/v3/projects/c7c1abe20ef64ed9a7be8720622420f6 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:53.309966 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37ab4c-f806-4cea-a294-3dd86a8bfdc8 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:53.310554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5712ceb-9cb0-4e35-9e08-edbe18665800 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:53.353861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ba5af-8941-43b4-b258-d2ad97351cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:53.354951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ba5af-8941-43b4-b258-d2ad97351cef None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:53.355434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ba5af-8941-43b4-b258-d2ad97351cef None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:53.356399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ba5af-8941-43b4-b258-d2ad97351cef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:53.357448 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ba5af-8941-43b4-b258-d2ad97351cef None admin] RBAC: Adding query filter params (group.id=63ec8e83fd5f44e2ac5fee308a183ba7, role.id=c010c38ef8f54067ad2da8aef99dbdcd, scope.project.id=ca31edde9c134f528cd3f229ac72e713) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:53.358361 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ba5af-8941-43b4-b258-d2ad97351cef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:53.360753 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ba5af-8941-43b4-b258-d2ad97351cef None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:53.374803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 184/378] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 14:17:53 2022] GET /identity/v3/role_assignments?group.id=63ec8e83fd5f44e2ac5fee308a183ba7&scope.project.id=ca31edde9c134f528cd3f229ac72e713&role.id=c010c38ef8f54067ad2da8aef99dbdcd => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:53.447427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37ab4c-f806-4cea-a294-3dd86a8bfdc8 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:53.489224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f51e16-0c37-4517-b2ab-c8896421f8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:53.494728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f51e16-0c37-4517-b2ab-c8896421f8d0 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:53.495334 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f51e16-0c37-4517-b2ab-c8896421f8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:53.495812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f51e16-0c37-4517-b2ab-c8896421f8d0 None admin] PATH_INFO: `/v3/groups/280307ee5f584659928e49c0278080c2` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:53.503608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f51e16-0c37-4517-b2ab-c8896421f8d0 None admin] RBAC: Authorizing `identity:get_group(group_id=280307ee5f584659928e49c0278080c2)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:53.505427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f51e16-0c37-4517-b2ab-c8896421f8d0 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:53.507905 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 195/379] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 14:17:53 2022] GET /identity/v3/groups/280307ee5f584659928e49c0278080c2 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:53.513647 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ba5af-8941-43b4-b258-d2ad97351cef None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:53.664932 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ba5af-8941-43b4-b258-d2ad97351cef None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:53.706329 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bb04a-7918-4032-9f5e-654a2cabd8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:53.706910 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bb04a-7918-4032-9f5e-654a2cabd8aa None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:53.707192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bb04a-7918-4032-9f5e-654a2cabd8aa None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:53.707466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bb04a-7918-4032-9f5e-654a2cabd8aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:53.708304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bb04a-7918-4032-9f5e-654a2cabd8aa None admin] RBAC: Adding query filter params (group.id=280307ee5f584659928e49c0278080c2, role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=c7c1abe20ef64ed9a7be8720622420f6) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:53.708616 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bb04a-7918-4032-9f5e-654a2cabd8aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:53.710058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bb04a-7918-4032-9f5e-654a2cabd8aa None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:53.719069 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 185/380] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 14:17:53 2022] GET /identity/v3/role_assignments?group.id=280307ee5f584659928e49c0278080c2&scope.project.id=c7c1abe20ef64ed9a7be8720622420f6&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:54.341449 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571ca09-5add-4ff5-99bf-1da56621c200 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:54.341837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571ca09-5add-4ff5-99bf-1da56621c200 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:54.342022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571ca09-5add-4ff5-99bf-1da56621c200 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:54.343531 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 196/381] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:54.348929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e386b3f-aca8-414e-b9e6-58feb4f2b1d1 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:54.349224 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e386b3f-aca8-414e-b9e6-58feb4f2b1d1 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:54.349508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e386b3f-aca8-414e-b9e6-58feb4f2b1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:54.371063 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-2e386b3f-aca8-414e-b9e6-58feb4f2b1d1 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:54.373037 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2e386b3f-aca8-414e-b9e6-58feb4f2b1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:54.461733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 186/382] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:54.486617 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571ca09-5add-4ff5-99bf-1da56621c200 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:54.613618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571ca09-5add-4ff5-99bf-1da56621c200 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:54.621579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cce1c-4972-4bc8-a6b0-f170b667e48b None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:54.621579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cce1c-4972-4bc8-a6b0-f170b667e48b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:54.621579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cce1c-4972-4bc8-a6b0-f170b667e48b None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:54.622816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 187/383] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:17:54.626840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a7310-1304-4696-b93f-f27f54cb2af4 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:54.627327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a7310-1304-4696-b93f-f27f54cb2af4 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:54.627790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a7310-1304-4696-b93f-f27f54cb2af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:54.654071 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c4836-330a-41c6-8675-a66b64378515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:54.654925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c4836-330a-41c6-8675-a66b64378515 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:54.655207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c4836-330a-41c6-8675-a66b64378515 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:54.655481 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c4836-330a-41c6-8675-a66b64378515 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:54.662724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-903a7310-1304-4696-b93f-f27f54cb2af4 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:54.664246 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-903a7310-1304-4696-b93f-f27f54cb2af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:54.670215 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c4836-330a-41c6-8675-a66b64378515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-f77c4836-330a-41c6-8675-a66b64378515 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:54.677570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:54.678534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:54.679315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:54.679315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:54.679315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:54.679315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:54.679315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:54.679315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:54.679315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:54.679315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:54.679315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:54.679315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:54.679315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:54.679315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:54.679315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 197/384] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:17:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:54.685104 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c4836-330a-41c6-8675-a66b64378515 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:54.766011 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 188/385] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:54.796374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a7310-1304-4696-b93f-f27f54cb2af4 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:54.800194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c4836-330a-41c6-8675-a66b64378515 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:54.846895 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c63d32-bb23-47e2-a318-f12a531a05c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:54.848781 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c63d32-bb23-47e2-a318-f12a531a05c9 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:54.849067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c63d32-bb23-47e2-a318-f12a531a05c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:54.850071 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c63d32-bb23-47e2-a318-f12a531a05c9 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:54.850876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c63d32-bb23-47e2-a318-f12a531a05c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:54.851188 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c63d32-bb23-47e2-a318-f12a531a05c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:54.852808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c63d32-bb23-47e2-a318-f12a531a05c9 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:54.873113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 198/386] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:17:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:54.878561 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c63d32-bb23-47e2-a318-f12a531a05c9 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:54.964265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a7310-1304-4696-b93f-f27f54cb2af4 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:55.013237 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801906a-7b1f-480b-a831-518d8abe3e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:55.014048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801906a-7b1f-480b-a831-518d8abe3e9b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:55.014373 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801906a-7b1f-480b-a831-518d8abe3e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:55.014659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801906a-7b1f-480b-a831-518d8abe3e9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:55.037286 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801906a-7b1f-480b-a831-518d8abe3e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-c801906a-7b1f-480b-a831-518d8abe3e9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:55.055146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:55.056048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:55.056954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:55.056954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:55.056954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:55.056954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:55.056954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:55.056954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:55.056954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:55.056954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:55.056954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:55.056954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:55.056954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:55.056954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:55.056954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 189/387] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:17:55.063612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801906a-7b1f-480b-a831-518d8abe3e9b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:55.080903 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c63d32-bb23-47e2-a318-f12a531a05c9 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:55.170896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcc7ce-089a-4f73-a265-1782307a9d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:55.171760 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcc7ce-089a-4f73-a265-1782307a9d41 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:55.172037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcc7ce-089a-4f73-a265-1782307a9d41 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:55.172309 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcc7ce-089a-4f73-a265-1782307a9d41 None admin] PATH_INFO: `/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:55.173521 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcc7ce-089a-4f73-a265-1782307a9d41 None admin] RBAC: Authorizing `identity:get_group(group_id=63ec8e83fd5f44e2ac5fee308a183ba7)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:55.174998 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcc7ce-089a-4f73-a265-1782307a9d41 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:55.176907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 199/388] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 14:17:54 2022] GET /identity/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7 => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:55.182089 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcc7ce-089a-4f73-a265-1782307a9d41 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:55.208185 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801906a-7b1f-480b-a831-518d8abe3e9b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:55.254717 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24447e35-045e-49c7-9559-c68e25f6d746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:55.255392 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24447e35-045e-49c7-9559-c68e25f6d746 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:55.255665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24447e35-045e-49c7-9559-c68e25f6d746 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:55.255938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24447e35-045e-49c7-9559-c68e25f6d746 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:55.256688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24447e35-045e-49c7-9559-c68e25f6d746 None admin] RBAC: Adding query filter params (name=member) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:55.256986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24447e35-045e-49c7-9559-c68e25f6d746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:55.258409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24447e35-045e-49c7-9559-c68e25f6d746 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:55.276590 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 190/389] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:55.283219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24447e35-045e-49c7-9559-c68e25f6d746 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:55.389860 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcc7ce-089a-4f73-a265-1782307a9d41 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:55.393872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24447e35-045e-49c7-9559-c68e25f6d746 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:55.424167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69999fd8-243a-40aa-a3f2-ff1558d489d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:55.425026 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69999fd8-243a-40aa-a3f2-ff1558d489d7 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:55.425301 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69999fd8-243a-40aa-a3f2-ff1558d489d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:55.425570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69999fd8-243a-40aa-a3f2-ff1558d489d7 None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:55.426792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69999fd8-243a-40aa-a3f2-ff1558d489d7 None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:55.428238 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69999fd8-243a-40aa-a3f2-ff1558d489d7 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:55.428947 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c503af0-d267-4235-8b1f-2860cac4051b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:55.429810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c503af0-d267-4235-8b1f-2860cac4051b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:55.430149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c503af0-d267-4235-8b1f-2860cac4051b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:55.430355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 200/390] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:55 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:55.430522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c503af0-d267-4235-8b1f-2860cac4051b None admin] PATH_INFO: `/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:55.431767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c503af0-d267-4235-8b1f-2860cac4051b None admin] RBAC: Authorizing `identity:get_group(group_id=63ec8e83fd5f44e2ac5fee308a183ba7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:55.433215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c503af0-d267-4235-8b1f-2860cac4051b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:55.435728 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 191/391] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 14:17:55 2022] GET /identity/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:55.435898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69999fd8-243a-40aa-a3f2-ff1558d489d7 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:55.440702 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c503af0-d267-4235-8b1f-2860cac4051b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:55.544441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c503af0-d267-4235-8b1f-2860cac4051b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:55.544791 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69999fd8-243a-40aa-a3f2-ff1558d489d7 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:55.579220 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279056d-234e-484c-8a95-b6c839da52f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:55.580115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279056d-234e-484c-8a95-b6c839da52f4 None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:55.580408 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279056d-234e-484c-8a95-b6c839da52f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:55.580644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279056d-234e-484c-8a95-b6c839da52f4 None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc/groups/63ec8e83fd5f44e2ac5fee308a183ba7/roles/c010c38ef8f54067ad2da8aef99dbdcd` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:55.581819 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbab4a-6dd3-42d5-bd4c-48e7df4a9c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:55.583054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbab4a-6dd3-42d5-bd4c-48e7df4a9c6f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:55.583345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279056d-234e-484c-8a95-b6c839da52f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=903badc2e08c482fa823407b822580fc, group_id=63ec8e83fd5f44e2ac5fee308a183ba7, role_id=c010c38ef8f54067ad2da8aef99dbdcd)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:55.583724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbab4a-6dd3-42d5-bd4c-48e7df4a9c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:55.584174 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbab4a-6dd3-42d5-bd4c-48e7df4a9c6f None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:55.585004 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279056d-234e-484c-8a95-b6c839da52f4 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:55.585744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbab4a-6dd3-42d5-bd4c-48e7df4a9c6f None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:55.587459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbab4a-6dd3-42d5-bd4c-48e7df4a9c6f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:55.589898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 192/392] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:55 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:55.596053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbab4a-6dd3-42d5-bd4c-48e7df4a9c6f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:55.601174 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 201/393] 10.222.0.48 () {58 vars in 1442 bytes} [Tue May 17 14:17:55 2022] PUT /identity/v3/projects/903badc2e08c482fa823407b822580fc/groups/63ec8e83fd5f44e2ac5fee308a183ba7/roles/c010c38ef8f54067ad2da8aef99dbdcd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:17:55.711697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbab4a-6dd3-42d5-bd4c-48e7df4a9c6f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:55.751435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3aaeb-f909-493f-9790-e1e80faf43ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:55.752802 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3aaeb-f909-493f-9790-e1e80faf43ac None admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:55.753357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3aaeb-f909-493f-9790-e1e80faf43ac None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:55.753834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3aaeb-f909-493f-9790-e1e80faf43ac None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc/groups/63ec8e83fd5f44e2ac5fee308a183ba7/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:55.756191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3aaeb-f909-493f-9790-e1e80faf43ac None admin] RBAC: Authorizing `identity:create_grant(project_id=903badc2e08c482fa823407b822580fc, group_id=63ec8e83fd5f44e2ac5fee308a183ba7, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:55.758103 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3aaeb-f909-493f-9790-e1e80faf43ac None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:55.788732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 193/394] 10.222.0.48 () {58 vars in 1442 bytes} [Tue May 17 14:17:55 2022] PUT /identity/v3/projects/903badc2e08c482fa823407b822580fc/groups/63ec8e83fd5f44e2ac5fee308a183ba7/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:17:56.172891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b2c09-6b92-4b8b-a24b-b0d1118cd47a None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:56.173263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b2c09-6b92-4b8b-a24b-b0d1118cd47a None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:56.173456 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b2c09-6b92-4b8b-a24b-b0d1118cd47a None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:56.175155 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 202/395] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:56.180183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05fe0d-9b3b-4a8a-8813-5a4d57efafe7 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:56.180469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05fe0d-9b3b-4a8a-8813-5a4d57efafe7 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:56.180746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05fe0d-9b3b-4a8a-8813-5a4d57efafe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:56.210779 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-3f05fe0d-9b3b-4a8a-8813-5a4d57efafe7 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:56.212016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-3f05fe0d-9b3b-4a8a-8813-5a4d57efafe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:56.297632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 194/396] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:56.332765 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b2c09-6b92-4b8b-a24b-b0d1118cd47a None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:56.470307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b2c09-6b92-4b8b-a24b-b0d1118cd47a None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:56.506988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0792519-c1d4-4926-aed9-62b9a84e8ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:56.507811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0792519-c1d4-4926-aed9-62b9a84e8ffe None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:56.508093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0792519-c1d4-4926-aed9-62b9a84e8ffe None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:56.508357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0792519-c1d4-4926-aed9-62b9a84e8ffe None admin] PATH_INFO: `/v3/roles/member` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:56.527315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0792519-c1d4-4926-aed9-62b9a84e8ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-d0792519-c1d4-4926-aed9-62b9a84e8ffe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:56.536192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:56.537171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:56.538435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:56.538435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:56.538435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:56.538435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:56.538435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:56.538435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:56.538435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:56.538435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:56.538435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:56.538435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:56.538435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:56.538435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:56.538435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 203/397] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:56.543718 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05fe0d-9b3b-4a8a-8813-5a4d57efafe7 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:56.666799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324049c0-360c-4c36-a421-e2bb3d660ce8 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:56.667327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324049c0-360c-4c36-a421-e2bb3d660ce8 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:56.667327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324049c0-360c-4c36-a421-e2bb3d660ce8 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:56.669436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 204/398] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:56.677268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f212f41-460d-4ec5-95f8-676f1fedda7d None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:56.677268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f212f41-460d-4ec5-95f8-676f1fedda7d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:56.677268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f212f41-460d-4ec5-95f8-676f1fedda7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:56.694451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05fe0d-9b3b-4a8a-8813-5a4d57efafe7 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:56.708652 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-0f212f41-460d-4ec5-95f8-676f1fedda7d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:56.710162 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0f212f41-460d-4ec5-95f8-676f1fedda7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:56.743501 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20df7e-89ca-46a6-887b-f45b3d64c894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:56.744145 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20df7e-89ca-46a6-887b-f45b3d64c894 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:56.744371 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20df7e-89ca-46a6-887b-f45b3d64c894 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:56.744640 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20df7e-89ca-46a6-887b-f45b3d64c894 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:56.745398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20df7e-89ca-46a6-887b-f45b3d64c894 None admin] RBAC: Adding query filter params (name=member) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:56.745752 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20df7e-89ca-46a6-887b-f45b3d64c894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:56.749579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20df7e-89ca-46a6-887b-f45b3d64c894 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:56.766792 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 195/399] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:56.772507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20df7e-89ca-46a6-887b-f45b3d64c894 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:56.829389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 205/400] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:56.830773 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40723767-99e6-4195-b784-af76db9907f1 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:56.831313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40723767-99e6-4195-b784-af76db9907f1 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:56.831585 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40723767-99e6-4195-b784-af76db9907f1 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:56.833042 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 206/401] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:56.847604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589546c-8654-4735-b986-5b8b1be704a3 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:56.847891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589546c-8654-4735-b986-5b8b1be704a3 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:56.848148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589546c-8654-4735-b986-5b8b1be704a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:56.869511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7589546c-8654-4735-b986-5b8b1be704a3 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:56.871331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7589546c-8654-4735-b986-5b8b1be704a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:56.894795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20df7e-89ca-46a6-887b-f45b3d64c894 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:56.936618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863facc-3046-44c5-bb3a-1c46ed6526bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:56.937472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863facc-3046-44c5-bb3a-1c46ed6526bc None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:56.937751 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863facc-3046-44c5-bb3a-1c46ed6526bc None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:56.938029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863facc-3046-44c5-bb3a-1c46ed6526bc None admin] PATH_INFO: `/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:56.939717 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863facc-3046-44c5-bb3a-1c46ed6526bc None admin] RBAC: Authorizing `identity:get_group(group_id=63ec8e83fd5f44e2ac5fee308a183ba7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:56.941644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863facc-3046-44c5-bb3a-1c46ed6526bc None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:56.944126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 196/402] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 14:17:56 2022] GET /identity/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:56.945183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863facc-3046-44c5-bb3a-1c46ed6526bc None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:56.954414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 207/403] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 17 14:17:56.955375 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589546c-8654-4735-b986-5b8b1be704a3 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:57.077365 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863facc-3046-44c5-bb3a-1c46ed6526bc None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:57.077537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589546c-8654-4735-b986-5b8b1be704a3 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:57.112627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539be30f-67cc-4537-b310-bbc5a4d729b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:57.113413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539be30f-67cc-4537-b310-bbc5a4d729b8 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:57.113691 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539be30f-67cc-4537-b310-bbc5a4d729b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:57.113962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539be30f-67cc-4537-b310-bbc5a4d729b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:57.119792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f563e5-887e-4af7-99fd-3edf0e2bcddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:57.120654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f563e5-887e-4af7-99fd-3edf0e2bcddc None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:57.121083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f563e5-887e-4af7-99fd-3edf0e2bcddc None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:57.121366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f563e5-887e-4af7-99fd-3edf0e2bcddc None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:57.123500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f563e5-887e-4af7-99fd-3edf0e2bcddc None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:57.125196 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539be30f-67cc-4537-b310-bbc5a4d729b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:57.125431 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f563e5-887e-4af7-99fd-3edf0e2bcddc None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:57.127153 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 208/404] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:56 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:57.128025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f563e5-887e-4af7-99fd-3edf0e2bcddc None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-539be30f-67cc-4537-b310-bbc5a4d729b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:57.133698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:57.135938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:57.137963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:57.137963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:57.137963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:57.137963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:57.137963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:57.137963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:57.137963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:57.137963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:57.137963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:57.137963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:57.137963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:17:57.137963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:57.137963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 197/405] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:17:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:57.137963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539be30f-67cc-4537-b310-bbc5a4d729b8 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:57.260914 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539be30f-67cc-4537-b310-bbc5a4d729b8 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:57.262899 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f563e5-887e-4af7-99fd-3edf0e2bcddc None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:57.296427 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccba540-8c57-42a2-8997-7708664d7de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:57.297443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bf966-c5d6-4f2d-90f4-44e5d0231a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:57.297939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccba540-8c57-42a2-8997-7708664d7de9 None admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:57.298275 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bf966-c5d6-4f2d-90f4-44e5d0231a51 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:57.298558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bf966-c5d6-4f2d-90f4-44e5d0231a51 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:57.298830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bf966-c5d6-4f2d-90f4-44e5d0231a51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:57.299083 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccba540-8c57-42a2-8997-7708664d7de9 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:57.299686 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccba540-8c57-42a2-8997-7708664d7de9 None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713/groups/63ec8e83fd5f44e2ac5fee308a183ba7/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:57.301829 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccba540-8c57-42a2-8997-7708664d7de9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca31edde9c134f528cd3f229ac72e713, group_id=63ec8e83fd5f44e2ac5fee308a183ba7, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:57.303509 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccba540-8c57-42a2-8997-7708664d7de9 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:57.310732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bf966-c5d6-4f2d-90f4-44e5d0231a51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-f38bf966-c5d6-4f2d-90f4-44e5d0231a51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:57.318300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:57.319735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:57.320546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:57.320546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:57.320546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:57.320546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:57.320546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:57.320546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:57.320546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:57.320546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:57.320546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:57.320546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:57.320546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:57.320546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:57.320546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 209/406] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:17:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:57.320546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bf966-c5d6-4f2d-90f4-44e5d0231a51 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:57.323151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 198/407] 10.222.0.48 () {58 vars in 1442 bytes} [Tue May 17 14:17:57 2022] PUT /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713/groups/63ec8e83fd5f44e2ac5fee308a183ba7/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:17:57.326654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccba540-8c57-42a2-8997-7708664d7de9 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:57.437911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccba540-8c57-42a2-8997-7708664d7de9 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:57.442118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bf966-c5d6-4f2d-90f4-44e5d0231a51 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:57.475240 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7a1e3-25ac-406a-8c1f-896897816f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:57.476520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7a1e3-25ac-406a-8c1f-896897816f2c None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:57.477165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7a1e3-25ac-406a-8c1f-896897816f2c None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:57.477697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7a1e3-25ac-406a-8c1f-896897816f2c None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:57.478537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7dbcc-3b92-4b7d-a52f-edb0846feffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:57.478991 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7a1e3-25ac-406a-8c1f-896897816f2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:57.479477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7dbcc-3b92-4b7d-a52f-edb0846feffb None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:57.479596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7a1e3-25ac-406a-8c1f-896897816f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:57.479815 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7dbcc-3b92-4b7d-a52f-edb0846feffb None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:57.480159 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7dbcc-3b92-4b7d-a52f-edb0846feffb None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:57.481527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7dbcc-3b92-4b7d-a52f-edb0846feffb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:57.481902 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7dbcc-3b92-4b7d-a52f-edb0846feffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:57.482683 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7a1e3-25ac-406a-8c1f-896897816f2c None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:57.483470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7dbcc-3b92-4b7d-a52f-edb0846feffb None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:57.492198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 199/408] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:17:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:57.498385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 210/409] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:57.499666 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7a1e3-25ac-406a-8c1f-896897816f2c None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:57.500781 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7dbcc-3b92-4b7d-a52f-edb0846feffb None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:57.636170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7a1e3-25ac-406a-8c1f-896897816f2c None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:57.656789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7dbcc-3b92-4b7d-a52f-edb0846feffb None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:57.675183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcfbf0-7197-4226-87f4-f481412e5974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:57.676205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcfbf0-7197-4226-87f4-f481412e5974 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:57.676777 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcfbf0-7197-4226-87f4-f481412e5974 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:57.677060 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcfbf0-7197-4226-87f4-f481412e5974 None admin] PATH_INFO: `/v3/groups/280307ee5f584659928e49c0278080c2` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:57.678293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcfbf0-7197-4226-87f4-f481412e5974 None admin] RBAC: Authorizing `identity:get_group(group_id=280307ee5f584659928e49c0278080c2)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:57.680225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcfbf0-7197-4226-87f4-f481412e5974 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:57.682664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 200/410] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 14:17:57 2022] GET /identity/v3/groups/280307ee5f584659928e49c0278080c2 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:57.688089 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcfbf0-7197-4226-87f4-f481412e5974 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:57.697416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c2ca4-07f0-4e9a-a5cb-e995f24cc002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:57.698428 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c2ca4-07f0-4e9a-a5cb-e995f24cc002 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:57.698710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c2ca4-07f0-4e9a-a5cb-e995f24cc002 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:57.698984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c2ca4-07f0-4e9a-a5cb-e995f24cc002 None admin] PATH_INFO: `/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:57.700714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c2ca4-07f0-4e9a-a5cb-e995f24cc002 None admin] RBAC: Authorizing `identity:get_group(group_id=63ec8e83fd5f44e2ac5fee308a183ba7)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:57.702288 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c2ca4-07f0-4e9a-a5cb-e995f24cc002 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:57.703928 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 211/411] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 14:17:57 2022] GET /identity/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:57.710392 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c2ca4-07f0-4e9a-a5cb-e995f24cc002 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:57.795489 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcfbf0-7197-4226-87f4-f481412e5974 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:57.835254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937edeb-a828-4c88-8800-b15509873b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:57.835651 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c2ca4-07f0-4e9a-a5cb-e995f24cc002 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:57.836120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937edeb-a828-4c88-8800-b15509873b99 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:57.836400 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937edeb-a828-4c88-8800-b15509873b99 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:57.836674 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937edeb-a828-4c88-8800-b15509873b99 None admin] PATH_INFO: `/v3/projects/c7c1abe20ef64ed9a7be8720622420f6` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:57.838668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937edeb-a828-4c88-8800-b15509873b99 None admin] RBAC: Authorizing `identity:get_project(project_id=c7c1abe20ef64ed9a7be8720622420f6)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:57.840716 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937edeb-a828-4c88-8800-b15509873b99 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:57.843052 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 201/412] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:57 2022] GET /identity/v3/projects/c7c1abe20ef64ed9a7be8720622420f6 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:57.848497 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937edeb-a828-4c88-8800-b15509873b99 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:57.881535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e86f10-b7a4-4d23-b250-299fd091a60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:57.883774 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e86f10-b7a4-4d23-b250-299fd091a60a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:57.884062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e86f10-b7a4-4d23-b250-299fd091a60a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:57.884336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e86f10-b7a4-4d23-b250-299fd091a60a None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:57.887171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e86f10-b7a4-4d23-b250-299fd091a60a None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:57.888635 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e86f10-b7a4-4d23-b250-299fd091a60a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:57.892566 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 212/413] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:57 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:57.897125 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e86f10-b7a4-4d23-b250-299fd091a60a None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:58.038739 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e86f10-b7a4-4d23-b250-299fd091a60a None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:58.055297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937edeb-a828-4c88-8800-b15509873b99 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:58.080005 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66868a73-1b3b-4ec2-beee-e1f708435b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:58.080903 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66868a73-1b3b-4ec2-beee-e1f708435b86 None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:58.081445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66868a73-1b3b-4ec2-beee-e1f708435b86 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:58.081725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66868a73-1b3b-4ec2-beee-e1f708435b86 None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713/groups/63ec8e83fd5f44e2ac5fee308a183ba7/roles/c010c38ef8f54067ad2da8aef99dbdcd` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:58.091106 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66868a73-1b3b-4ec2-beee-e1f708435b86 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca31edde9c134f528cd3f229ac72e713, group_id=63ec8e83fd5f44e2ac5fee308a183ba7, role_id=c010c38ef8f54067ad2da8aef99dbdcd)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:58.092694 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66868a73-1b3b-4ec2-beee-e1f708435b86 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:58.115536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 213/414] 10.222.0.48 () {58 vars in 1442 bytes} [Tue May 17 14:17:57 2022] PUT /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713/groups/63ec8e83fd5f44e2ac5fee308a183ba7/roles/c010c38ef8f54067ad2da8aef99dbdcd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:17:58.116455 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac7f3b-0da9-40af-8449-4e0fff606dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:58.117494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac7f3b-0da9-40af-8449-4e0fff606dbb None admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:58.117840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac7f3b-0da9-40af-8449-4e0fff606dbb None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:58.118197 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac7f3b-0da9-40af-8449-4e0fff606dbb None admin] PATH_INFO: `/v3/projects/c7c1abe20ef64ed9a7be8720622420f6/groups/280307ee5f584659928e49c0278080c2/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:58.120407 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac7f3b-0da9-40af-8449-4e0fff606dbb None admin] RBAC: Authorizing `identity:create_grant(project_id=c7c1abe20ef64ed9a7be8720622420f6, group_id=280307ee5f584659928e49c0278080c2, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:58.122837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac7f3b-0da9-40af-8449-4e0fff606dbb None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:58.139412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 202/415] 10.222.0.48 () {58 vars in 1442 bytes} [Tue May 17 14:17:57 2022] PUT /identity/v3/projects/c7c1abe20ef64ed9a7be8720622420f6/groups/280307ee5f584659928e49c0278080c2/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:17:58.481766 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9d3d4-1822-43ed-84e4-ce2e89764b12 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:58.482139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9d3d4-1822-43ed-84e4-ce2e89764b12 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:58.482364 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9d3d4-1822-43ed-84e4-ce2e89764b12 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:58.484136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 214/416] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:58.489835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b134d8-56df-489e-b1a0-5f7a47269141 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:58.490133 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b134d8-56df-489e-b1a0-5f7a47269141 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:58.490453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b134d8-56df-489e-b1a0-5f7a47269141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:58.507726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c3b134d8-56df-489e-b1a0-5f7a47269141 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:58.508905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c3b134d8-56df-489e-b1a0-5f7a47269141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:58.584148 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 203/417] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:17:58.605603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9d3d4-1822-43ed-84e4-ce2e89764b12 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:58.621278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a1049-2d1e-4cee-a801-3bfa0a57e744 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:58.622212 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a1049-2d1e-4cee-a801-3bfa0a57e744 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:58.622663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a1049-2d1e-4cee-a801-3bfa0a57e744 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:58.626411 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 204/418] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:17:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:17:58.631605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f69d7-dcbf-41c9-ac07-1858b433af5f None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:58.631942 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f69d7-dcbf-41c9-ac07-1858b433af5f None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:58.632225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f69d7-dcbf-41c9-ac07-1858b433af5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:58.661797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c07f69d7-dcbf-41c9-ac07-1858b433af5f None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:17:58.664075 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c07f69d7-dcbf-41c9-ac07-1858b433af5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:17:58.764968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 205/419] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:17:58.807345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f69d7-dcbf-41c9-ac07-1858b433af5f None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:58.808337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9d3d4-1822-43ed-84e4-ce2e89764b12 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:58.844863 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce9759-5bd7-4e27-ad1b-9b851d3838ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:58.845944 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce9759-5bd7-4e27-ad1b-9b851d3838ca None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:58.846417 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce9759-5bd7-4e27-ad1b-9b851d3838ca None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:58.846835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce9759-5bd7-4e27-ad1b-9b851d3838ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:58.857345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce9759-5bd7-4e27-ad1b-9b851d3838ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-c4ce9759-5bd7-4e27-ad1b-9b851d3838ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:58.865667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:58.866713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:58.867508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:58.867508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:58.867508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:58.867508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:58.867508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:58.867508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:58.867508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:58.867508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:58.867508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:58.867508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:58.867508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:17:58.867508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:17:58.870075 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 215/420] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:17:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:17:58.891633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce9759-5bd7-4e27-ad1b-9b851d3838ca None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:58.916105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f69d7-dcbf-41c9-ac07-1858b433af5f None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:58.952506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e9a03-a99e-425b-831e-9c145a659d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:58.953417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e9a03-a99e-425b-831e-9c145a659d99 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:58.953776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e9a03-a99e-425b-831e-9c145a659d99 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:58.954128 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e9a03-a99e-425b-831e-9c145a659d99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:58.965299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e9a03-a99e-425b-831e-9c145a659d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-3e9e9a03-a99e-425b-831e-9c145a659d99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:17:58.973689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:17:58.974615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:17:58.975406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:17:58.975406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:17:58.975406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:17:58.975406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:17:58.975406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:17:58.975406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:17:58.975406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:17:58.975406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:17:58.975406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:17:58.975406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:17:58.975406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:17:58.975406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:17:58.975406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 206/421] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:17:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:17:58.985231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e9a03-a99e-425b-831e-9c145a659d99 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:59.061639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce9759-5bd7-4e27-ad1b-9b851d3838ca None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:59.109794 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5accbb-1417-4917-bdbc-b1a8ede8ceee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:59.110517 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5accbb-1417-4917-bdbc-b1a8ede8ceee None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:59.110804 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5accbb-1417-4917-bdbc-b1a8ede8ceee None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:59.111082 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5accbb-1417-4917-bdbc-b1a8ede8ceee None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:59.111840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5accbb-1417-4917-bdbc-b1a8ede8ceee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:59.112149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5accbb-1417-4917-bdbc-b1a8ede8ceee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:59.113553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5accbb-1417-4917-bdbc-b1a8ede8ceee None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:59.128942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 216/422] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:17:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:59.133575 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5accbb-1417-4917-bdbc-b1a8ede8ceee None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:59.149412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e9a03-a99e-425b-831e-9c145a659d99 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:59.198907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16764c95-51e8-4e97-9b81-c3c98f8d6ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:59.200116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16764c95-51e8-4e97-9b81-c3c98f8d6ef7 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:59.200403 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16764c95-51e8-4e97-9b81-c3c98f8d6ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:59.200679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16764c95-51e8-4e97-9b81-c3c98f8d6ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:59.201443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16764c95-51e8-4e97-9b81-c3c98f8d6ef7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:17:59.201749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16764c95-51e8-4e97-9b81-c3c98f8d6ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:59.203197 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16764c95-51e8-4e97-9b81-c3c98f8d6ef7 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:59.220522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 207/423] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:17:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:59.225975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16764c95-51e8-4e97-9b81-c3c98f8d6ef7 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:59.256244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5accbb-1417-4917-bdbc-b1a8ede8ceee None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:59.305726 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f659bd-a273-4796-aa92-4a15143f5835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:59.306465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f659bd-a273-4796-aa92-4a15143f5835 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:59.306749 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f659bd-a273-4796-aa92-4a15143f5835 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:59.307077 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f659bd-a273-4796-aa92-4a15143f5835 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:59.354428 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16764c95-51e8-4e97-9b81-c3c98f8d6ef7 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:59.392338 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5d24c-fa2b-4e2a-b54f-3244abea2049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:59.392983 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5d24c-fa2b-4e2a-b54f-3244abea2049 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:59.393260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5d24c-fa2b-4e2a-b54f-3244abea2049 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:59.393532 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5d24c-fa2b-4e2a-b54f-3244abea2049 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:59.427946 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f659bd-a273-4796-aa92-4a15143f5835 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:59.429411 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f659bd-a273-4796-aa92-4a15143f5835 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:59.515852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5d24c-fa2b-4e2a-b54f-3244abea2049 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:59.517325 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5d24c-fa2b-4e2a-b54f-3244abea2049 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:59.606825 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 217/424] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 14:17:59.612787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f659bd-a273-4796-aa92-4a15143f5835 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:59.677361 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 208/425] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:17:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:17:59.683592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5d24c-fa2b-4e2a-b54f-3244abea2049 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:59.790518 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5d24c-fa2b-4e2a-b54f-3244abea2049 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:59.826440 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212dabb-0449-40c1-b574-6ea0427f56cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:59.827295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212dabb-0449-40c1-b574-6ea0427f56cb None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:59.827571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212dabb-0449-40c1-b574-6ea0427f56cb None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:59.827841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212dabb-0449-40c1-b574-6ea0427f56cb None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:59.829044 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212dabb-0449-40c1-b574-6ea0427f56cb None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:59.830516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212dabb-0449-40c1-b574-6ea0427f56cb None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:59.833352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 209/426] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:59 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:17:59.839071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212dabb-0449-40c1-b574-6ea0427f56cb None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:59.842362 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f659bd-a273-4796-aa92-4a15143f5835 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:17:59.882695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6a822-57ec-4d47-9c38-997a7c848d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:17:59.883774 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6a822-57ec-4d47-9c38-997a7c848d23 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:17:59.884247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6a822-57ec-4d47-9c38-997a7c848d23 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:17:59.884694 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6a822-57ec-4d47-9c38-997a7c848d23 None admin] PATH_INFO: `/v3/projects/903badc2e08c482fa823407b822580fc` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:17:59.886836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6a822-57ec-4d47-9c38-997a7c848d23 None admin] RBAC: Authorizing `identity:get_project(project_id=903badc2e08c482fa823407b822580fc)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:17:59.889559 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6a822-57ec-4d47-9c38-997a7c848d23 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:17:59.891584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 218/427] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:17:59 2022] GET /identity/v3/projects/903badc2e08c482fa823407b822580fc => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:17:59.903442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6a822-57ec-4d47-9c38-997a7c848d23 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:17:59.980400 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212dabb-0449-40c1-b574-6ea0427f56cb None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:00.067561 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6a822-57ec-4d47-9c38-997a7c848d23 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:00.082848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60910644-f2d3-43f5-96a3-4d2de3fd9d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:00.084116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60910644-f2d3-43f5-96a3-4d2de3fd9d5f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:00.085943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60910644-f2d3-43f5-96a3-4d2de3fd9d5f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:00.087132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60910644-f2d3-43f5-96a3-4d2de3fd9d5f None admin] PATH_INFO: `/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:00.089270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60910644-f2d3-43f5-96a3-4d2de3fd9d5f None admin] RBAC: Authorizing `identity:get_group(group_id=63ec8e83fd5f44e2ac5fee308a183ba7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:00.091176 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60910644-f2d3-43f5-96a3-4d2de3fd9d5f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:00.095270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 210/428] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 14:17:59 2022] GET /identity/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:00.103161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60910644-f2d3-43f5-96a3-4d2de3fd9d5f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:00.124427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db90d4-2ec5-489a-b5f3-967a2cd7eb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:00.125281 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db90d4-2ec5-489a-b5f3-967a2cd7eb2c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:00.125563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db90d4-2ec5-489a-b5f3-967a2cd7eb2c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:00.125840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db90d4-2ec5-489a-b5f3-967a2cd7eb2c None admin] PATH_INFO: `/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:00.128389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db90d4-2ec5-489a-b5f3-967a2cd7eb2c None admin] RBAC: Authorizing `identity:get_group(group_id=63ec8e83fd5f44e2ac5fee308a183ba7)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:00.129854 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db90d4-2ec5-489a-b5f3-967a2cd7eb2c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:00.131502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 219/429] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 14:17:59 2022] GET /identity/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:00.139280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db90d4-2ec5-489a-b5f3-967a2cd7eb2c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:00.267290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60910644-f2d3-43f5-96a3-4d2de3fd9d5f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:00.288454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db90d4-2ec5-489a-b5f3-967a2cd7eb2c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:00.305713 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3083e4-fab2-46a3-846d-16998f3e8c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:00.306805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3083e4-fab2-46a3-846d-16998f3e8c15 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:00.307347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3083e4-fab2-46a3-846d-16998f3e8c15 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:00.307825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3083e4-fab2-46a3-846d-16998f3e8c15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:00.309432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3083e4-fab2-46a3-846d-16998f3e8c15 None admin] RBAC: Adding query filter params (group.id=63ec8e83fd5f44e2ac5fee308a183ba7, role.id=c2cbdedfc238463d91a843ca8e5ac3ca, scope.project.id=903badc2e08c482fa823407b822580fc) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:00.309960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3083e4-fab2-46a3-846d-16998f3e8c15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:00.311686 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3083e4-fab2-46a3-846d-16998f3e8c15 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:00.318729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 211/430] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 14:18:00 2022] GET /identity/v3/role_assignments?group.id=63ec8e83fd5f44e2ac5fee308a183ba7&scope.project.id=903badc2e08c482fa823407b822580fc&role.id=c2cbdedfc238463d91a843ca8e5ac3ca => generated 611 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:00.360882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631e197-1599-4930-abe4-2315b5821ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:00.361895 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631e197-1599-4930-abe4-2315b5821ec2 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:00.362450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631e197-1599-4930-abe4-2315b5821ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:00.362929 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631e197-1599-4930-abe4-2315b5821ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:00.363989 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631e197-1599-4930-abe4-2315b5821ec2 None admin] RBAC: Adding query filter params (group.id=63ec8e83fd5f44e2ac5fee308a183ba7, role.id=c010c38ef8f54067ad2da8aef99dbdcd, scope.project.id=903badc2e08c482fa823407b822580fc) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:00.364502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631e197-1599-4930-abe4-2315b5821ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:00.366137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631e197-1599-4930-abe4-2315b5821ec2 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:00.379627 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 220/431] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 14:18:00 2022] GET /identity/v3/role_assignments?group.id=63ec8e83fd5f44e2ac5fee308a183ba7&scope.project.id=903badc2e08c482fa823407b822580fc&role.id=c010c38ef8f54067ad2da8aef99dbdcd => generated 611 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:00.558132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4be801-2e5e-4d66-bd75-f5932360f603 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:00.558968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4be801-2e5e-4d66-bd75-f5932360f603 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:00.559670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4be801-2e5e-4d66-bd75-f5932360f603 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:00.561749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 212/432] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:00.567806 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72c5f4-e724-4cdc-8364-cd22030c99f8 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:00.568102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72c5f4-e724-4cdc-8364-cd22030c99f8 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:00.568385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72c5f4-e724-4cdc-8364-cd22030c99f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:00.588579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-ed72c5f4-e724-4cdc-8364-cd22030c99f8 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:00.590242 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ed72c5f4-e724-4cdc-8364-cd22030c99f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:00.674030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 221/433] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:18:00.701559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4be801-2e5e-4d66-bd75-f5932360f603 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:00.818762 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bd607-b200-4e0d-b522-58cf67989812 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:00.818999 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bd607-b200-4e0d-b522-58cf67989812 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:00.819240 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bd607-b200-4e0d-b522-58cf67989812 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:00.820019 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4be801-2e5e-4d66-bd75-f5932360f603 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:00.820605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 222/434] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:00.827812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6de269-22f7-4a20-ad02-735fbf170527 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:00.828104 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6de269-22f7-4a20-ad02-735fbf170527 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:00.828382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6de269-22f7-4a20-ad02-735fbf170527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:00.848869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-0a6de269-22f7-4a20-ad02-735fbf170527 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:00.850878 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0a6de269-22f7-4a20-ad02-735fbf170527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:00.868863 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b8354-a0a6-4d48-9648-d5ef97bb9705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:00.869657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b8354-a0a6-4d48-9648-d5ef97bb9705 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:00.869936 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b8354-a0a6-4d48-9648-d5ef97bb9705 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:00.870261 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b8354-a0a6-4d48-9648-d5ef97bb9705 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:00.883218 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b8354-a0a6-4d48-9648-d5ef97bb9705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-854b8354-a0a6-4d48-9648-d5ef97bb9705 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:00.892706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:00.893778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:00.894810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:00.894810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:00.894810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:00.894810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:00.894810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:00.894810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:00.894810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:00.894810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:00.894810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:00.894810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:00.894810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 14:18:00.894810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:00.896684 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 213/435] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:18:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:00.898070 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3142e8b-03c5-43f1-a22f-e8e8bf9b0803 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:00.898510 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3142e8b-03c5-43f1-a22f-e8e8bf9b0803 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:00.898927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3142e8b-03c5-43f1-a22f-e8e8bf9b0803 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:00.900334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 214/436] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:00.904257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3142e8b-03c5-43f1-a22f-e8e8bf9b0803 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:00.940052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 223/437] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:00.941676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff826980-a665-4cd4-8550-0725e44c95c0 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:00.941964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff826980-a665-4cd4-8550-0725e44c95c0 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:00.942280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff826980-a665-4cd4-8550-0725e44c95c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:00.963625 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-ff826980-a665-4cd4-8550-0725e44c95c0 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:00.964805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ff826980-a665-4cd4-8550-0725e44c95c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:01.031600 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3142e8b-03c5-43f1-a22f-e8e8bf9b0803 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:01.052347 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 224/438] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:01.053372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff826980-a665-4cd4-8550-0725e44c95c0 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:01.082751 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a69e4-3d17-444f-b839-7480c2ee91c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:01.083340 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a69e4-3d17-444f-b839-7480c2ee91c8 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:01.083645 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a69e4-3d17-444f-b839-7480c2ee91c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:01.083952 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a69e4-3d17-444f-b839-7480c2ee91c8 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:01.084765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a69e4-3d17-444f-b839-7480c2ee91c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:01.085113 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a69e4-3d17-444f-b839-7480c2ee91c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:01.086583 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a69e4-3d17-444f-b839-7480c2ee91c8 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:01.095957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 215/439] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:18:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:01.096793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a69e4-3d17-444f-b839-7480c2ee91c8 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:01.176277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff826980-a665-4cd4-8550-0725e44c95c0 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:01.217424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab782bd-6d7e-4d9c-810d-22e53ed154c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:01.217667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a69e4-3d17-444f-b839-7480c2ee91c8 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:01.218725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab782bd-6d7e-4d9c-810d-22e53ed154c0 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:01.219024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab782bd-6d7e-4d9c-810d-22e53ed154c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:01.219298 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab782bd-6d7e-4d9c-810d-22e53ed154c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:01.238312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab782bd-6d7e-4d9c-810d-22e53ed154c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-4ab782bd-6d7e-4d9c-810d-22e53ed154c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:01.248378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:01.249312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:01.250416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:01.250416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:01.250416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:01.250416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:01.250416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:01.250416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:01.250416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:01.250416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:01.250416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:01.250416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:01.250416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:18:01.250416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:01.250416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 225/440] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:18:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:01.251537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab782bd-6d7e-4d9c-810d-22e53ed154c0 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:01.255005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39c0cc-cf54-4a06-88ac-ed43e4bbfd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:01.255810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39c0cc-cf54-4a06-88ac-ed43e4bbfd26 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:01.256142 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39c0cc-cf54-4a06-88ac-ed43e4bbfd26 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:01.256365 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39c0cc-cf54-4a06-88ac-ed43e4bbfd26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:01.267869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39c0cc-cf54-4a06-88ac-ed43e4bbfd26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-1a39c0cc-cf54-4a06-88ac-ed43e4bbfd26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:01.275601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:01.276500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:01.277297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:01.277297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:01.277297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:01.277297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:01.277297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:01.277297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:01.277297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:01.277297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:01.277297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:01.277297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:01.277297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:18:01.277297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:01.278807 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 216/441] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:18:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:01.279353 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39c0cc-cf54-4a06-88ac-ed43e4bbfd26 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:01.361057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab782bd-6d7e-4d9c-810d-22e53ed154c0 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:01.383711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39c0cc-cf54-4a06-88ac-ed43e4bbfd26 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:01.397548 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abb1eb-18ed-4e67-9683-372c0a209a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:01.398228 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abb1eb-18ed-4e67-9683-372c0a209a5c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:01.398516 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abb1eb-18ed-4e67-9683-372c0a209a5c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:01.398797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abb1eb-18ed-4e67-9683-372c0a209a5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:01.421041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1d062-b39c-44f7-991f-ec8daf896d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:01.421723 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1d062-b39c-44f7-991f-ec8daf896d37 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:01.422469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1d062-b39c-44f7-991f-ec8daf896d37 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:01.422469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1d062-b39c-44f7-991f-ec8daf896d37 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:01.423142 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1d062-b39c-44f7-991f-ec8daf896d37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:01.423449 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1d062-b39c-44f7-991f-ec8daf896d37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:01.424842 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1d062-b39c-44f7-991f-ec8daf896d37 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:01.433044 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 217/442] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:01.433906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1d062-b39c-44f7-991f-ec8daf896d37 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:01.476253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2abb1eb-18ed-4e67-9683-372c0a209a5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:01.477835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2abb1eb-18ed-4e67-9683-372c0a209a5c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:01.551292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1d062-b39c-44f7-991f-ec8daf896d37 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:01.583219 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 226/443] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:18:01.584473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abb1eb-18ed-4e67-9683-372c0a209a5c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:01.589732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac9919-18ab-42dd-a70f-a10478b0b274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:01.591530 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac9919-18ab-42dd-a70f-a10478b0b274 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:01.591786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac9919-18ab-42dd-a70f-a10478b0b274 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:01.592063 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac9919-18ab-42dd-a70f-a10478b0b274 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:01.592812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac9919-18ab-42dd-a70f-a10478b0b274 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:01.593120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac9919-18ab-42dd-a70f-a10478b0b274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:01.594524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac9919-18ab-42dd-a70f-a10478b0b274 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:01.603322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 218/444] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:18:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:01.604137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac9919-18ab-42dd-a70f-a10478b0b274 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:01.688574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abb1eb-18ed-4e67-9683-372c0a209a5c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:01.710780 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac9919-18ab-42dd-a70f-a10478b0b274 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:01.728570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b37af-9940-4f2f-8f24-354df925f557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:01.729213 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b37af-9940-4f2f-8f24-354df925f557 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:01.729491 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b37af-9940-4f2f-8f24-354df925f557 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:01.738519 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b37af-9940-4f2f-8f24-354df925f557 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:01.750296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce41795-b40a-4a3d-869d-a289b02158ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:01.751163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce41795-b40a-4a3d-869d-a289b02158ac None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:01.751449 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce41795-b40a-4a3d-869d-a289b02158ac None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:01.751726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce41795-b40a-4a3d-869d-a289b02158ac None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:01.752946 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce41795-b40a-4a3d-869d-a289b02158ac None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:01.754558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce41795-b40a-4a3d-869d-a289b02158ac None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:01.756269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 219/445] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:18:01 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:01.757066 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce41795-b40a-4a3d-869d-a289b02158ac None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:01.818793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b37af-9940-4f2f-8f24-354df925f557 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:01.820926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b37af-9940-4f2f-8f24-354df925f557 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:01.871806 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce41795-b40a-4a3d-869d-a289b02158ac None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:01.907367 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de880b-2c5e-4172-b6c0-c5e170e5eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:01.908293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de880b-2c5e-4172-b6c0-c5e170e5eddb None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:01.908764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de880b-2c5e-4172-b6c0-c5e170e5eddb None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:01.909221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de880b-2c5e-4172-b6c0-c5e170e5eddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:01.941267 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 227/446] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:18:01.941267 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b37af-9940-4f2f-8f24-354df925f557 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:01.978999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de880b-2c5e-4172-b6c0-c5e170e5eddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:01.980521 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de880b-2c5e-4172-b6c0-c5e170e5eddb None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:02.057119 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b37af-9940-4f2f-8f24-354df925f557 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:02.087694 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 220/447] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:18:02.088542 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de880b-2c5e-4172-b6c0-c5e170e5eddb None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:02.097568 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaef33-5e1f-48e7-9078-36e6f811d274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:02.098462 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaef33-5e1f-48e7-9078-36e6f811d274 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:02.098742 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaef33-5e1f-48e7-9078-36e6f811d274 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:02.099015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaef33-5e1f-48e7-9078-36e6f811d274 None admin] PATH_INFO: `/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:02.100185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eaef33-5e1f-48e7-9078-36e6f811d274 None admin] RBAC: Authorizing `identity:get_group(group_id=63ec8e83fd5f44e2ac5fee308a183ba7)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:02.101650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eaef33-5e1f-48e7-9078-36e6f811d274 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:02.103281 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 228/448] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 14:18:01 2022] GET /identity/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:02.104033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaef33-5e1f-48e7-9078-36e6f811d274 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:02.182253 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de880b-2c5e-4172-b6c0-c5e170e5eddb None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:02.199586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaef33-5e1f-48e7-9078-36e6f811d274 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:02.216153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53345cec-543f-4d4f-8304-248871aba81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:02.217000 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53345cec-543f-4d4f-8304-248871aba81d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:02.217281 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53345cec-543f-4d4f-8304-248871aba81d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:02.217552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53345cec-543f-4d4f-8304-248871aba81d None admin] PATH_INFO: `/v3/projects/ca31edde9c134f528cd3f229ac72e713` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:02.218759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53345cec-543f-4d4f-8304-248871aba81d None admin] RBAC: Authorizing `identity:get_project(project_id=ca31edde9c134f528cd3f229ac72e713)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:02.220289 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53345cec-543f-4d4f-8304-248871aba81d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:02.221954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 221/449] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:18:02 2022] GET /identity/v3/projects/ca31edde9c134f528cd3f229ac72e713 => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:02.222765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53345cec-543f-4d4f-8304-248871aba81d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:02.233530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b1145-481f-4d59-a17a-ade2114170ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:02.234424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b1145-481f-4d59-a17a-ade2114170ca None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:02.234708 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b1145-481f-4d59-a17a-ade2114170ca None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:02.234986 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b1145-481f-4d59-a17a-ade2114170ca None admin] PATH_INFO: `/v3/projects/c7c1abe20ef64ed9a7be8720622420f6` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:02.236168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b1145-481f-4d59-a17a-ade2114170ca None admin] RBAC: Authorizing `identity:get_project(project_id=c7c1abe20ef64ed9a7be8720622420f6)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:02.237603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b1145-481f-4d59-a17a-ade2114170ca None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:02.239455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 229/450] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:18:02 2022] GET /identity/v3/projects/c7c1abe20ef64ed9a7be8720622420f6 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:02.240059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b1145-481f-4d59-a17a-ade2114170ca None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:02.321289 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53345cec-543f-4d4f-8304-248871aba81d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:02.335403 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b1145-481f-4d59-a17a-ade2114170ca None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:02.354126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bfa47-bf87-458b-9ccd-426877b0f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:02.354804 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bfa47-bf87-458b-9ccd-426877b0f571 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:02.355081 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bfa47-bf87-458b-9ccd-426877b0f571 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:02.355351 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bfa47-bf87-458b-9ccd-426877b0f571 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:02.356910 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bfa47-bf87-458b-9ccd-426877b0f571 None admin] RBAC: Adding query filter params (group.id=63ec8e83fd5f44e2ac5fee308a183ba7, role.id=c2cbdedfc238463d91a843ca8e5ac3ca, scope.project.id=ca31edde9c134f528cd3f229ac72e713) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:02.357219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bfa47-bf87-458b-9ccd-426877b0f571 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:02.358685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bfa47-bf87-458b-9ccd-426877b0f571 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:02.364210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 222/451] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 14:18:02 2022] GET /identity/v3/role_assignments?group.id=63ec8e83fd5f44e2ac5fee308a183ba7&scope.project.id=ca31edde9c134f528cd3f229ac72e713&role.id=c2cbdedfc238463d91a843ca8e5ac3ca => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:02.364975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bfa47-bf87-458b-9ccd-426877b0f571 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:02.376162 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51312e-4357-421f-92b8-b8593c22a383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:02.377197 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51312e-4357-421f-92b8-b8593c22a383 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:02.377544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51312e-4357-421f-92b8-b8593c22a383 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:02.377894 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51312e-4357-421f-92b8-b8593c22a383 None admin] PATH_INFO: `/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:02.379313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51312e-4357-421f-92b8-b8593c22a383 None admin] RBAC: Authorizing `identity:get_group(group_id=63ec8e83fd5f44e2ac5fee308a183ba7)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:02.380823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51312e-4357-421f-92b8-b8593c22a383 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:02.382848 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 230/452] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 14:18:02 2022] GET /identity/v3/groups/63ec8e83fd5f44e2ac5fee308a183ba7 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:02.389046 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51312e-4357-421f-92b8-b8593c22a383 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:02.479839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bfa47-bf87-458b-9ccd-426877b0f571 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:02.498608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51312e-4357-421f-92b8-b8593c22a383 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:02.516526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e22725-29bb-4792-9904-91abb9d5dc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:02.517466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e22725-29bb-4792-9904-91abb9d5dc75 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:02.517750 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e22725-29bb-4792-9904-91abb9d5dc75 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:02.518078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e22725-29bb-4792-9904-91abb9d5dc75 None admin] PATH_INFO: `/v3/groups/280307ee5f584659928e49c0278080c2` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:02.519594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e22725-29bb-4792-9904-91abb9d5dc75 None admin] RBAC: Authorizing `identity:get_group(group_id=280307ee5f584659928e49c0278080c2)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:02.521057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e22725-29bb-4792-9904-91abb9d5dc75 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:02.523080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 223/453] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 17 14:18:02 2022] GET /identity/v3/groups/280307ee5f584659928e49c0278080c2 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:02.529362 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e22725-29bb-4792-9904-91abb9d5dc75 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:02.543005 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450e782-ac5d-406b-bc5d-8568410bfdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:02.544703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450e782-ac5d-406b-bc5d-8568410bfdb4 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:02.544992 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450e782-ac5d-406b-bc5d-8568410bfdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:02.545270 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450e782-ac5d-406b-bc5d-8568410bfdb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:02.546112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450e782-ac5d-406b-bc5d-8568410bfdb4 None admin] RBAC: Adding query filter params (group.id=63ec8e83fd5f44e2ac5fee308a183ba7, role.id=c010c38ef8f54067ad2da8aef99dbdcd, scope.project.id=ca31edde9c134f528cd3f229ac72e713) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:02.546453 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450e782-ac5d-406b-bc5d-8568410bfdb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:02.547916 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450e782-ac5d-406b-bc5d-8568410bfdb4 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:02.553977 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 231/454] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 14:18:02 2022] GET /identity/v3/role_assignments?group.id=63ec8e83fd5f44e2ac5fee308a183ba7&scope.project.id=ca31edde9c134f528cd3f229ac72e713&role.id=c010c38ef8f54067ad2da8aef99dbdcd => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:02.639138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e22725-29bb-4792-9904-91abb9d5dc75 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:02.676439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfca61-429a-4149-870c-be89ee1a468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:02.677104 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfca61-429a-4149-870c-be89ee1a468f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:02.677385 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfca61-429a-4149-870c-be89ee1a468f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:02.677664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfca61-429a-4149-870c-be89ee1a468f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:02.678557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfca61-429a-4149-870c-be89ee1a468f None admin] RBAC: Adding query filter params (group.id=280307ee5f584659928e49c0278080c2, role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=c7c1abe20ef64ed9a7be8720622420f6) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:02.678864 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfca61-429a-4149-870c-be89ee1a468f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:02.680324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfca61-429a-4149-870c-be89ee1a468f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:02.687160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 224/455] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 17 14:18:02 2022] GET /identity/v3/role_assignments?group.id=280307ee5f584659928e49c0278080c2&scope.project.id=c7c1abe20ef64ed9a7be8720622420f6&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:05.492299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d6b95-772f-46d7-a67f-660588cd2022 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:05.493386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d6b95-772f-46d7-a67f-660588cd2022 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:05.493882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d6b95-772f-46d7-a67f-660588cd2022 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:05.495904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 232/456] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:05.502808 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1bf12-7b79-4a66-862b-2ea2b232374f None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:05.503786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1bf12-7b79-4a66-862b-2ea2b232374f None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:05.504334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1bf12-7b79-4a66-862b-2ea2b232374f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:05.531540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-15a1bf12-7b79-4a66-862b-2ea2b232374f None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:05.533124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-15a1bf12-7b79-4a66-862b-2ea2b232374f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:05.628458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 225/457] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:05.677139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d6b95-772f-46d7-a67f-660588cd2022 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:05.750285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640f37d-2ff3-427c-beeb-284ccd148f89 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:05.750285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640f37d-2ff3-427c-beeb-284ccd148f89 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:05.750285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640f37d-2ff3-427c-beeb-284ccd148f89 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:05.751152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 226/458] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:05.756371 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a2e0b-4a4e-40f4-b6e3-6604f3e58293 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:05.756661 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a2e0b-4a4e-40f4-b6e3-6604f3e58293 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:05.756944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a2e0b-4a4e-40f4-b6e3-6604f3e58293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:05.799432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-477a2e0b-4a4e-40f4-b6e3-6604f3e58293 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:05.800634 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-477a2e0b-4a4e-40f4-b6e3-6604f3e58293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:05.815801 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d6b95-772f-46d7-a67f-660588cd2022 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:05.860017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee967dc-1ddd-4f86-9dba-c9e587753d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:05.861157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee967dc-1ddd-4f86-9dba-c9e587753d1e None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:05.861643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee967dc-1ddd-4f86-9dba-c9e587753d1e None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:05.862118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee967dc-1ddd-4f86-9dba-c9e587753d1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:05.872956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee967dc-1ddd-4f86-9dba-c9e587753d1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:05.874792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee967dc-1ddd-4f86-9dba-c9e587753d1e None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:05.882436 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 227/459] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:18:05.884075 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979c04e-9637-44ed-ba2e-65930547b78f None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:05.884186 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979c04e-9637-44ed-ba2e-65930547b78f None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:05.884431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979c04e-9637-44ed-ba2e-65930547b78f None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:05.885991 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 228/460] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:05.894746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-2ee967dc-1ddd-4f86-9dba-c9e587753d1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:05.894746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:05.894746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:05.894746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:05.894746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:05.894746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:05.894746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:05.894746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:05.894746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:05.894746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:05.894746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:05.894746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:05.894746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:05.894746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:05.894746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:05.895589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:05.896438 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:05.896438 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:05.896438 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:05.896438 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:05.898621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 233/461] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:05.904664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979c04e-9637-44ed-ba2e-65930547b78f None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:05.907189 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63ffa4-28dc-4e45-90cf-7271b2097e49 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:05.907672 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63ffa4-28dc-4e45-90cf-7271b2097e49 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:05.907952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63ffa4-28dc-4e45-90cf-7271b2097e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:05.928241 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-9a63ffa4-28dc-4e45-90cf-7271b2097e49 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:05.929444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-9a63ffa4-28dc-4e45-90cf-7271b2097e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:06.010275 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 234/462] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:06.010275 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63ffa4-28dc-4e45-90cf-7271b2097e49 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:06.044174 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979c04e-9637-44ed-ba2e-65930547b78f None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:06.078961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0dcb8-2515-4498-98b7-0f457b7b1669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:06.079709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0dcb8-2515-4498-98b7-0f457b7b1669 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:06.079889 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0dcb8-2515-4498-98b7-0f457b7b1669 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:06.080168 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0dcb8-2515-4498-98b7-0f457b7b1669 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:06.081146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0dcb8-2515-4498-98b7-0f457b7b1669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:06.081503 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0dcb8-2515-4498-98b7-0f457b7b1669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:06.082951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0dcb8-2515-4498-98b7-0f457b7b1669 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:06.101515 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 229/463] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:06.106425 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0dcb8-2515-4498-98b7-0f457b7b1669 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:06.119273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63ffa4-28dc-4e45-90cf-7271b2097e49 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:06.155046 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37528-73a7-4de8-afc6-365df88a1501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:06.156350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37528-73a7-4de8-afc6-365df88a1501 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:06.156844 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37528-73a7-4de8-afc6-365df88a1501 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:06.157281 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37528-73a7-4de8-afc6-365df88a1501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:06.167326 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d37528-73a7-4de8-afc6-365df88a1501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:06.169171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d37528-73a7-4de8-afc6-365df88a1501 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:06.187393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-56d37528-73a7-4de8-afc6-365df88a1501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:06.187393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:06.187393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:06.187393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:06.187393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:06.187393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:06.187393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:06.187393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:06.187393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:06.187393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:06.187393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:06.187393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:06.187393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:06.187393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:06.187393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:06.188361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:06.189234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:06.189234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:06.189234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:06.189234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:06.189234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 235/464] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:06.189494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37528-73a7-4de8-afc6-365df88a1501 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:06.212753 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0dcb8-2515-4498-98b7-0f457b7b1669 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:06.249385 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859821cd-31c6-4ae0-b8e7-369f52a851fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:06.250203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859821cd-31c6-4ae0-b8e7-369f52a851fc None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:06.250495 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859821cd-31c6-4ae0-b8e7-369f52a851fc None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:06.250771 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859821cd-31c6-4ae0-b8e7-369f52a851fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:06.265010 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859821cd-31c6-4ae0-b8e7-369f52a851fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:06.266448 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859821cd-31c6-4ae0-b8e7-369f52a851fc None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:06.285183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-859821cd-31c6-4ae0-b8e7-369f52a851fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:06.285183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:06.285183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:06.285183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:06.285183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:06.285183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:06.285183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:06.285183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:06.285183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:06.285183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:06.285183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:06.285183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:06.285183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:06.285183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:06.285183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:06.286265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:06.292114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:06.292114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:06.292114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:06.292114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:06.292114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 230/465] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:06.292114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467daeb-8e01-4fdb-9f3e-e8b01d305ffe None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:06.292114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467daeb-8e01-4fdb-9f3e-e8b01d305ffe None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:06.292114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467daeb-8e01-4fdb-9f3e-e8b01d305ffe None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:06.292114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 231/466] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:06.292612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467daeb-8e01-4fdb-9f3e-e8b01d305ffe None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:06.306763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37528-73a7-4de8-afc6-365df88a1501 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:06.342458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc6101-7a47-489f-90a7-dff8d397f676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:06.343131 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc6101-7a47-489f-90a7-dff8d397f676 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:06.343414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc6101-7a47-489f-90a7-dff8d397f676 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:06.343696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc6101-7a47-489f-90a7-dff8d397f676 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:06.344402 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc6101-7a47-489f-90a7-dff8d397f676 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:06.345994 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc6101-7a47-489f-90a7-dff8d397f676 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:06.367328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 236/467] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:18:06 2022] POST /identity/v3/users => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:18:06.368466 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc6101-7a47-489f-90a7-dff8d397f676 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:06.403543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467daeb-8e01-4fdb-9f3e-e8b01d305ffe None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:06.441895 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f1058-ecbe-4b0b-9d5b-90029ba62c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:06.442607 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f1058-ecbe-4b0b-9d5b-90029ba62c52 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:06.442952 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f1058-ecbe-4b0b-9d5b-90029ba62c52 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:06.443230 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f1058-ecbe-4b0b-9d5b-90029ba62c52 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:06.444040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f1058-ecbe-4b0b-9d5b-90029ba62c52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:06.444395 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f1058-ecbe-4b0b-9d5b-90029ba62c52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:06.445846 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f1058-ecbe-4b0b-9d5b-90029ba62c52 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:06.466123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 232/468] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:06.466123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac1025-1df1-41cc-a9ba-d443d0bb1463 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:06.466123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac1025-1df1-41cc-a9ba-d443d0bb1463 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:06.466123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac1025-1df1-41cc-a9ba-d443d0bb1463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:06.487351 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-28ac1025-1df1-41cc-a9ba-d443d0bb1463 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:06.489015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-28ac1025-1df1-41cc-a9ba-d443d0bb1463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:06.515903 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc6101-7a47-489f-90a7-dff8d397f676 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:06.554093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca860857-ce0b-4e18-a8ab-462dfd390f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:06.555145 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca860857-ce0b-4e18-a8ab-462dfd390f20 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:06.555145 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca860857-ce0b-4e18-a8ab-462dfd390f20 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:06.555423 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca860857-ce0b-4e18-a8ab-462dfd390f20 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:06.556101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca860857-ce0b-4e18-a8ab-462dfd390f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:06.556412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca860857-ce0b-4e18-a8ab-462dfd390f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:06.557902 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca860857-ce0b-4e18-a8ab-462dfd390f20 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:06.574742 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 237/469] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:06.574742 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca860857-ce0b-4e18-a8ab-462dfd390f20 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:06.577951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 233/470] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:06.579373 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac1025-1df1-41cc-a9ba-d443d0bb1463 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:06.676558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca860857-ce0b-4e18-a8ab-462dfd390f20 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:06.696698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac1025-1df1-41cc-a9ba-d443d0bb1463 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:06.722022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e230ad4-8a67-40d2-a6f5-3029cdbdb639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:06.722891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e230ad4-8a67-40d2-a6f5-3029cdbdb639 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:06.723521 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e230ad4-8a67-40d2-a6f5-3029cdbdb639 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:06.723802 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e230ad4-8a67-40d2-a6f5-3029cdbdb639 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:06.724840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e230ad4-8a67-40d2-a6f5-3029cdbdb639 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:06.727164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e230ad4-8a67-40d2-a6f5-3029cdbdb639 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:06.733990 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05c93e-f520-45ac-9fb6-07ed064e0c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:06.734700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05c93e-f520-45ac-9fb6-07ed064e0c80 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:06.734986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05c93e-f520-45ac-9fb6-07ed064e0c80 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:06.735445 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05c93e-f520-45ac-9fb6-07ed064e0c80 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:06.736176 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05c93e-f520-45ac-9fb6-07ed064e0c80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:06.737669 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05c93e-f520-45ac-9fb6-07ed064e0c80 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:06.755536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 238/471] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:18:06 2022] POST /identity/v3/users => generated 248 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:18:06.756553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e230ad4-8a67-40d2-a6f5-3029cdbdb639 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:06.773406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 234/472] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:18:06 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:18:06.877053 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e230ad4-8a67-40d2-a6f5-3029cdbdb639 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:06.917887 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc05a0-a06c-42b9-94f2-0e799112928a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:06.918812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc05a0-a06c-42b9-94f2-0e799112928a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:06.919100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc05a0-a06c-42b9-94f2-0e799112928a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:06.919376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc05a0-a06c-42b9-94f2-0e799112928a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:06.931647 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc05a0-a06c-42b9-94f2-0e799112928a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:06.933156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc05a0-a06c-42b9-94f2-0e799112928a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:06.947857 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ecfd9-9c2b-4fb9-968e-f5124d1d0826 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:06.948160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ecfd9-9c2b-4fb9-968e-f5124d1d0826 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:06.948425 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ecfd9-9c2b-4fb9-968e-f5124d1d0826 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:06.950437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 235/473] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:06.953714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-8dfc05a0-a06c-42b9-94f2-0e799112928a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:06.953714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:06.953714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:06.953714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:06.953714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:06.953714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:06.953714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:06.953714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:06.953714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:06.953714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:06.953714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:06.953714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:06.953714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:06.953714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:06.953714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:06.954665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:06.955535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:06.955535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:06.955535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:06.955535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:06.955535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 239/474] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:06.956513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d5d7d-0e98-44a9-a202-e523f3b7a17b None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:06.956799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d5d7d-0e98-44a9-a202-e523f3b7a17b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:06.957074 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d5d7d-0e98-44a9-a202-e523f3b7a17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:06.966408 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc05a0-a06c-42b9-94f2-0e799112928a None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:06.982209 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-164d5d7d-0e98-44a9-a202-e523f3b7a17b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:06.982209 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-164d5d7d-0e98-44a9-a202-e523f3b7a17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:07.063165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 236/475] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:07.086872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d5d7d-0e98-44a9-a202-e523f3b7a17b None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:07.127583 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc05a0-a06c-42b9-94f2-0e799112928a None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:07.167671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ba248-762b-4627-9ce6-53fd8c6d8de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:07.169406 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ba248-762b-4627-9ce6-53fd8c6d8de3 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:07.169977 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ba248-762b-4627-9ce6-53fd8c6d8de3 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:07.170414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ba248-762b-4627-9ce6-53fd8c6d8de3 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:07.171292 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ba248-762b-4627-9ce6-53fd8c6d8de3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:07.171699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ba248-762b-4627-9ce6-53fd8c6d8de3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:07.173195 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ba248-762b-4627-9ce6-53fd8c6d8de3 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:07.186273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 240/476] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:07.191511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ba248-762b-4627-9ce6-53fd8c6d8de3 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:07.218655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d5d7d-0e98-44a9-a202-e523f3b7a17b None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:07.304263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc22be9-5438-46fa-a6b9-8df00959f398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:07.305124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc22be9-5438-46fa-a6b9-8df00959f398 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:07.305507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc22be9-5438-46fa-a6b9-8df00959f398 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:07.305885 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc22be9-5438-46fa-a6b9-8df00959f398 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:07.307063 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc22be9-5438-46fa-a6b9-8df00959f398 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:07.308270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc22be9-5438-46fa-a6b9-8df00959f398 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:07.319413 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ba248-762b-4627-9ce6-53fd8c6d8de3 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:07.326101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.sql.core [None req-4bc22be9-5438-46fa-a6b9-8df00959f398 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 14:18:07.326101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 17 14:18:07.326101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [parameters: {'id': '5f6701a5cf6a4bcb8843a8d5bb5b0875', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 17 14:18:07.326101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79877) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 14:18:07.351228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-4bc22be9-5438-46fa-a6b9-8df00959f398 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 17 14:18:07.351228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:07.351228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 14:18:07.351228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 14:18:07.351228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 14:18:07.351228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 14:18:07.351228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 14:18:07.351228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application result = self._query(query) May 17 14:18:07.351228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 14:18:07.351228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application conn.query(q) May 17 14:18:07.351228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 14:18:07.351228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 14:18:07.351228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 14:18:07.351228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application result.read() May 17 14:18:07.351228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return ref.to_dict() May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 14:18:07.352241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application next(self.gen) May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application yield resource May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application next(self.gen) May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self.session.rollback() May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self.force_reraise() May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise self.value May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application session.commit() May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 14:18:07.353161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._prepare_impl() May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self.session.flush() May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._flush(objects) May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application compat.raise_( May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application flush_context.execute() May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rec.execute(self) May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 14:18:07.354008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application c = connection._execute_20( May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 14:18:07.354911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application result = self._query(query) May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application conn.query(q) May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application result.read() May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 14:18:07.356274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [parameters: {'id': '5f6701a5cf6a4bcb8843a8d5bb5b0875', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:07.357051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 17 14:18:07.357831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:07.358720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 237/477] 10.222.0.48 () {60 vars in 1131 bytes} [Tue May 17 14:18:07 2022] POST /identity/v3/roles => generated 144 bytes in 266 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:07.360327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc22be9-5438-46fa-a6b9-8df00959f398 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:07.364204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4fa8d-0945-46c0-be16-bfc8e0997595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:07.365135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4fa8d-0945-46c0-be16-bfc8e0997595 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:07.365635 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4fa8d-0945-46c0-be16-bfc8e0997595 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:07.366117 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4fa8d-0945-46c0-be16-bfc8e0997595 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:07.367067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4fa8d-0945-46c0-be16-bfc8e0997595 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:07.368708 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4fa8d-0945-46c0-be16-bfc8e0997595 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:07.395314 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 241/478] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:18:07 2022] POST /identity/v3/users => generated 249 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:18:07.539486 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc22be9-5438-46fa-a6b9-8df00959f398 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:07.592346 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d28c4e-d24d-4bb7-a798-7d0d3cfecaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:07.594659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d28c4e-d24d-4bb7-a798-7d0d3cfecaaf None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:07.595080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d28c4e-d24d-4bb7-a798-7d0d3cfecaaf None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:07.595494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d28c4e-d24d-4bb7-a798-7d0d3cfecaaf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:07.613496 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d28c4e-d24d-4bb7-a798-7d0d3cfecaaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-07d28c4e-d24d-4bb7-a798-7d0d3cfecaaf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:07.622525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:07.623540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:07.624372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:07.624372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:07.624372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:07.624372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:07.624372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:07.624372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:07.624372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:07.624372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:07.624372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:07.624372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:07.624372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 14:18:07.624372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:07.624372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 238/479] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:18:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:07.631353 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4fa8d-0945-46c0-be16-bfc8e0997595 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:07.737868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4fa8d-0945-46c0-be16-bfc8e0997595 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:07.771760 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd363d5-dfe9-4f3f-b1c6-255c83d353f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:07.772437 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd363d5-dfe9-4f3f-b1c6-255c83d353f1 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:07.772720 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd363d5-dfe9-4f3f-b1c6-255c83d353f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:07.772995 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd363d5-dfe9-4f3f-b1c6-255c83d353f1 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:07.773739 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd363d5-dfe9-4f3f-b1c6-255c83d353f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:07.774041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd363d5-dfe9-4f3f-b1c6-255c83d353f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:07.775464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd363d5-dfe9-4f3f-b1c6-255c83d353f1 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:07.784572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 242/480] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:09.499926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fcc39-26d2-4f79-9f53-fb822de39440 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:09.500820 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fcc39-26d2-4f79-9f53-fb822de39440 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:09.501278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fcc39-26d2-4f79-9f53-fb822de39440 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:09.503095 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 239/481] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:09.509688 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90af9b6-bb70-4ee4-a749-59d174aa3985 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:09.510579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90af9b6-bb70-4ee4-a749-59d174aa3985 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:09.511056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90af9b6-bb70-4ee4-a749-59d174aa3985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:09.535151 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b90af9b6-bb70-4ee4-a749-59d174aa3985 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:09.536734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b90af9b6-bb70-4ee4-a749-59d174aa3985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:09.614201 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bd6e8-8f3e-487b-917a-117fc8ca0c7a None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:09.614201 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bd6e8-8f3e-487b-917a-117fc8ca0c7a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:09.614201 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bd6e8-8f3e-487b-917a-117fc8ca0c7a None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:09.614201 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 240/482] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:09.619253 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be023369-fbdb-4107-8fcf-d0790900dc25 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:09.619618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be023369-fbdb-4107-8fcf-d0790900dc25 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:09.619968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be023369-fbdb-4107-8fcf-d0790900dc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:09.620584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 243/483] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:09.637308 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-be023369-fbdb-4107-8fcf-d0790900dc25 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:09.638789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-be023369-fbdb-4107-8fcf-d0790900dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:09.651490 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90af9b6-bb70-4ee4-a749-59d174aa3985 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:09.710202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 241/484] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:09.718523 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620d5e1-11ee-424f-99c8-212147d23eaf None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:09.718849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620d5e1-11ee-424f-99c8-212147d23eaf None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:09.719140 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620d5e1-11ee-424f-99c8-212147d23eaf None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:09.720519 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 242/485] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:09 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:09.732868 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326404d1-4ecc-47b1-8cc5-7dd0ccb6beb4 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:09.733157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326404d1-4ecc-47b1-8cc5-7dd0ccb6beb4 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:09.733524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326404d1-4ecc-47b1-8cc5-7dd0ccb6beb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:09.750155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-326404d1-4ecc-47b1-8cc5-7dd0ccb6beb4 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:09.751293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-326404d1-4ecc-47b1-8cc5-7dd0ccb6beb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:09.775612 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90af9b6-bb70-4ee4-a749-59d174aa3985 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:09.816173 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d0c13-d681-49af-bb19-6bcdde9a3029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:09.817123 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d0c13-d681-49af-bb19-6bcdde9a3029 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:09.817532 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d0c13-d681-49af-bb19-6bcdde9a3029 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:09.817806 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d0c13-d681-49af-bb19-6bcdde9a3029 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:09.831995 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d0c13-d681-49af-bb19-6bcdde9a3029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-969d0c13-d681-49af-bb19-6bcdde9a3029 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:09.840455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:09.841534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:09.842354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:09.842354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:09.842354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:09.842354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:09.842354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:09.842354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:09.842354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:09.842354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:09.842354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:09.842354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:09.842354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:09.842354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:09.842354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 244/486] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:09.843028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 243/487] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:18:09.847345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d0c13-d681-49af-bb19-6bcdde9a3029 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:09.847834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326404d1-4ecc-47b1-8cc5-7dd0ccb6beb4 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:09.965453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326404d1-4ecc-47b1-8cc5-7dd0ccb6beb4 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:09.971992 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d0c13-d681-49af-bb19-6bcdde9a3029 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:10.005775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d3b0a-96e3-442d-ae02-2b1280ca9d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:10.006553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d3b0a-96e3-442d-ae02-2b1280ca9d1e None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.006833 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d3b0a-96e3-442d-ae02-2b1280ca9d1e None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.007111 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d3b0a-96e3-442d-ae02-2b1280ca9d1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.007419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecfc64-f9c6-424a-b1a9-96ba22dd8233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:10.008262 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecfc64-f9c6-424a-b1a9-96ba22dd8233 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.008539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecfc64-f9c6-424a-b1a9-96ba22dd8233 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.008974 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecfc64-f9c6-424a-b1a9-96ba22dd8233 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.010058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecfc64-f9c6-424a-b1a9-96ba22dd8233 None admin] RBAC: Adding query filter params (name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:10.010396 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecfc64-f9c6-424a-b1a9-96ba22dd8233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:10.011891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecfc64-f9c6-424a-b1a9-96ba22dd8233 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:10.017727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d3b0a-96e3-442d-ae02-2b1280ca9d1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:10.021677 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 244/488] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:10.022527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecfc64-f9c6-424a-b1a9-96ba22dd8233 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-a21d3b0a-96e3-442d-ae02-2b1280ca9d1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:10.030893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:10.033021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:10.035150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:10.035150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:10.035150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:10.035150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:10.035150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:10.035150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:10.035150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:10.035150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:10.035150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:10.035150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:10.035150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:10.035150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:10.035150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 245/489] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:10.035150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d3b0a-96e3-442d-ae02-2b1280ca9d1e None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:10.130086 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecfc64-f9c6-424a-b1a9-96ba22dd8233 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:10.136236 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d3b0a-96e3-442d-ae02-2b1280ca9d1e None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:10.163610 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034a207-e7a0-4f86-8e3a-d0c378cbd732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:10.164403 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034a207-e7a0-4f86-8e3a-d0c378cbd732 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.164681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034a207-e7a0-4f86-8e3a-d0c378cbd732 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.164954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034a207-e7a0-4f86-8e3a-d0c378cbd732 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.171041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b33ea8-90ce-4c57-b5af-58e27b1a3fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:10.171836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b33ea8-90ce-4c57-b5af-58e27b1a3fbb None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.172121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b33ea8-90ce-4c57-b5af-58e27b1a3fbb None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.172401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b33ea8-90ce-4c57-b5af-58e27b1a3fbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.176223 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034a207-e7a0-4f86-8e3a-d0c378cbd732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:10.183189 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b33ea8-90ce-4c57-b5af-58e27b1a3fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-3034a207-e7a0-4f86-8e3a-d0c378cbd732 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:10.184096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:10.186577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:10.188534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:10.188534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:10.188534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:10.188534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:10.188534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:10.188534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:10.188534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:10.188534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:10.188534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:10.188534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:10.188534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:10.188534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:10.189982 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b33ea8-90ce-4c57-b5af-58e27b1a3fbb None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:10.190125 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 245/490] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:10.198460 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034a207-e7a0-4f86-8e3a-d0c378cbd732 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:10.203345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-31b33ea8-90ce-4c57-b5af-58e27b1a3fbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:10.203345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:10.203345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:10.203345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:10.203345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:10.203345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:10.203345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:10.203345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:10.203345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:10.203345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:10.203345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:10.203345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:10.203345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:10.203345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:10.203345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:10.205246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:10.207735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:10.207735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:10.207735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:10.207735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:10.207735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 246/491] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:10.207735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b33ea8-90ce-4c57-b5af-58e27b1a3fbb None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:10.299412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034a207-e7a0-4f86-8e3a-d0c378cbd732 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:10.341136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b33ea8-90ce-4c57-b5af-58e27b1a3fbb None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:10.343512 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1ba69-14ce-4290-bb37-a9cea075b838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:10.345159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1ba69-14ce-4290-bb37-a9cea075b838 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.345445 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1ba69-14ce-4290-bb37-a9cea075b838 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.345725 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1ba69-14ce-4290-bb37-a9cea075b838 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.346534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1ba69-14ce-4290-bb37-a9cea075b838 None admin] RBAC: Adding query filter params (name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:10.346843 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1ba69-14ce-4290-bb37-a9cea075b838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:10.348634 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1ba69-14ce-4290-bb37-a9cea075b838 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:10.369773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 246/492] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:10.372245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1ba69-14ce-4290-bb37-a9cea075b838 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:10.380679 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7347ac-8a24-4a48-b332-30b7040866df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:10.381512 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7347ac-8a24-4a48-b332-30b7040866df None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.381888 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7347ac-8a24-4a48-b332-30b7040866df None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.382285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7347ac-8a24-4a48-b332-30b7040866df None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.383145 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7347ac-8a24-4a48-b332-30b7040866df None admin] RBAC: Adding query filter params (name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:10.383553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7347ac-8a24-4a48-b332-30b7040866df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:10.385052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7347ac-8a24-4a48-b332-30b7040866df None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:10.399195 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 247/493] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:10.400233 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7347ac-8a24-4a48-b332-30b7040866df None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:10.489554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1ba69-14ce-4290-bb37-a9cea075b838 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:10.505987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7347ac-8a24-4a48-b332-30b7040866df None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:10.525099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164c09f-50c5-4f7e-8c9c-0f911589b69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:10.525756 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164c09f-50c5-4f7e-8c9c-0f911589b69c None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.526035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164c09f-50c5-4f7e-8c9c-0f911589b69c None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.526341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164c09f-50c5-4f7e-8c9c-0f911589b69c None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.527064 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164c09f-50c5-4f7e-8c9c-0f911589b69c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:10.527494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164c09f-50c5-4f7e-8c9c-0f911589b69c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:10.528884 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164c09f-50c5-4f7e-8c9c-0f911589b69c None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:10.540191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 247/494] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:10.541069 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164c09f-50c5-4f7e-8c9c-0f911589b69c None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:10.545726 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bc0ba-60c9-42ed-a91b-5d41324b1738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:10.546563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bc0ba-60c9-42ed-a91b-5d41324b1738 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.546851 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bc0ba-60c9-42ed-a91b-5d41324b1738 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.547129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bc0ba-60c9-42ed-a91b-5d41324b1738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.557944 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bc0ba-60c9-42ed-a91b-5d41324b1738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:10.559994 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bc0ba-60c9-42ed-a91b-5d41324b1738 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:10.577712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-b55bc0ba-60c9-42ed-a91b-5d41324b1738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:10.577712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:10.577712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:10.577712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:10.577712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:10.577712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:10.577712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:10.577712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:10.577712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:10.577712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:10.577712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:10.577712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:10.577712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:10.577712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:10.577712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:10.579830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:10.586486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:10.586486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:10.586486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:10.586486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:10.586486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 248/495] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:10.586486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a275d-4e57-4b48-820b-0bb3df2e3300 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.586486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a275d-4e57-4b48-820b-0bb3df2e3300 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.586486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a275d-4e57-4b48-820b-0bb3df2e3300 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.586486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 249/496] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:10.587587 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a275d-4e57-4b48-820b-0bb3df2e3300 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:10.639145 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164c09f-50c5-4f7e-8c9c-0f911589b69c None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:10.670772 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2488877-7aee-4a83-a6c5-3dcac90ec15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:10.671555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2488877-7aee-4a83-a6c5-3dcac90ec15f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.671837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2488877-7aee-4a83-a6c5-3dcac90ec15f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.672114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2488877-7aee-4a83-a6c5-3dcac90ec15f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.680087 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a275d-4e57-4b48-820b-0bb3df2e3300 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:10.681578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2488877-7aee-4a83-a6c5-3dcac90ec15f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:10.683075 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2488877-7aee-4a83-a6c5-3dcac90ec15f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:10.709461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-e2488877-7aee-4a83-a6c5-3dcac90ec15f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:10.709461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:10.709461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:10.709461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:10.709461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:10.709461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:10.709461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:10.709461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:10.709461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:10.709461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:10.709461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:10.709461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:10.709461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:10.709461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:10.709461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:10.710394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:10.711272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:10.711272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:10.711272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:10.711272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:10.711272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 248/497] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:10.711944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dc2f1-83aa-4584-a27d-15e32f75464d None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.712212 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dc2f1-83aa-4584-a27d-15e32f75464d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.712486 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dc2f1-83aa-4584-a27d-15e32f75464d None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.713883 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 249/498] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:10.714452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61dc2f1-83aa-4584-a27d-15e32f75464d None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:10.718493 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9614249-f8ca-4c33-b5a3-a7319b152244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:10.719438 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9614249-f8ca-4c33-b5a3-a7319b152244 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.719720 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9614249-f8ca-4c33-b5a3-a7319b152244 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.719995 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9614249-f8ca-4c33-b5a3-a7319b152244 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.728052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9614249-f8ca-4c33-b5a3-a7319b152244 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:10.729499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9614249-f8ca-4c33-b5a3-a7319b152244 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-f9614249-f8ca-4c33-b5a3-a7319b152244 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:10.745036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:10.746623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:10.747634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:10.747634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:10.747634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:10.747634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:10.747634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:10.747634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:10.747634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:10.747634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:10.747634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 14:18:10.747634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:10.747634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 250/499] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 14:18:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:10.748202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdecc72-0321-44ab-a61f-b0c87fd2eeef None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.748269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdecc72-0321-44ab-a61f-b0c87fd2eeef None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.748496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdecc72-0321-44ab-a61f-b0c87fd2eeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.767133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-dcdecc72-0321-44ab-a61f-b0c87fd2eeef None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:10.768328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-dcdecc72-0321-44ab-a61f-b0c87fd2eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:10.819136 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61dc2f1-83aa-4584-a27d-15e32f75464d None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:10.833808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 251/500] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:10.834659 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdecc72-0321-44ab-a61f-b0c87fd2eeef None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:10.855027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20338f96-df16-4499-9ddc-a129c33056d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:10.856458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20338f96-df16-4499-9ddc-a129c33056d0 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.856865 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20338f96-df16-4499-9ddc-a129c33056d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.857229 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20338f96-df16-4499-9ddc-a129c33056d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.857956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20338f96-df16-4499-9ddc-a129c33056d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:10.858299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20338f96-df16-4499-9ddc-a129c33056d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:10.859681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20338f96-df16-4499-9ddc-a129c33056d0 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:10.870723 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 250/501] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:10.872023 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d7820-698b-4398-86d4-ab19e30c9471 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.872363 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d7820-698b-4398-86d4-ab19e30c9471 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.872643 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d7820-698b-4398-86d4-ab19e30c9471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.888808 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-7c7d7820-698b-4398-86d4-ab19e30c9471 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:10.890010 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7c7d7820-698b-4398-86d4-ab19e30c9471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:10.940976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdecc72-0321-44ab-a61f-b0c87fd2eeef None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:10.952627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 251/502] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:10.953447 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d7820-698b-4398-86d4-ab19e30c9471 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:10.975466 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd5ab8-f431-4c32-ae6f-af45362277ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:10.976205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd5ab8-f431-4c32-ae6f-af45362277ae None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:10.976492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd5ab8-f431-4c32-ae6f-af45362277ae None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:10.976772 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd5ab8-f431-4c32-ae6f-af45362277ae None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:10.977496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd5ab8-f431-4c32-ae6f-af45362277ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:10.977805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd5ab8-f431-4c32-ae6f-af45362277ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:10.979226 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd5ab8-f431-4c32-ae6f-af45362277ae None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:10.990753 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 252/503] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:10.991545 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd5ab8-f431-4c32-ae6f-af45362277ae None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:11.048102 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d7820-698b-4398-86d4-ab19e30c9471 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:11.080271 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde54ce-876f-4fe0-bad6-b6a288bd3634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:11.081122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde54ce-876f-4fe0-bad6-b6a288bd3634 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:11.081413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde54ce-876f-4fe0-bad6-b6a288bd3634 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:11.081689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde54ce-876f-4fe0-bad6-b6a288bd3634 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:11.082552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde54ce-876f-4fe0-bad6-b6a288bd3634 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:11.082862 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde54ce-876f-4fe0-bad6-b6a288bd3634 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:11.084289 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde54ce-876f-4fe0-bad6-b6a288bd3634 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:11.087661 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd5ab8-f431-4c32-ae6f-af45362277ae None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:11.120635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 252/504] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 14:18:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:11.121579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde54ce-876f-4fe0-bad6-b6a288bd3634 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:11.126734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cbcf6-8639-47bf-b189-a314cf1ae9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:11.127523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cbcf6-8639-47bf-b189-a314cf1ae9b8 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:11.127797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cbcf6-8639-47bf-b189-a314cf1ae9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:11.128062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cbcf6-8639-47bf-b189-a314cf1ae9b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:11.138594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cbcf6-8639-47bf-b189-a314cf1ae9b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-a83cbcf6-8639-47bf-b189-a314cf1ae9b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:11.146130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:11.147045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:11.148085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:11.148085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:11.148085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:11.148085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:11.148085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:11.148085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:11.148085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:11.148085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:11.148085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:11.148085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:11.148085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:11.148085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:11.148085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 253/505] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:11.149176 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cbcf6-8639-47bf-b189-a314cf1ae9b8 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:11.223441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde54ce-876f-4fe0-bad6-b6a288bd3634 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:11.243926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cbcf6-8639-47bf-b189-a314cf1ae9b8 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:11.256519 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba8e8d-a6ca-4d9e-b0cc-b093b19febdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:11.257310 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba8e8d-a6ca-4d9e-b0cc-b093b19febdf None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:11.257586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba8e8d-a6ca-4d9e-b0cc-b093b19febdf None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:11.257855 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba8e8d-a6ca-4d9e-b0cc-b093b19febdf None admin] PATH_INFO: `/v3/users/glance` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:11.264692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba8e8d-a6ca-4d9e-b0cc-b093b19febdf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:11.266133 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba8e8d-a6ca-4d9e-b0cc-b093b19febdf None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:11.276757 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb1cb8-2030-4f7c-9e8b-26ce9438d3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:11.278037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb1cb8-2030-4f7c-9e8b-26ce9438d3c3 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:11.278343 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb1cb8-2030-4f7c-9e8b-26ce9438d3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:11.278613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb1cb8-2030-4f7c-9e8b-26ce9438d3c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-b4ba8e8d-a6ca-4d9e-b0cc-b093b19febdf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:11.282164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:11.283058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:11.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:11.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:11.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:11.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:11.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:11.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:11.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:11.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:11.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 14:18:11.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:11.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 253/506] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:18:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:11.284514 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba8e8d-a6ca-4d9e-b0cc-b093b19febdf None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:11.289498 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb1cb8-2030-4f7c-9e8b-26ce9438d3c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:11.290976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb1cb8-2030-4f7c-9e8b-26ce9438d3c3 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:11.307471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-17bb1cb8-2030-4f7c-9e8b-26ce9438d3c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:11.307471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:11.307471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:11.307471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:11.307471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:11.307471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:11.307471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:11.307471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:11.307471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:11.307471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:11.307471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:11.307471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:11.307471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:11.307471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:11.307471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:11.309115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:11.315022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:11.315022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:11.315022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:11.315022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:11.315022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 254/507] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:11.315022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb1cb8-2030-4f7c-9e8b-26ce9438d3c3 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:11.381714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba8e8d-a6ca-4d9e-b0cc-b093b19febdf None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:11.401808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb1cb8-2030-4f7c-9e8b-26ce9438d3c3 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:11.413801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f16c20-a697-4bd4-ab44-08e87cacfb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:11.414626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f16c20-a697-4bd4-ab44-08e87cacfb85 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:11.414915 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f16c20-a697-4bd4-ab44-08e87cacfb85 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:11.415193 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f16c20-a697-4bd4-ab44-08e87cacfb85 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:11.422522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f16c20-a697-4bd4-ab44-08e87cacfb85 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:11.423977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f16c20-a697-4bd4-ab44-08e87cacfb85 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:11.434157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91538b36-59fe-4aaf-987c-a8abcdc3509a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:11.434829 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91538b36-59fe-4aaf-987c-a8abcdc3509a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:11.435106 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91538b36-59fe-4aaf-987c-a8abcdc3509a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:11.435379 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91538b36-59fe-4aaf-987c-a8abcdc3509a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-d5f16c20-a697-4bd4-ab44-08e87cacfb85 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:11.438027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:11.438957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:11.444638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:11.444638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:11.444638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:11.444638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:11.444638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:11.444638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:11.444638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:11.444638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:11.444638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 14:18:11.444638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:11.444638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 254/508] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:18:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:11.444638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f16c20-a697-4bd4-ab44-08e87cacfb85 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:11.500991 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91538b36-59fe-4aaf-987c-a8abcdc3509a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:11.502493 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91538b36-59fe-4aaf-987c-a8abcdc3509a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:11.538126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f16c20-a697-4bd4-ab44-08e87cacfb85 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:11.569891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a86022-e5e2-46f3-9341-246d04393ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:11.570581 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a86022-e5e2-46f3-9341-246d04393ec2 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:11.570864 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a86022-e5e2-46f3-9341-246d04393ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:11.571137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a86022-e5e2-46f3-9341-246d04393ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:11.571881 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a86022-e5e2-46f3-9341-246d04393ec2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:11.572188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a86022-e5e2-46f3-9341-246d04393ec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:11.573558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a86022-e5e2-46f3-9341-246d04393ec2 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:11.581604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 255/509] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:11.582420 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a86022-e5e2-46f3-9341-246d04393ec2 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:11.601494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 255/510] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:18:11.602371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91538b36-59fe-4aaf-987c-a8abcdc3509a None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:11.680167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a86022-e5e2-46f3-9341-246d04393ec2 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:11.695093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91538b36-59fe-4aaf-987c-a8abcdc3509a None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:11.712754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a560b4b-b177-4871-83c8-b9b1fb525793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:11.713408 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a560b4b-b177-4871-83c8-b9b1fb525793 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:11.713691 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a560b4b-b177-4871-83c8-b9b1fb525793 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:11.713966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a560b4b-b177-4871-83c8-b9b1fb525793 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:11.715950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a560b4b-b177-4871-83c8-b9b1fb525793 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:11.716268 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a560b4b-b177-4871-83c8-b9b1fb525793 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:11.717721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a560b4b-b177-4871-83c8-b9b1fb525793 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:11.728081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c819d55-2c0b-461e-a4f4-c20bf9ec42e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:11.728729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c819d55-2c0b-461e-a4f4-c20bf9ec42e1 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:11.729005 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c819d55-2c0b-461e-a4f4-c20bf9ec42e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:11.729274 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c819d55-2c0b-461e-a4f4-c20bf9ec42e1 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:11.729980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c819d55-2c0b-461e-a4f4-c20bf9ec42e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:11.730363 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c819d55-2c0b-461e-a4f4-c20bf9ec42e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:11.734428 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c819d55-2c0b-461e-a4f4-c20bf9ec42e1 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:11.739488 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 256/511] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 17 14:18:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:11.739488 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a560b4b-b177-4871-83c8-b9b1fb525793 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:11.745631 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 256/512] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:11.746574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c819d55-2c0b-461e-a4f4-c20bf9ec42e1 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:11.831285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a560b4b-b177-4871-83c8-b9b1fb525793 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:11.845789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c819d55-2c0b-461e-a4f4-c20bf9ec42e1 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:11.863353 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8f4ae-b4fc-49b6-b525-1721af41fe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:11.864013 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8f4ae-b4fc-49b6-b525-1721af41fe0d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:11.864296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8f4ae-b4fc-49b6-b525-1721af41fe0d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:11.864571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8f4ae-b4fc-49b6-b525-1721af41fe0d None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:11.865471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8f4ae-b4fc-49b6-b525-1721af41fe0d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:11.865710 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8f4ae-b4fc-49b6-b525-1721af41fe0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:11.867196 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8f4ae-b4fc-49b6-b525-1721af41fe0d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:11.878006 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2abb0a-86d0-4e41-842d-164cf08d933c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:11.878878 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2abb0a-86d0-4e41-842d-164cf08d933c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:11.879158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2abb0a-86d0-4e41-842d-164cf08d933c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:11.879432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2abb0a-86d0-4e41-842d-164cf08d933c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:11.883503 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 257/513] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 17 14:18:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:11.884297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8f4ae-b4fc-49b6-b525-1721af41fe0d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:11.890948 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2abb0a-86d0-4e41-842d-164cf08d933c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:11.892412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2abb0a-86d0-4e41-842d-164cf08d933c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:11.909665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-be2abb0a-86d0-4e41-842d-164cf08d933c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:11.909665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:11.909665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:11.909665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:11.909665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:11.909665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:11.909665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:11.909665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:11.909665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:11.909665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:11.909665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:11.909665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:11.909665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:11.909665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:11.909665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:11.910609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:11.911436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:11.911436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:11.911436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:11.911436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:11.911436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 257/514] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:11.911702 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2abb0a-86d0-4e41-842d-164cf08d933c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:11.982342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8f4ae-b4fc-49b6-b525-1721af41fe0d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:12.008535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2abb0a-86d0-4e41-842d-164cf08d933c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:12.014860 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3404b-e920-45bc-b643-3c00dcea28a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:12.015661 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3404b-e920-45bc-b643-3c00dcea28a2 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:12.015935 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3404b-e920-45bc-b643-3c00dcea28a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:12.016203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3404b-e920-45bc-b643-3c00dcea28a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:12.025566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3404b-e920-45bc-b643-3c00dcea28a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:12.027048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3404b-e920-45bc-b643-3c00dcea28a2 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:12.041832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17661c82-fd73-4303-bbe3-d89696409a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:12.042492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17661c82-fd73-4303-bbe3-d89696409a8a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:12.042800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17661c82-fd73-4303-bbe3-d89696409a8a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:12.043509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17661c82-fd73-4303-bbe3-d89696409a8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:12.044288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-5eb3404b-e920-45bc-b643-3c00dcea28a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:12.044288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:12.044288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:12.044288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:12.044288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:12.044288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:12.044288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:12.044288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:12.044288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:12.044288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:12.044288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:12.044288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:12.044288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:12.044288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:12.044288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:12.045278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:12.046236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:12.046236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:12.046236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:12.046236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:12.046236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 258/515] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:12.046497 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3404b-e920-45bc-b643-3c00dcea28a2 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:12.110814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17661c82-fd73-4303-bbe3-d89696409a8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:12.112265 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17661c82-fd73-4303-bbe3-d89696409a8a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:12.142507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3404b-e920-45bc-b643-3c00dcea28a2 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:12.174723 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea69e5-6ab1-4f8f-a658-093ce7421791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:12.175381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea69e5-6ab1-4f8f-a658-093ce7421791 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:12.175663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea69e5-6ab1-4f8f-a658-093ce7421791 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:12.175938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea69e5-6ab1-4f8f-a658-093ce7421791 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:12.176631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea69e5-6ab1-4f8f-a658-093ce7421791 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:12.178061 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea69e5-6ab1-4f8f-a658-093ce7421791 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:12.198288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 259/516] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:18:12 2022] POST /identity/v3/users => generated 247 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:18:12.198563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea69e5-6ab1-4f8f-a658-093ce7421791 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:12.222501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 258/517] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:18:12.223480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17661c82-fd73-4303-bbe3-d89696409a8a None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:12.307957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea69e5-6ab1-4f8f-a658-093ce7421791 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:12.340728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17661c82-fd73-4303-bbe3-d89696409a8a None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:12.345907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fe970-f24b-4dc9-823e-b96d772ac30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:12.346645 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fe970-f24b-4dc9-823e-b96d772ac30a None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:12.346933 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fe970-f24b-4dc9-823e-b96d772ac30a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:12.347207 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fe970-f24b-4dc9-823e-b96d772ac30a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:12.377382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb2412-ae21-43a8-8f7d-5a0fefce32d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:12.380445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb2412-ae21-43a8-8f7d-5a0fefce32d0 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:12.380445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb2412-ae21-43a8-8f7d-5a0fefce32d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:12.380445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb2412-ae21-43a8-8f7d-5a0fefce32d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:12.380445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb2412-ae21-43a8-8f7d-5a0fefce32d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:12.380445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb2412-ae21-43a8-8f7d-5a0fefce32d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:12.381599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb2412-ae21-43a8-8f7d-5a0fefce32d0 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:12.393513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 259/518] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:12.394463 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb2412-ae21-43a8-8f7d-5a0fefce32d0 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:12.423094 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fe970-f24b-4dc9-823e-b96d772ac30a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:12.424914 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fe970-f24b-4dc9-823e-b96d772ac30a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:12.495779 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb2412-ae21-43a8-8f7d-5a0fefce32d0 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:12.524304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 260/519] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:18:12.525473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fe970-f24b-4dc9-823e-b96d772ac30a None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:12.530914 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc0f48-d319-4e29-a34c-19afc6990f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:12.531584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc0f48-d319-4e29-a34c-19afc6990f2b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:12.531867 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc0f48-d319-4e29-a34c-19afc6990f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:12.532144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc0f48-d319-4e29-a34c-19afc6990f2b None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:12.532868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc0f48-d319-4e29-a34c-19afc6990f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:12.533174 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc0f48-d319-4e29-a34c-19afc6990f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:12.534611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc0f48-d319-4e29-a34c-19afc6990f2b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:12.546907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 260/520] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:12.547726 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc0f48-d319-4e29-a34c-19afc6990f2b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:12.626861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fe970-f24b-4dc9-823e-b96d772ac30a None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:12.648685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc0f48-d319-4e29-a34c-19afc6990f2b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:12.660418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9b45b-58e5-441e-a5e1-2b2af20dce3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:12.661205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9b45b-58e5-441e-a5e1-2b2af20dce3d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:12.661479 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9b45b-58e5-441e-a5e1-2b2af20dce3d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:12.661747 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9b45b-58e5-441e-a5e1-2b2af20dce3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:12.671765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9b45b-58e5-441e-a5e1-2b2af20dce3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:12.673508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9b45b-58e5-441e-a5e1-2b2af20dce3d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:12.682474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01d024-b0d0-40fa-bbbd-b7c5e0a3f492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:12.683263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01d024-b0d0-40fa-bbbd-b7c5e0a3f492 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:12.683572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01d024-b0d0-40fa-bbbd-b7c5e0a3f492 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:12.683846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01d024-b0d0-40fa-bbbd-b7c5e0a3f492 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:12.690847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01d024-b0d0-40fa-bbbd-b7c5e0a3f492 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:12.692295 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01d024-b0d0-40fa-bbbd-b7c5e0a3f492 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:12.692850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-3ce9b45b-58e5-441e-a5e1-2b2af20dce3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:12.692850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:12.692850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:12.692850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:12.692850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:12.692850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:12.692850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:12.692850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:12.692850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:12.692850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:12.692850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:12.692850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:12.692850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:12.692850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:12.692850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:12.693681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:12.699975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:12.699975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:12.699975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:12.699975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:12.699975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 261/521] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:12.699975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9b45b-58e5-441e-a5e1-2b2af20dce3d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-1e01d024-b0d0-40fa-bbbd-b7c5e0a3f492 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:12.707911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:12.708799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:12.710079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:12.710079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:12.710079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:12.710079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:12.710079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:12.710079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:12.710079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:12.710079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:12.710079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 14:18:12.710079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:12.713615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 261/522] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:12.714272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01d024-b0d0-40fa-bbbd-b7c5e0a3f492 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:12.794778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9b45b-58e5-441e-a5e1-2b2af20dce3d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:12.813417 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01d024-b0d0-40fa-bbbd-b7c5e0a3f492 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:12.828899 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf9559-226c-4dcf-8ec3-d452cc1368c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:12.829680 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf9559-226c-4dcf-8ec3-d452cc1368c2 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:12.829957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf9559-226c-4dcf-8ec3-d452cc1368c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:12.830251 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf9559-226c-4dcf-8ec3-d452cc1368c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:12.840765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf9559-226c-4dcf-8ec3-d452cc1368c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:12.842226 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf9559-226c-4dcf-8ec3-d452cc1368c2 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:12.848451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf39bec-fb23-4066-a871-73cc188c8459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:12.849246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf39bec-fb23-4066-a871-73cc188c8459 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:12.849530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf39bec-fb23-4066-a871-73cc188c8459 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:12.849805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf39bec-fb23-4066-a871-73cc188c8459 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:12.856536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf39bec-fb23-4066-a871-73cc188c8459 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:12.857981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf39bec-fb23-4066-a871-73cc188c8459 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:12.860106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-9ecf9559-226c-4dcf-8ec3-d452cc1368c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:12.860106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:12.860106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:12.860106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:12.860106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:12.860106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:12.860106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:12.860106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:12.860106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:12.860106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:12.860106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:12.860106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:12.860106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:12.860106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:12.860106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:12.860905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:12.861755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:12.861755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:12.861755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:12.861755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:12.863651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 262/523] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:12.864597 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf9559-226c-4dcf-8ec3-d452cc1368c2 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:12.873351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-ecf39bec-fb23-4066-a871-73cc188c8459 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:12.873351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:12.873351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:12.873351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:12.873351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:12.873351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:12.873351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:12.873351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:12.873351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:12.873351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:12.873351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:12.873351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:12.873351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:12.873351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:12.873351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:12.874401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:12.876745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:12.876745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:12.876745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:12.876745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:12.876745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:12.876745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:12.876745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:12.876745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:12.876745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 262/524] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:12.876745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf39bec-fb23-4066-a871-73cc188c8459 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:12.965699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf9559-226c-4dcf-8ec3-d452cc1368c2 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:12.975372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf39bec-fb23-4066-a871-73cc188c8459 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:12.998368 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a40e5-9c95-414c-87eb-0c2358797f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:12.999036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a40e5-9c95-414c-87eb-0c2358797f16 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:12.999347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a40e5-9c95-414c-87eb-0c2358797f16 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:12.999623 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a40e5-9c95-414c-87eb-0c2358797f16 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:13.000421 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a40e5-9c95-414c-87eb-0c2358797f16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:13.000731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a40e5-9c95-414c-87eb-0c2358797f16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:13.002164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a40e5-9c95-414c-87eb-0c2358797f16 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:13.009396 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d3315-b5e2-479a-a7ef-1052f7931a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:13.010067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d3315-b5e2-479a-a7ef-1052f7931a0a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:13.010372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d3315-b5e2-479a-a7ef-1052f7931a0a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:13.010650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d3315-b5e2-479a-a7ef-1052f7931a0a None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:13.011510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d3315-b5e2-479a-a7ef-1052f7931a0a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:13.011843 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d3315-b5e2-479a-a7ef-1052f7931a0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:13.013259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d3315-b5e2-479a-a7ef-1052f7931a0a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:13.018686 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 263/525] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:13.018686 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a40e5-9c95-414c-87eb-0c2358797f16 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:13.061072 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 263/526] 10.222.0.48 () {56 vars in 1139 bytes} [Tue May 17 14:18:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:13.062374 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d3315-b5e2-479a-a7ef-1052f7931a0a None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:13.125980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a40e5-9c95-414c-87eb-0c2358797f16 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:13.161801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d8311-e82d-423d-a3f4-0da7c2b03783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:13.162843 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d8311-e82d-423d-a3f4-0da7c2b03783 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:13.163131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d8311-e82d-423d-a3f4-0da7c2b03783 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:13.163406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d8311-e82d-423d-a3f4-0da7c2b03783 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:13.164129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d8311-e82d-423d-a3f4-0da7c2b03783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:13.164454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d8311-e82d-423d-a3f4-0da7c2b03783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:13.165799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d8311-e82d-423d-a3f4-0da7c2b03783 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:13.169097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d3315-b5e2-479a-a7ef-1052f7931a0a None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:13.181245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 264/527] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:13.181245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d8311-e82d-423d-a3f4-0da7c2b03783 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:13.206442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc611e2-b683-4916-977d-b7d758596c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:13.207102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc611e2-b683-4916-977d-b7d758596c68 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:13.207384 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc611e2-b683-4916-977d-b7d758596c68 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:13.207653 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc611e2-b683-4916-977d-b7d758596c68 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:13.208429 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc611e2-b683-4916-977d-b7d758596c68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:13.208733 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc611e2-b683-4916-977d-b7d758596c68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:13.210194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc611e2-b683-4916-977d-b7d758596c68 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:13.228216 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 264/528] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:13.229066 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc611e2-b683-4916-977d-b7d758596c68 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:13.288005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d8311-e82d-423d-a3f4-0da7c2b03783 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:13.321471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee8718-2ff6-4c8e-b891-c40028805d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:13.322335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8718-2ff6-4c8e-b891-c40028805d05 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:13.322548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8718-2ff6-4c8e-b891-c40028805d05 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:13.322821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8718-2ff6-4c8e-b891-c40028805d05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:13.328256 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc611e2-b683-4916-977d-b7d758596c68 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:13.329474 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee8718-2ff6-4c8e-b891-c40028805d05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:13.331215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee8718-2ff6-4c8e-b891-c40028805d05 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:13.345155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-8eee8718-2ff6-4c8e-b891-c40028805d05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:13.345155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:13.345155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:13.345155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:13.345155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:13.345155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:13.345155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:13.345155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:13.345155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:13.345155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:13.345155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:13.345155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:13.345155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:13.345155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:13.345155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:13.346021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:13.347206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:13.347206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:13.347206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:13.347206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:13.347206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:13.347206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:13.347206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:13.347206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:13.347206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 265/529] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:13.347206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee8718-2ff6-4c8e-b891-c40028805d05 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:13.367253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3147dd-d233-4e53-94f8-82f79b0386d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:13.368056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3147dd-d233-4e53-94f8-82f79b0386d3 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:13.368338 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3147dd-d233-4e53-94f8-82f79b0386d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:13.368942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3147dd-d233-4e53-94f8-82f79b0386d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:13.440142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3147dd-d233-4e53-94f8-82f79b0386d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:13.441611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3147dd-d233-4e53-94f8-82f79b0386d3 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:13.451547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee8718-2ff6-4c8e-b891-c40028805d05 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:13.486687 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d2321-1523-4e71-ac23-0407c4393797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:13.487440 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d2321-1523-4e71-ac23-0407c4393797 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:13.487679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d2321-1523-4e71-ac23-0407c4393797 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:13.487956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d2321-1523-4e71-ac23-0407c4393797 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:13.494989 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d2321-1523-4e71-ac23-0407c4393797 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:13.496861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d2321-1523-4e71-ac23-0407c4393797 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:13.512950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-fb8d2321-1523-4e71-ac23-0407c4393797 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:13.512950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:13.512950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:13.512950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:13.512950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:13.512950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:13.512950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:13.512950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:13.512950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:13.512950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:13.512950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:13.512950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:13.512950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:13.512950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:13.512950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:13.513966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:13.515429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:13.515429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:13.515429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:13.515429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:13.515429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:13.515429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:13.515429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:13.515429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:13.518571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 266/530] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:13.519665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d2321-1523-4e71-ac23-0407c4393797 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:13.549823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 265/531] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:18:13.549823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3147dd-d233-4e53-94f8-82f79b0386d3 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:13.616534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d2321-1523-4e71-ac23-0407c4393797 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:13.646507 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3147dd-d233-4e53-94f8-82f79b0386d3 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:13.650229 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede16558-d2e0-4283-a0c2-dbe074dca995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:13.650891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede16558-d2e0-4283-a0c2-dbe074dca995 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:13.651174 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede16558-d2e0-4283-a0c2-dbe074dca995 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:13.651449 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede16558-d2e0-4283-a0c2-dbe074dca995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:13.652829 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede16558-d2e0-4283-a0c2-dbe074dca995 None admin] RBAC: Adding query filter params (role.id=4aa22f352696432bbf8fcd9d74ba0dc7, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=1f443d2ca1534249bb2c4096300ddffd) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:13.653139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede16558-d2e0-4283-a0c2-dbe074dca995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:13.654623 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede16558-d2e0-4283-a0c2-dbe074dca995 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:13.670555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 267/532] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:13 2022] GET /identity/v3/role_assignments?user.id=1f443d2ca1534249bb2c4096300ddffd&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=4aa22f352696432bbf8fcd9d74ba0dc7 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:13.670555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede16558-d2e0-4283-a0c2-dbe074dca995 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:13.684140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413de68-d985-47e3-b9bf-31c5cee6c60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:13.684824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413de68-d985-47e3-b9bf-31c5cee6c60b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:13.685094 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413de68-d985-47e3-b9bf-31c5cee6c60b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:13.685364 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413de68-d985-47e3-b9bf-31c5cee6c60b None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:13.686259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413de68-d985-47e3-b9bf-31c5cee6c60b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:13.686571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413de68-d985-47e3-b9bf-31c5cee6c60b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:13.688120 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413de68-d985-47e3-b9bf-31c5cee6c60b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:13.707091 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 266/533] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:13.708090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413de68-d985-47e3-b9bf-31c5cee6c60b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:13.779318 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede16558-d2e0-4283-a0c2-dbe074dca995 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:13.815976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb86eed-6b27-4e7d-92b2-bfc720cc29e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:13.816675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb86eed-6b27-4e7d-92b2-bfc720cc29e7 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:13.816959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb86eed-6b27-4e7d-92b2-bfc720cc29e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:13.817238 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb86eed-6b27-4e7d-92b2-bfc720cc29e7 None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:13.818044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413de68-d985-47e3-b9bf-31c5cee6c60b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:13.818152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb86eed-6b27-4e7d-92b2-bfc720cc29e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:13.818390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb86eed-6b27-4e7d-92b2-bfc720cc29e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:13.819878 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb86eed-6b27-4e7d-92b2-bfc720cc29e7 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:13.839475 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 268/534] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:13.840845 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb86eed-6b27-4e7d-92b2-bfc720cc29e7 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:13.855421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ed97f-77fb-4c8b-9a95-1dc04ac199e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:13.856238 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ed97f-77fb-4c8b-9a95-1dc04ac199e4 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:13.856518 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ed97f-77fb-4c8b-9a95-1dc04ac199e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:13.856794 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ed97f-77fb-4c8b-9a95-1dc04ac199e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:13.869315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ed97f-77fb-4c8b-9a95-1dc04ac199e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:13.871560 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ed97f-77fb-4c8b-9a95-1dc04ac199e4 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:13.890152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-3c4ed97f-77fb-4c8b-9a95-1dc04ac199e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:13.890152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:13.890152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:13.890152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:13.890152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:13.890152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:13.890152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:13.890152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:13.890152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:13.890152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:13.890152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:13.890152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:13.890152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:13.890152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:13.890152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:13.891551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:13.892387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:13.892387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:13.892387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:13.892387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:13.892387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 267/535] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:13.892643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ed97f-77fb-4c8b-9a95-1dc04ac199e4 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:13.971288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb86eed-6b27-4e7d-92b2-bfc720cc29e7 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:14.006224 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c833e-a9af-43c6-9c9d-25768164f31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:14.006969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c833e-a9af-43c6-9c9d-25768164f31a None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:14.007254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c833e-a9af-43c6-9c9d-25768164f31a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:14.007533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c833e-a9af-43c6-9c9d-25768164f31a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:14.008368 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c833e-a9af-43c6-9c9d-25768164f31a None admin] RBAC: Adding query filter params (role.id=4aa22f352696432bbf8fcd9d74ba0dc7, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=f34ff47d8c4f4d99955340ddbdc3d475) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:14.008765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c833e-a9af-43c6-9c9d-25768164f31a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:14.010354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c833e-a9af-43c6-9c9d-25768164f31a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:14.011285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ed97f-77fb-4c8b-9a95-1dc04ac199e4 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:14.022498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 269/536] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:13 2022] GET /identity/v3/role_assignments?user.id=f34ff47d8c4f4d99955340ddbdc3d475&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=4aa22f352696432bbf8fcd9d74ba0dc7 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:14.023504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c833e-a9af-43c6-9c9d-25768164f31a None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:14.056575 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973ddd6-332b-4e04-bd33-34e9758bdc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:14.057177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973ddd6-332b-4e04-bd33-34e9758bdc61 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:14.057462 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973ddd6-332b-4e04-bd33-34e9758bdc61 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:14.058451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973ddd6-332b-4e04-bd33-34e9758bdc61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:14.061972 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973ddd6-332b-4e04-bd33-34e9758bdc61 None admin] RBAC: Adding query filter params (role.id=4aa22f352696432bbf8fcd9d74ba0dc7, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=f7fd6429fee94c89a6a29467b014ec5f) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:14.062326 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973ddd6-332b-4e04-bd33-34e9758bdc61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:14.063848 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973ddd6-332b-4e04-bd33-34e9758bdc61 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:14.079745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 268/537] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:13 2022] GET /identity/v3/role_assignments?user.id=f7fd6429fee94c89a6a29467b014ec5f&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=4aa22f352696432bbf8fcd9d74ba0dc7 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:14.195603 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c833e-a9af-43c6-9c9d-25768164f31a None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:14.245664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0fdb7-5e4e-4720-9b10-9dc3a19d8400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:14.246435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0fdb7-5e4e-4720-9b10-9dc3a19d8400 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:14.246719 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0fdb7-5e4e-4720-9b10-9dc3a19d8400 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:14.246996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0fdb7-5e4e-4720-9b10-9dc3a19d8400 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:14.247753 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0fdb7-5e4e-4720-9b10-9dc3a19d8400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:14.251408 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0fdb7-5e4e-4720-9b10-9dc3a19d8400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:14.259722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0fdb7-5e4e-4720-9b10-9dc3a19d8400 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:14.278154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 270/538] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:14.284316 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973ddd6-332b-4e04-bd33-34e9758bdc61 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:14.425111 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973ddd6-332b-4e04-bd33-34e9758bdc61 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:14.470760 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0cc31-ee76-47ee-a21c-e2b3c8b112e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:14.471567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0cc31-ee76-47ee-a21c-e2b3c8b112e0 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:14.471847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0cc31-ee76-47ee-a21c-e2b3c8b112e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:14.472121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0cc31-ee76-47ee-a21c-e2b3c8b112e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:14.479224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0cc31-ee76-47ee-a21c-e2b3c8b112e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:14.481798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0cc31-ee76-47ee-a21c-e2b3c8b112e0 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:14.497036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-cbe0cc31-ee76-47ee-a21c-e2b3c8b112e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:14.497036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:14.497036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:14.497036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:14.497036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:14.497036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:14.497036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:14.497036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:14.497036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:14.497036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:14.497036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:14.497036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:14.497036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:14.497036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:14.497036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:14.497912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:14.498775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:14.498775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:14.498775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:14.498775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:14.498775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:14.498775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:14.498775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:14.498775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:14.498775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 269/539] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:14.503864 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0fdb7-5e4e-4720-9b10-9dc3a19d8400 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:14.575272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf478b-af7d-4008-abca-5cc9944e91b8 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:14.575600 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf478b-af7d-4008-abca-5cc9944e91b8 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:14.575833 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf478b-af7d-4008-abca-5cc9944e91b8 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:14.581683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 270/540] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:18:14.587993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06affcee-14be-42b4-8402-b121be8f42d4 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:14.588332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06affcee-14be-42b4-8402-b121be8f42d4 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:14.588540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06affcee-14be-42b4-8402-b121be8f42d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:14.631296 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-06affcee-14be-42b4-8402-b121be8f42d4 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:14.632506 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-06affcee-14be-42b4-8402-b121be8f42d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:14.645477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0fdb7-5e4e-4720-9b10-9dc3a19d8400 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:14.680926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18921736-6e0e-45ba-958b-78a726716aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:14.682379 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18921736-6e0e-45ba-958b-78a726716aaf None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:14.682876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18921736-6e0e-45ba-958b-78a726716aaf None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:14.683455 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18921736-6e0e-45ba-958b-78a726716aaf None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:14.684455 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18921736-6e0e-45ba-958b-78a726716aaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:14.684954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18921736-6e0e-45ba-958b-78a726716aaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:14.687126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18921736-6e0e-45ba-958b-78a726716aaf None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:14.700110 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 271/541] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:14.706085 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18921736-6e0e-45ba-958b-78a726716aaf None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:14.796932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 271/542] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:14.818572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18921736-6e0e-45ba-958b-78a726716aaf None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:14.839564 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06affcee-14be-42b4-8402-b121be8f42d4 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:14.852986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75679767-7195-4f5b-b02a-aae2b2fc97c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:14.853975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75679767-7195-4f5b-b02a-aae2b2fc97c9 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:14.854487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75679767-7195-4f5b-b02a-aae2b2fc97c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:14.854953 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75679767-7195-4f5b-b02a-aae2b2fc97c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:14.856654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75679767-7195-4f5b-b02a-aae2b2fc97c9 None admin] RBAC: Adding query filter params (role.id=4aa22f352696432bbf8fcd9d74ba0dc7, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=7b03ca44da654c3a9a5d9762b8eee189) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:14.857199 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75679767-7195-4f5b-b02a-aae2b2fc97c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:14.858847 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75679767-7195-4f5b-b02a-aae2b2fc97c9 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:14.864953 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 272/543] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:14 2022] GET /identity/v3/role_assignments?user.id=7b03ca44da654c3a9a5d9762b8eee189&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=4aa22f352696432bbf8fcd9d74ba0dc7 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:15.024684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06affcee-14be-42b4-8402-b121be8f42d4 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:15.078956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d618d50-d761-4b45-a6d1-5146b053ab4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:15.079782 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d618d50-d761-4b45-a6d1-5146b053ab4b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:15.080061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d618d50-d761-4b45-a6d1-5146b053ab4b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:15.080333 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d618d50-d761-4b45-a6d1-5146b053ab4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:15.098654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d618d50-d761-4b45-a6d1-5146b053ab4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-0d618d50-d761-4b45-a6d1-5146b053ab4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:15.107368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:15.108304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:15.109097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:15.109097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:15.109097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:15.109097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:15.109097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:15.109097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:15.109097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:15.109097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:15.109097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:15.109097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:15.109097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:15.109097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:15.113117 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 272/544] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:15.114889 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75679767-7195-4f5b-b02a-aae2b2fc97c9 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:15.245151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75679767-7195-4f5b-b02a-aae2b2fc97c9 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:15.294466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f9298-e5fb-491e-8258-f66ba8404a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:15.295054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f9298-e5fb-491e-8258-f66ba8404a5b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:15.295334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f9298-e5fb-491e-8258-f66ba8404a5b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:15.295607 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f9298-e5fb-491e-8258-f66ba8404a5b None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:15.296347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f9298-e5fb-491e-8258-f66ba8404a5b None admin] RBAC: Adding query filter params (name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:15.296651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f9298-e5fb-491e-8258-f66ba8404a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:15.298009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f9298-e5fb-491e-8258-f66ba8404a5b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:15.309904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 273/545] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:15.315076 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d618d50-d761-4b45-a6d1-5146b053ab4b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:15.471105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d618d50-d761-4b45-a6d1-5146b053ab4b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:15.528569 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec2589-cd21-4462-8a62-706c387da17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:15.529400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec2589-cd21-4462-8a62-706c387da17a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:15.529683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec2589-cd21-4462-8a62-706c387da17a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:15.529961 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec2589-cd21-4462-8a62-706c387da17a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:15.545781 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec2589-cd21-4462-8a62-706c387da17a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:15.547187 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec2589-cd21-4462-8a62-706c387da17a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:15.570373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-48ec2589-cd21-4462-8a62-706c387da17a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:15.570373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:15.570373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:15.570373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:15.570373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:15.570373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:15.570373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:15.570373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:15.570373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:15.570373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:15.570373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:15.570373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:15.570373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:15.570373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:15.570373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:15.571283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:15.572567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:15.572567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:15.572567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:15.572567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:15.572567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 273/546] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:15.577584 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f9298-e5fb-491e-8258-f66ba8404a5b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:15.705015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f9298-e5fb-491e-8258-f66ba8404a5b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:15.741186 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa777c-dace-48e7-b150-4c885d380041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:15.741848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa777c-dace-48e7-b150-4c885d380041 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:15.742127 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa777c-dace-48e7-b150-4c885d380041 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:15.742431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa777c-dace-48e7-b150-4c885d380041 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:15.743158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa777c-dace-48e7-b150-4c885d380041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:15.743524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa777c-dace-48e7-b150-4c885d380041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:15.745070 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa777c-dace-48e7-b150-4c885d380041 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:15.758330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 274/547] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:15.765168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec2589-cd21-4462-8a62-706c387da17a None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:15.920284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec2589-cd21-4462-8a62-706c387da17a None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:15.962929 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27746ea5-257b-4935-a86f-cb873ced69cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:15.963754 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27746ea5-257b-4935-a86f-cb873ced69cf None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:15.964035 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27746ea5-257b-4935-a86f-cb873ced69cf None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:15.964307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27746ea5-257b-4935-a86f-cb873ced69cf None admin] PATH_INFO: `/v3/users/swift` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:15.975056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27746ea5-257b-4935-a86f-cb873ced69cf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:15.976559 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27746ea5-257b-4935-a86f-cb873ced69cf None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-27746ea5-257b-4935-a86f-cb873ced69cf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:15.998269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:16.000469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:16.002682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:16.002682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:16.002682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:16.002682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:16.002682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:16.002682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:16.002682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:16.002682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:16.002682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 14:18:16.002682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:16.002682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 274/548] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:18:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:16.010208 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa777c-dace-48e7-b150-4c885d380041 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:16.104465 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa777c-dace-48e7-b150-4c885d380041 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:16.142544 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a320ccc-0de8-4828-89ef-5ef8bb023d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:16.143662 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a320ccc-0de8-4828-89ef-5ef8bb023d2b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:16.144105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a320ccc-0de8-4828-89ef-5ef8bb023d2b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:16.144528 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a320ccc-0de8-4828-89ef-5ef8bb023d2b None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:16.145842 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a320ccc-0de8-4828-89ef-5ef8bb023d2b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:16.146148 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a320ccc-0de8-4828-89ef-5ef8bb023d2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:16.147621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a320ccc-0de8-4828-89ef-5ef8bb023d2b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:16.169859 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 275/549] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 17 14:18:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:16.175921 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27746ea5-257b-4935-a86f-cb873ced69cf None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:16.236044 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10fd15-cc47-455b-b125-94a0512da591 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:16.236382 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10fd15-cc47-455b-b125-94a0512da591 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:16.236588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10fd15-cc47-455b-b125-94a0512da591 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:16.238282 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 276/550] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:18:16.243214 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55775b-6485-4109-9723-bdffc6dbc3ce None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:16.243498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55775b-6485-4109-9723-bdffc6dbc3ce None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:16.243770 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55775b-6485-4109-9723-bdffc6dbc3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:16.271084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-5c55775b-6485-4109-9723-bdffc6dbc3ce None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:16.272274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5c55775b-6485-4109-9723-bdffc6dbc3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:16.348758 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27746ea5-257b-4935-a86f-cb873ced69cf None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:16.354225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 277/551] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:18:16.382358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55775b-6485-4109-9723-bdffc6dbc3ce None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:16.416739 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d19bf5-b7d9-4558-a9ca-983cbccf018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:16.417399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d19bf5-b7d9-4558-a9ca-983cbccf018d None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:16.418273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d19bf5-b7d9-4558-a9ca-983cbccf018d None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:16.419168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d19bf5-b7d9-4558-a9ca-983cbccf018d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:16.491571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55775b-6485-4109-9723-bdffc6dbc3ce None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:16.532309 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d19bf5-b7d9-4558-a9ca-983cbccf018d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:16.533815 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d19bf5-b7d9-4558-a9ca-983cbccf018d None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:16.541620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6322a-53bf-4931-a6fd-2a0b9fbe7b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:16.542458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6322a-53bf-4931-a6fd-2a0b9fbe7b16 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:16.542774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6322a-53bf-4931-a6fd-2a0b9fbe7b16 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:16.543602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6322a-53bf-4931-a6fd-2a0b9fbe7b16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:16.568502 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6322a-53bf-4931-a6fd-2a0b9fbe7b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-3dc6322a-53bf-4931-a6fd-2a0b9fbe7b16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:16.587397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:16.590017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:16.592003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:16.592003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:16.592003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:16.592003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:16.592003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:16.592003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:16.592003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:16.592003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:16.592003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:16.592003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:16.592003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:16.592003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:16.592003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 278/552] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:16.598206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6322a-53bf-4931-a6fd-2a0b9fbe7b16 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:16.688314 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 275/553] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:18:16.693710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d19bf5-b7d9-4558-a9ca-983cbccf018d None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:16.815327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6322a-53bf-4931-a6fd-2a0b9fbe7b16 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:16.853532 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d19bf5-b7d9-4558-a9ca-983cbccf018d None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:16.891935 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbd3bb-c1bb-4d3f-8bdc-19c0214cc8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:16.892732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbd3bb-c1bb-4d3f-8bdc-19c0214cc8dc None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:16.893013 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbd3bb-c1bb-4d3f-8bdc-19c0214cc8dc None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:16.893286 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbd3bb-c1bb-4d3f-8bdc-19c0214cc8dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:16.895992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc89a3-fb04-4786-8808-74cd5b05c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:16.896661 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc89a3-fb04-4786-8808-74cd5b05c101 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:16.896941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc89a3-fb04-4786-8808-74cd5b05c101 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:16.897214 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc89a3-fb04-4786-8808-74cd5b05c101 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:16.897972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc89a3-fb04-4786-8808-74cd5b05c101 None admin] RBAC: Adding query filter params (name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:16.898305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc89a3-fb04-4786-8808-74cd5b05c101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:16.899783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc89a3-fb04-4786-8808-74cd5b05c101 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:16.904122 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbd3bb-c1bb-4d3f-8bdc-19c0214cc8dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:16.905636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbd3bb-c1bb-4d3f-8bdc-19c0214cc8dc None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:16.917288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 279/554] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:16.924848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc89a3-fb04-4786-8808-74cd5b05c101 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:16.929586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-c1fbd3bb-c1bb-4d3f-8bdc-19c0214cc8dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:16.929586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:16.929586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:16.929586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:16.929586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:16.929586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:16.929586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:16.929586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:16.929586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:16.929586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:16.929586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:16.929586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:16.929586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:16.929586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:16.929586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:16.931643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:16.932883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:16.932883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:16.932883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:16.932883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:16.932883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 276/555] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:16.941666 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbd3bb-c1bb-4d3f-8bdc-19c0214cc8dc None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:17.045253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbd3bb-c1bb-4d3f-8bdc-19c0214cc8dc None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:17.045595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc89a3-fb04-4786-8808-74cd5b05c101 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:17.080812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2894a-057f-4e66-876b-c4e7620fa29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:17.081662 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2894a-057f-4e66-876b-c4e7620fa29e None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.081943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2894a-057f-4e66-876b-c4e7620fa29e None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.082242 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2894a-057f-4e66-876b-c4e7620fa29e None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.082987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2894a-057f-4e66-876b-c4e7620fa29e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:17.083290 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2894a-057f-4e66-876b-c4e7620fa29e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:17.084733 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2894a-057f-4e66-876b-c4e7620fa29e None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:17.085023 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb6c10-b78e-4a56-82d7-dc5301c822c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:17.085918 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb6c10-b78e-4a56-82d7-dc5301c822c5 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.086300 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb6c10-b78e-4a56-82d7-dc5301c822c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.086642 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb6c10-b78e-4a56-82d7-dc5301c822c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.097849 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 277/556] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:17.099330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f822a99-82b8-40d2-88f1-c653a16a4621 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.099491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb6c10-b78e-4a56-82d7-dc5301c822c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:17.099632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f822a99-82b8-40d2-88f1-c653a16a4621 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.099949 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f822a99-82b8-40d2-88f1-c653a16a4621 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.101119 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb6c10-b78e-4a56-82d7-dc5301c822c5 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:17.101502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 278/557] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:17.102835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f822a99-82b8-40d2-88f1-c653a16a4621 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:17.130032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-f0cb6c10-b78e-4a56-82d7-dc5301c822c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:17.130032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:17.130032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:17.130032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:17.130032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:17.130032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:17.130032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:17.130032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:17.130032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:17.130032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:17.130032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:17.130032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:17.130032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:17.130032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:17.130032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:17.131152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:17.132338 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:17.132338 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:17.132338 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:17.132338 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:17.138197 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 280/558] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:17.139693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940960d6-15fc-4b4e-9c23-89960f262550 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.139978 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940960d6-15fc-4b4e-9c23-89960f262550 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.140256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940960d6-15fc-4b4e-9c23-89960f262550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.163110 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-940960d6-15fc-4b4e-9c23-89960f262550 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:17.165952 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-940960d6-15fc-4b4e-9c23-89960f262550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:17.233021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f822a99-82b8-40d2-88f1-c653a16a4621 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:17.255295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 281/559] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:17.255295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940960d6-15fc-4b4e-9c23-89960f262550 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:17.271610 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c5f9f-97dd-4e26-8a65-8082b0fbf857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:17.272777 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c5f9f-97dd-4e26-8a65-8082b0fbf857 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.273063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c5f9f-97dd-4e26-8a65-8082b0fbf857 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.273341 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c5f9f-97dd-4e26-8a65-8082b0fbf857 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.287556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c5f9f-97dd-4e26-8a65-8082b0fbf857 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:17.289116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c5f9f-97dd-4e26-8a65-8082b0fbf857 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:17.305137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-c18c5f9f-97dd-4e26-8a65-8082b0fbf857 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:17.305137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:17.305137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:17.305137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:17.305137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:17.305137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:17.305137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:17.305137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:17.305137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:17.305137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:17.305137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:17.305137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:17.305137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:17.305137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:17.305137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:17.306044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:17.306926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:17.306926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:17.306926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:17.306926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:17.306926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:17.306926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:17.306926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:17.306926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:17.306926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 279/560] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:17.307396 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c5f9f-97dd-4e26-8a65-8082b0fbf857 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:17.378239 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940960d6-15fc-4b4e-9c23-89960f262550 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:17.410611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c5f9f-97dd-4e26-8a65-8082b0fbf857 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:17.412287 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75973a5a-4380-4536-a8f9-1f219a945ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:17.412954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75973a5a-4380-4536-a8f9-1f219a945ce2 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.413520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75973a5a-4380-4536-a8f9-1f219a945ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.413520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75973a5a-4380-4536-a8f9-1f219a945ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.414216 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75973a5a-4380-4536-a8f9-1f219a945ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:17.414521 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75973a5a-4380-4536-a8f9-1f219a945ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:17.415892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75973a5a-4380-4536-a8f9-1f219a945ce2 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:17.427907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 282/561] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:17.429270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b1958-90e7-4d9a-a655-748ce1493a01 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.429559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b1958-90e7-4d9a-a655-748ce1493a01 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.429835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b1958-90e7-4d9a-a655-748ce1493a01 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.434215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 283/562] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:17.434215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b1958-90e7-4d9a-a655-748ce1493a01 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:17.455401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8d3a0-4cbb-4311-8e37-f091ef98bb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:17.457148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8d3a0-4cbb-4311-8e37-f091ef98bb0c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.457572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8d3a0-4cbb-4311-8e37-f091ef98bb0c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.458332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8d3a0-4cbb-4311-8e37-f091ef98bb0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.469906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8d3a0-4cbb-4311-8e37-f091ef98bb0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-b8c8d3a0-4cbb-4311-8e37-f091ef98bb0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:17.477537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:17.478483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:17.481097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:17.481097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:17.481097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:17.481097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:17.481097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:17.481097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:17.481097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:17.481097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:17.481097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:17.481097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:17.481097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:17.481097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:17.481097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 280/563] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:17.481097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8d3a0-4cbb-4311-8e37-f091ef98bb0c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:17.541421 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b1958-90e7-4d9a-a655-748ce1493a01 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:17.573653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c1e5b-cc30-4340-b836-1aa758145e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:17.575172 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1e5b-cc30-4340-b836-1aa758145e46 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.575452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1e5b-cc30-4340-b836-1aa758145e46 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.575729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1e5b-cc30-4340-b836-1aa758145e46 None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.576510 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c1e5b-cc30-4340-b836-1aa758145e46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:17.576820 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c1e5b-cc30-4340-b836-1aa758145e46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:17.578300 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c1e5b-cc30-4340-b836-1aa758145e46 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:17.582869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8d3a0-4cbb-4311-8e37-f091ef98bb0c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:17.590269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 284/564] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:17.591316 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2f8f7-60a9-40b3-ae65-775c68264bb3 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.591604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2f8f7-60a9-40b3-ae65-775c68264bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.591881 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2f8f7-60a9-40b3-ae65-775c68264bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.607140 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-47a2f8f7-60a9-40b3-ae65-775c68264bb3 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:17.608333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-47a2f8f7-60a9-40b3-ae65-775c68264bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:17.618566 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ecd27-05ea-4118-9745-f61571cf9536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:17.619382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ecd27-05ea-4118-9745-f61571cf9536 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.619669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ecd27-05ea-4118-9745-f61571cf9536 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.619943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ecd27-05ea-4118-9745-f61571cf9536 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.627979 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ecd27-05ea-4118-9745-f61571cf9536 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:17.629478 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ecd27-05ea-4118-9745-f61571cf9536 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-5c3ecd27-05ea-4118-9745-f61571cf9536 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:17.644711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:17.645724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:17.646842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:17.646842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:17.646842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:17.646842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:17.646842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:17.646842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:17.646842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:17.646842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:17.646842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 14:18:17.646842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:17.646842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 281/565] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 14:18:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:17.647790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea01be-42d5-4625-abfb-fd73cb287b86 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.647790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea01be-42d5-4625-abfb-fd73cb287b86 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.648043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea01be-42d5-4625-abfb-fd73cb287b86 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.649419 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 282/566] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:17.650048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea01be-42d5-4625-abfb-fd73cb287b86 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:17.674475 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 285/567] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:17.675304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2f8f7-60a9-40b3-ae65-775c68264bb3 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:17.750075 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea01be-42d5-4625-abfb-fd73cb287b86 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:17.767754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2f8f7-60a9-40b3-ae65-775c68264bb3 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:17.782999 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a52ff-1982-466b-ad2c-099d397ed9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:17.783670 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a52ff-1982-466b-ad2c-099d397ed9e3 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.783955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a52ff-1982-466b-ad2c-099d397ed9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.784232 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a52ff-1982-466b-ad2c-099d397ed9e3 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.784980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a52ff-1982-466b-ad2c-099d397ed9e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:17.785287 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a52ff-1982-466b-ad2c-099d397ed9e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:17.786695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a52ff-1982-466b-ad2c-099d397ed9e3 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:17.795617 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 283/568] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:17.796453 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a52ff-1982-466b-ad2c-099d397ed9e3 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:17.806727 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a45d0-9c6b-43bc-bdd3-ac82095bc2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:17.807390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a45d0-9c6b-43bc-bdd3-ac82095bc2eb None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.807676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a45d0-9c6b-43bc-bdd3-ac82095bc2eb None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.807958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a45d0-9c6b-43bc-bdd3-ac82095bc2eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.809782 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a45d0-9c6b-43bc-bdd3-ac82095bc2eb None admin] RBAC: Adding query filter params (role.id=4aa22f352696432bbf8fcd9d74ba0dc7, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=055264c31c9e4d3dbf234a362ee82698) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:17.810091 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a45d0-9c6b-43bc-bdd3-ac82095bc2eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:17.811557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a45d0-9c6b-43bc-bdd3-ac82095bc2eb None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:17.817219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 286/569] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:17 2022] GET /identity/v3/role_assignments?user.id=055264c31c9e4d3dbf234a362ee82698&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=4aa22f352696432bbf8fcd9d74ba0dc7 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:17.818525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79750df6-becd-43a1-84ff-56d212ec00a9 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.818820 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79750df6-becd-43a1-84ff-56d212ec00a9 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.819098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79750df6-becd-43a1-84ff-56d212ec00a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.837247 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-79750df6-becd-43a1-84ff-56d212ec00a9 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:17.838507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-79750df6-becd-43a1-84ff-56d212ec00a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:17.904159 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a52ff-1982-466b-ad2c-099d397ed9e3 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:17.919820 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 287/570] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:17.921328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79750df6-becd-43a1-84ff-56d212ec00a9 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:17.940849 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450eca0-d8b6-4ff9-ac2e-7a6e1c1832cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:17.941628 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450eca0-d8b6-4ff9-ac2e-7a6e1c1832cd None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:17.941888 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450eca0-d8b6-4ff9-ac2e-7a6e1c1832cd None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:17.942168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450eca0-d8b6-4ff9-ac2e-7a6e1c1832cd None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:17.943072 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450eca0-d8b6-4ff9-ac2e-7a6e1c1832cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:17.943385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450eca0-d8b6-4ff9-ac2e-7a6e1c1832cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:17.944923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450eca0-d8b6-4ff9-ac2e-7a6e1c1832cd None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:17.964852 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 284/571] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 14:18:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:17.965830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450eca0-d8b6-4ff9-ac2e-7a6e1c1832cd None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:18.045496 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79750df6-becd-43a1-84ff-56d212ec00a9 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:18.072925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450eca0-d8b6-4ff9-ac2e-7a6e1c1832cd None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:18.080713 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fa744-513c-4ac1-9db5-ff5b3c88b84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:18.081781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fa744-513c-4ac1-9db5-ff5b3c88b84d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:18.082067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fa744-513c-4ac1-9db5-ff5b3c88b84d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:18.082374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fa744-513c-4ac1-9db5-ff5b3c88b84d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:18.092768 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fa744-513c-4ac1-9db5-ff5b3c88b84d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-303fa744-513c-4ac1-9db5-ff5b3c88b84d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:18.100579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:18.101685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:18.102644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:18.102644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:18.102644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:18.102644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:18.102644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:18.102644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:18.102644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:18.102644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:18.102644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:18.102644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:18.102644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:18.102644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:18.102644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 288/572] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:18.102644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fa744-513c-4ac1-9db5-ff5b3c88b84d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:18.113159 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3a018-6591-4a00-a6a7-c58ec5c79d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:18.113963 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3a018-6591-4a00-a6a7-c58ec5c79d1d None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:18.114273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3a018-6591-4a00-a6a7-c58ec5c79d1d None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:18.114552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3a018-6591-4a00-a6a7-c58ec5c79d1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:18.131536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3a018-6591-4a00-a6a7-c58ec5c79d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:18.133025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3a018-6591-4a00-a6a7-c58ec5c79d1d None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:18.150727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-93e3a018-6591-4a00-a6a7-c58ec5c79d1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:18.150727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:18.150727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:18.150727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:18.150727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:18.150727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:18.150727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:18.150727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:18.150727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:18.150727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:18.150727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:18.150727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:18.150727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:18.150727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:18.150727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:18.152704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:18.153637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:18.153637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:18.153637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:18.153637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:18.153637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 285/573] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:18.153637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3a018-6591-4a00-a6a7-c58ec5c79d1d None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:18.218780 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fa744-513c-4ac1-9db5-ff5b3c88b84d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:18.255220 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3a018-6591-4a00-a6a7-c58ec5c79d1d None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:18.260168 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7518e87-efc4-45b3-af83-1bb2fe1cfb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:18.261192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7518e87-efc4-45b3-af83-1bb2fe1cfb51 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:18.261693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7518e87-efc4-45b3-af83-1bb2fe1cfb51 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:18.262163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7518e87-efc4-45b3-af83-1bb2fe1cfb51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:18.272930 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7518e87-efc4-45b3-af83-1bb2fe1cfb51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-d7518e87-efc4-45b3-af83-1bb2fe1cfb51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:18.281434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:18.282437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:18.283358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:18.283358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:18.283358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:18.283358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:18.283358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:18.283358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:18.283358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:18.283358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:18.283358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:18.283358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:18.283358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:18.283358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:18.283358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 289/574] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:18.284069 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7518e87-efc4-45b3-af83-1bb2fe1cfb51 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:18.292660 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a464e47-eb95-4cfb-97ba-36de865abb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:18.293450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a464e47-eb95-4cfb-97ba-36de865abb0d None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:18.293729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a464e47-eb95-4cfb-97ba-36de865abb0d None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:18.293998 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a464e47-eb95-4cfb-97ba-36de865abb0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:18.304180 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a464e47-eb95-4cfb-97ba-36de865abb0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:18.305634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a464e47-eb95-4cfb-97ba-36de865abb0d None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:18.323785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-1a464e47-eb95-4cfb-97ba-36de865abb0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:18.323785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:18.323785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:18.323785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:18.323785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:18.323785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:18.323785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:18.323785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:18.323785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:18.323785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:18.323785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:18.323785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:18.323785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:18.323785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:18.323785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:18.325244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:18.326140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:18.326140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:18.326140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:18.326140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:18.326140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 286/575] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:18.326883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a464e47-eb95-4cfb-97ba-36de865abb0d None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:18.389887 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7518e87-efc4-45b3-af83-1bb2fe1cfb51 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:18.422938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef348659-ee8a-48c2-897e-5c665c255f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:18.423608 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef348659-ee8a-48c2-897e-5c665c255f9c None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:18.423895 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef348659-ee8a-48c2-897e-5c665c255f9c None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:18.424169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef348659-ee8a-48c2-897e-5c665c255f9c None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:18.424913 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef348659-ee8a-48c2-897e-5c665c255f9c None admin] RBAC: Adding query filter params (name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:18.425217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef348659-ee8a-48c2-897e-5c665c255f9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:18.426690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef348659-ee8a-48c2-897e-5c665c255f9c None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:18.427502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a464e47-eb95-4cfb-97ba-36de865abb0d None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:18.435118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 290/576] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:18.436002 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef348659-ee8a-48c2-897e-5c665c255f9c None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:18.468419 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ec534-b677-4a92-8786-40e942a4e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:18.469010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ec534-b677-4a92-8786-40e942a4e230 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:18.469290 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ec534-b677-4a92-8786-40e942a4e230 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:18.469563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ec534-b677-4a92-8786-40e942a4e230 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:18.470315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ec534-b677-4a92-8786-40e942a4e230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:18.470624 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ec534-b677-4a92-8786-40e942a4e230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:18.471990 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ec534-b677-4a92-8786-40e942a4e230 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:18.487881 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 287/577] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:18.488757 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ec534-b677-4a92-8786-40e942a4e230 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:18.537526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef348659-ee8a-48c2-897e-5c665c255f9c None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:18.571937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b25a8-3d5d-49bb-b5a8-ead1c27a23e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:18.572756 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b25a8-3d5d-49bb-b5a8-ead1c27a23e0 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:18.573043 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b25a8-3d5d-49bb-b5a8-ead1c27a23e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:18.573610 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b25a8-3d5d-49bb-b5a8-ead1c27a23e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:18.574965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b25a8-3d5d-49bb-b5a8-ead1c27a23e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:18.575424 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b25a8-3d5d-49bb-b5a8-ead1c27a23e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:18.576815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b25a8-3d5d-49bb-b5a8-ead1c27a23e0 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:18.590055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 291/578] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:18.590055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b25a8-3d5d-49bb-b5a8-ead1c27a23e0 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:18.594615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ec534-b677-4a92-8786-40e942a4e230 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:18.627886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0345f41-7020-43a5-8ccd-60bc581bcd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:18.628552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0345f41-7020-43a5-8ccd-60bc581bcd34 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:18.628834 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0345f41-7020-43a5-8ccd-60bc581bcd34 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:18.629108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0345f41-7020-43a5-8ccd-60bc581bcd34 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:18.629829 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0345f41-7020-43a5-8ccd-60bc581bcd34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:18.630136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0345f41-7020-43a5-8ccd-60bc581bcd34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:18.631546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0345f41-7020-43a5-8ccd-60bc581bcd34 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:18.649007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 288/579] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:18.649007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0345f41-7020-43a5-8ccd-60bc581bcd34 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:18.687244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b25a8-3d5d-49bb-b5a8-ead1c27a23e0 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:18.721489 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be9401-5d4e-448c-87f4-189bc8021aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:18.722216 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be9401-5d4e-448c-87f4-189bc8021aeb None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:18.722505 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be9401-5d4e-448c-87f4-189bc8021aeb None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:18.722780 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be9401-5d4e-448c-87f4-189bc8021aeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:18.734450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be9401-5d4e-448c-87f4-189bc8021aeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:18.735911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be9401-5d4e-448c-87f4-189bc8021aeb None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:18.746721 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0345f41-7020-43a5-8ccd-60bc581bcd34 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:18.752799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-27be9401-5d4e-448c-87f4-189bc8021aeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:18.752799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:18.752799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:18.752799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:18.752799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:18.752799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:18.752799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:18.752799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:18.752799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:18.752799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:18.752799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:18.752799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:18.752799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:18.752799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:18.752799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:18.753676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:18.754595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:18.754595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:18.754595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:18.754595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:18.754595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 292/580] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:18.755276 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be9401-5d4e-448c-87f4-189bc8021aeb None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:18.785430 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64a02d-36b5-4718-bc6c-8e4e52f27a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:18.786348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64a02d-36b5-4718-bc6c-8e4e52f27a7c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:18.786632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64a02d-36b5-4718-bc6c-8e4e52f27a7c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:18.786908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64a02d-36b5-4718-bc6c-8e4e52f27a7c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:18.794683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64a02d-36b5-4718-bc6c-8e4e52f27a7c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:18.796136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64a02d-36b5-4718-bc6c-8e4e52f27a7c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-3a64a02d-36b5-4718-bc6c-8e4e52f27a7c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:18.811405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:18.812581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:18.813543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:18.813543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:18.813543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:18.813543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:18.813543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:18.813543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:18.813543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:18.813543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:18.813543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 14:18:18.813543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:18.813543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 289/581] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:18:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:18.814211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64a02d-36b5-4718-bc6c-8e4e52f27a7c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:18.857379 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be9401-5d4e-448c-87f4-189bc8021aeb None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:18.892841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424877f3-6e01-4e55-96e6-785c843adb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:18.893629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424877f3-6e01-4e55-96e6-785c843adb7a None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:18.893918 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424877f3-6e01-4e55-96e6-785c843adb7a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:18.894200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424877f3-6e01-4e55-96e6-785c843adb7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:18.905192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424877f3-6e01-4e55-96e6-785c843adb7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:18.906688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424877f3-6e01-4e55-96e6-785c843adb7a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:18.922206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64a02d-36b5-4718-bc6c-8e4e52f27a7c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:18.923976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-424877f3-6e01-4e55-96e6-785c843adb7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:18.923976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:18.923976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:18.923976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:18.923976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:18.923976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:18.923976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:18.923976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:18.923976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:18.923976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:18.923976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:18.923976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:18.923976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:18.923976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:18.923976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:18.924832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:18.925702 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:18.925702 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:18.925702 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:18.925702 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:18.925702 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 293/582] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:18.925974 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424877f3-6e01-4e55-96e6-785c843adb7a None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:18.962595 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5f230-5395-4fce-9b18-7863e71251a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:18.964057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5f230-5395-4fce-9b18-7863e71251a3 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:18.964526 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5f230-5395-4fce-9b18-7863e71251a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:18.964981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5f230-5395-4fce-9b18-7863e71251a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:18.971960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5f230-5395-4fce-9b18-7863e71251a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:18.973597 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5f230-5395-4fce-9b18-7863e71251a3 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:18.987203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-5db5f230-5395-4fce-9b18-7863e71251a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:18.987203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:18.987203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:18.987203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:18.987203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:18.987203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:18.987203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:18.987203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:18.987203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:18.987203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:18.987203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:18.987203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:18.987203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:18.987203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:18.987203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:18.988085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:18.988958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:18.988958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:18.988958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:18.988958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:18.988958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:18.988958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:18.988958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:18.988958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:18.990780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 290/583] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:18.991763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5f230-5395-4fce-9b18-7863e71251a3 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:19.029792 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424877f3-6e01-4e55-96e6-785c843adb7a None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:19.064227 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb42764-5501-4f3c-b74d-22e56ef47a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:19.065057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb42764-5501-4f3c-b74d-22e56ef47a87 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:19.065345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb42764-5501-4f3c-b74d-22e56ef47a87 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:19.065625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb42764-5501-4f3c-b74d-22e56ef47a87 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:19.066394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb42764-5501-4f3c-b74d-22e56ef47a87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:19.066707 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb42764-5501-4f3c-b74d-22e56ef47a87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:19.068096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb42764-5501-4f3c-b74d-22e56ef47a87 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:19.085059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 294/584] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:19.085059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb42764-5501-4f3c-b74d-22e56ef47a87 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:19.101751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5f230-5395-4fce-9b18-7863e71251a3 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:19.135505 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee8a27-e127-42fa-9c52-749d16f1f167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:19.136179 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee8a27-e127-42fa-9c52-749d16f1f167 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:19.137103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee8a27-e127-42fa-9c52-749d16f1f167 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:19.137386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee8a27-e127-42fa-9c52-749d16f1f167 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:19.138254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee8a27-e127-42fa-9c52-749d16f1f167 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:19.138567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee8a27-e127-42fa-9c52-749d16f1f167 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:19.140004 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee8a27-e127-42fa-9c52-749d16f1f167 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:19.157292 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 291/585] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 17 14:18:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:19.158112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee8a27-e127-42fa-9c52-749d16f1f167 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:19.183922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb42764-5501-4f3c-b74d-22e56ef47a87 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:19.224495 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d096671-8baa-4e24-b046-bbc72a141199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:19.225090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d096671-8baa-4e24-b046-bbc72a141199 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:19.225373 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d096671-8baa-4e24-b046-bbc72a141199 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:19.225646 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d096671-8baa-4e24-b046-bbc72a141199 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:19.226402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d096671-8baa-4e24-b046-bbc72a141199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:19.226794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d096671-8baa-4e24-b046-bbc72a141199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:19.228161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d096671-8baa-4e24-b046-bbc72a141199 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:19.239637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 295/586] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:19.240602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d096671-8baa-4e24-b046-bbc72a141199 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:19.267748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee8a27-e127-42fa-9c52-749d16f1f167 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:19.303990 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2045-8da3-45fa-9926-5467a2493cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:19.304655 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2045-8da3-45fa-9926-5467a2493cf8 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:19.304938 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2045-8da3-45fa-9926-5467a2493cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:19.305213 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb2045-8da3-45fa-9926-5467a2493cf8 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:19.306001 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2045-8da3-45fa-9926-5467a2493cf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:19.306349 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2045-8da3-45fa-9926-5467a2493cf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:19.307793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb2045-8da3-45fa-9926-5467a2493cf8 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:19.324398 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 292/587] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:19.324398 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2045-8da3-45fa-9926-5467a2493cf8 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:19.344415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d096671-8baa-4e24-b046-bbc72a141199 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:19.377787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23156242-45c5-410d-b3b9-07619748ba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:19.378616 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23156242-45c5-410d-b3b9-07619748ba9e None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:19.378903 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23156242-45c5-410d-b3b9-07619748ba9e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:19.379178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23156242-45c5-410d-b3b9-07619748ba9e None admin] PATH_INFO: `/v3/users/glance` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:19.387322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23156242-45c5-410d-b3b9-07619748ba9e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:19.388713 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23156242-45c5-410d-b3b9-07619748ba9e None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-23156242-45c5-410d-b3b9-07619748ba9e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:19.403107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:19.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:19.405026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:19.405026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:19.405026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:19.405026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:19.405026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:19.405026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:19.405026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:19.405026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:19.405026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 14:18:19.405026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:19.405026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 296/588] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:18:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:19.405613 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23156242-45c5-410d-b3b9-07619748ba9e None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:19.427615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb2045-8da3-45fa-9926-5467a2493cf8 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:19.463115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9496810-84c6-4532-944c-439a51cc44a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:19.463915 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9496810-84c6-4532-944c-439a51cc44a4 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:19.464199 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9496810-84c6-4532-944c-439a51cc44a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:19.465130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9496810-84c6-4532-944c-439a51cc44a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:19.476017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9496810-84c6-4532-944c-439a51cc44a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:19.477530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9496810-84c6-4532-944c-439a51cc44a4 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:19.494857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-c9496810-84c6-4532-944c-439a51cc44a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:19.494857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:19.494857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:19.494857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:19.494857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:19.494857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:19.494857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:19.494857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:19.494857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:19.494857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:19.494857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:19.494857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:19.494857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:19.494857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:19.494857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:19.496095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:19.497010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:19.497010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:19.497010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:19.497010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:19.497010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 293/589] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:19.497377 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9496810-84c6-4532-944c-439a51cc44a4 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:19.509438 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23156242-45c5-410d-b3b9-07619748ba9e None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:19.545677 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e563b-6354-45ff-a885-16e437d8b872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:19.546400 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e563b-6354-45ff-a885-16e437d8b872 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:19.546690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e563b-6354-45ff-a885-16e437d8b872 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:19.546849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e563b-6354-45ff-a885-16e437d8b872 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:19.554682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e563b-6354-45ff-a885-16e437d8b872 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:19.556136 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e563b-6354-45ff-a885-16e437d8b872 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-5a5e563b-6354-45ff-a885-16e437d8b872 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:19.572030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:19.573036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:19.574735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:19.574735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:19.574735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:19.574735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:19.574735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:19.574735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:19.574735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:19.574735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:19.574735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 14:18:19.574735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:19.574735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 297/590] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:19.575860 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e563b-6354-45ff-a885-16e437d8b872 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:19.607113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9496810-84c6-4532-944c-439a51cc44a4 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:19.641566 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46150e1-f9dc-46e0-8c57-1e8c51a1a745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:19.642845 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46150e1-f9dc-46e0-8c57-1e8c51a1a745 None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:19.643137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46150e1-f9dc-46e0-8c57-1e8c51a1a745 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:19.643413 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46150e1-f9dc-46e0-8c57-1e8c51a1a745 None admin] PATH_INFO: `/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/1f443d2ca1534249bb2c4096300ddffd/roles/4aa22f352696432bbf8fcd9d74ba0dc7` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:19.657798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46150e1-f9dc-46e0-8c57-1e8c51a1a745 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac7d1119033458393ad6f78fc0df7a3, user_id=1f443d2ca1534249bb2c4096300ddffd, role_id=4aa22f352696432bbf8fcd9d74ba0dc7)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:19.659954 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46150e1-f9dc-46e0-8c57-1e8c51a1a745 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:19.682204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 294/591] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:18:19 2022] PUT /identity/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/1f443d2ca1534249bb2c4096300ddffd/roles/4aa22f352696432bbf8fcd9d74ba0dc7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:18:19.682204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46150e1-f9dc-46e0-8c57-1e8c51a1a745 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:19.687291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e563b-6354-45ff-a885-16e437d8b872 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:19.734614 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee722bd-d8a2-4d6e-bf31-fd4ed6561fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:19.735774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee722bd-d8a2-4d6e-bf31-fd4ed6561fcf None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:19.736063 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee722bd-d8a2-4d6e-bf31-fd4ed6561fcf None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:19.736344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee722bd-d8a2-4d6e-bf31-fd4ed6561fcf None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:19.737396 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee722bd-d8a2-4d6e-bf31-fd4ed6561fcf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:19.737710 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee722bd-d8a2-4d6e-bf31-fd4ed6561fcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:19.739990 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee722bd-d8a2-4d6e-bf31-fd4ed6561fcf None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:19.768703 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 298/592] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 17 14:18:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:19.769669 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee722bd-d8a2-4d6e-bf31-fd4ed6561fcf None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:19.804485 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46150e1-f9dc-46e0-8c57-1e8c51a1a745 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:19.845313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4035ed6-2117-42fa-9cd5-8a73c622a546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:19.846064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4035ed6-2117-42fa-9cd5-8a73c622a546 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:19.846388 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4035ed6-2117-42fa-9cd5-8a73c622a546 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:19.846725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4035ed6-2117-42fa-9cd5-8a73c622a546 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:19.847523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4035ed6-2117-42fa-9cd5-8a73c622a546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:19.847839 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4035ed6-2117-42fa-9cd5-8a73c622a546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:19.849260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4035ed6-2117-42fa-9cd5-8a73c622a546 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:19.862141 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 295/593] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:19.862862 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4035ed6-2117-42fa-9cd5-8a73c622a546 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:19.881657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee722bd-d8a2-4d6e-bf31-fd4ed6561fcf None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:19.919270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2f429-a6c3-4fd7-b162-8532c73b8542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:19.919969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2f429-a6c3-4fd7-b162-8532c73b8542 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:19.920249 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2f429-a6c3-4fd7-b162-8532c73b8542 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:19.920524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2f429-a6c3-4fd7-b162-8532c73b8542 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:19.921384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2f429-a6c3-4fd7-b162-8532c73b8542 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:19.921694 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2f429-a6c3-4fd7-b162-8532c73b8542 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:19.923234 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2f429-a6c3-4fd7-b162-8532c73b8542 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:19.946186 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 299/594] 10.222.0.48 () {56 vars in 1139 bytes} [Tue May 17 14:18:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:19.947105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2f429-a6c3-4fd7-b162-8532c73b8542 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:19.977946 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4035ed6-2117-42fa-9cd5-8a73c622a546 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:20.013882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba7c26-89c4-49e4-bd78-94df41eee05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:20.015149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba7c26-89c4-49e4-bd78-94df41eee05a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:20.015629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba7c26-89c4-49e4-bd78-94df41eee05a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:20.016096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba7c26-89c4-49e4-bd78-94df41eee05a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:20.027436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba7c26-89c4-49e4-bd78-94df41eee05a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:20.029295 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba7c26-89c4-49e4-bd78-94df41eee05a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:20.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-7bba7c26-89c4-49e4-bd78-94df41eee05a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:20.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:20.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:20.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:20.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:20.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:20.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:20.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:20.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:20.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:20.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:20.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:20.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:20.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:20.047542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:20.048470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:20.049360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:20.049360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:20.049360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:20.049360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:20.049980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2f429-a6c3-4fd7-b162-8532c73b8542 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:20.051809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 296/595] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:20.052882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba7c26-89c4-49e4-bd78-94df41eee05a None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:20.085710 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e33a3d-7b64-4732-aae6-946ef126a18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:20.086564 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e33a3d-7b64-4732-aae6-946ef126a18f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:20.086903 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e33a3d-7b64-4732-aae6-946ef126a18f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:20.087120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e33a3d-7b64-4732-aae6-946ef126a18f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:20.094822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e33a3d-7b64-4732-aae6-946ef126a18f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:20.096290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e33a3d-7b64-4732-aae6-946ef126a18f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:20.109954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-98e33a3d-7b64-4732-aae6-946ef126a18f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:20.109954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:20.109954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:20.109954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:20.109954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:20.109954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:20.109954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:20.109954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:20.109954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:20.109954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:20.109954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:20.109954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:20.109954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:20.109954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:20.109954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:20.111090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:20.111963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:20.111963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:20.111963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:20.111963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:20.111963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:20.111963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:20.111963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:20.111963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:20.111963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 300/596] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:20.111963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e33a3d-7b64-4732-aae6-946ef126a18f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:20.164103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba7c26-89c4-49e4-bd78-94df41eee05a None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:20.196541 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2a45d-e5d2-433f-b3b5-fbf8c455877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:20.197407 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2a45d-e5d2-433f-b3b5-fbf8c455877b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:20.197597 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2a45d-e5d2-433f-b3b5-fbf8c455877b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:20.197870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2a45d-e5d2-433f-b3b5-fbf8c455877b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:20.208958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2a45d-e5d2-433f-b3b5-fbf8c455877b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:20.210423 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2a45d-e5d2-433f-b3b5-fbf8c455877b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:20.216308 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e33a3d-7b64-4732-aae6-946ef126a18f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:20.227358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-71d2a45d-e5d2-433f-b3b5-fbf8c455877b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:20.227358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:20.227358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:20.227358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:20.227358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:20.227358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:20.227358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:20.227358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:20.227358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:20.227358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:20.227358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:20.227358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:20.227358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:20.227358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:20.227358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:20.228434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:20.229368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:20.229368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:20.229368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:20.229368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:20.229368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 297/597] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:20.230716 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541e0d0-6cdb-4493-8698-ae7766e0e8bd None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:20.231001 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541e0d0-6cdb-4493-8698-ae7766e0e8bd None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:20.231342 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541e0d0-6cdb-4493-8698-ae7766e0e8bd None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:20.236646 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 298/598] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:20.237474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541e0d0-6cdb-4493-8698-ae7766e0e8bd None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:20.257679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9490e-d4c1-4e83-a551-3bff8772d233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:20.258377 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9490e-d4c1-4e83-a551-3bff8772d233 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:20.258658 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9490e-d4c1-4e83-a551-3bff8772d233 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:20.258931 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9490e-d4c1-4e83-a551-3bff8772d233 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:20.259652 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9490e-d4c1-4e83-a551-3bff8772d233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:20.259959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9490e-d4c1-4e83-a551-3bff8772d233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:20.261841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9490e-d4c1-4e83-a551-3bff8772d233 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:20.277822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 301/599] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:20.278939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9490e-d4c1-4e83-a551-3bff8772d233 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:20.341628 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541e0d0-6cdb-4493-8698-ae7766e0e8bd None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:20.375845 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9490e-d4c1-4e83-a551-3bff8772d233 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:20.377261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c9140-c1ec-4102-8b5f-62a8c313b721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:20.377921 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c9140-c1ec-4102-8b5f-62a8c313b721 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:20.378231 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c9140-c1ec-4102-8b5f-62a8c313b721 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:20.378513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c9140-c1ec-4102-8b5f-62a8c313b721 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:20.379352 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c9140-c1ec-4102-8b5f-62a8c313b721 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:20.379723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c9140-c1ec-4102-8b5f-62a8c313b721 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:20.381188 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c9140-c1ec-4102-8b5f-62a8c313b721 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:20.399302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 299/600] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:20.399302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798494-46c4-4bb1-853a-5ed36b758ee3 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:20.399302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798494-46c4-4bb1-853a-5ed36b758ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:20.399302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798494-46c4-4bb1-853a-5ed36b758ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:20.413252 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-d5798494-46c4-4bb1-853a-5ed36b758ee3 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:20.414520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d5798494-46c4-4bb1-853a-5ed36b758ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:20.416014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536399f-7ca1-43f0-a5fa-0e69842cb7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:20.416916 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536399f-7ca1-43f0-a5fa-0e69842cb7e9 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:20.418418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536399f-7ca1-43f0-a5fa-0e69842cb7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:20.418779 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536399f-7ca1-43f0-a5fa-0e69842cb7e9 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:20.419574 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536399f-7ca1-43f0-a5fa-0e69842cb7e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:20.419952 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536399f-7ca1-43f0-a5fa-0e69842cb7e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:20.421388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536399f-7ca1-43f0-a5fa-0e69842cb7e9 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:20.436380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 302/601] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:20.437363 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536399f-7ca1-43f0-a5fa-0e69842cb7e9 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:20.481729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 300/602] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:20.482818 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5798494-46c4-4bb1-853a-5ed36b758ee3 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:20.548242 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536399f-7ca1-43f0-a5fa-0e69842cb7e9 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:20.582623 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc4f0f-cd52-487c-9db2-f1c72b463f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:20.583416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc4f0f-cd52-487c-9db2-f1c72b463f39 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:20.583701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc4f0f-cd52-487c-9db2-f1c72b463f39 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:20.583981 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc4f0f-cd52-487c-9db2-f1c72b463f39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:20.586719 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5798494-46c4-4bb1-853a-5ed36b758ee3 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:20.591282 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc4f0f-cd52-487c-9db2-f1c72b463f39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:20.592793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc4f0f-cd52-487c-9db2-f1c72b463f39 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:20.607949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-50bc4f0f-cd52-487c-9db2-f1c72b463f39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:20.607949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:20.607949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:20.607949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:20.607949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:20.607949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:20.607949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:20.607949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:20.607949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:20.607949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:20.607949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:20.607949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:20.607949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:20.607949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:20.607949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:20.608852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:20.609726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:20.609726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:20.609726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:20.609726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:20.609726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:20.609726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:20.609726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:20.609726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:20.609726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 303/603] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:20.610762 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc4f0f-cd52-487c-9db2-f1c72b463f39 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:20.631825 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeaf440-8fcb-4891-83ae-75cbd8a135f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:20.632850 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf440-8fcb-4891-83ae-75cbd8a135f5 None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:20.633130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf440-8fcb-4891-83ae-75cbd8a135f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:20.633968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf440-8fcb-4891-83ae-75cbd8a135f5 None admin] PATH_INFO: `/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/f7fd6429fee94c89a6a29467b014ec5f/roles/4aa22f352696432bbf8fcd9d74ba0dc7` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:20.652733 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeaf440-8fcb-4891-83ae-75cbd8a135f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac7d1119033458393ad6f78fc0df7a3, user_id=f7fd6429fee94c89a6a29467b014ec5f, role_id=4aa22f352696432bbf8fcd9d74ba0dc7)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:20.654219 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeaf440-8fcb-4891-83ae-75cbd8a135f5 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:20.674205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 301/604] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:18:20 2022] PUT /identity/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/f7fd6429fee94c89a6a29467b014ec5f/roles/4aa22f352696432bbf8fcd9d74ba0dc7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:18:20.674205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeaf440-8fcb-4891-83ae-75cbd8a135f5 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:20.716590 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc4f0f-cd52-487c-9db2-f1c72b463f39 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:20.753759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a4d1f-535d-469f-8520-8b21103f2053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:20.754594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a4d1f-535d-469f-8520-8b21103f2053 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:20.754879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a4d1f-535d-469f-8520-8b21103f2053 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:20.755156 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a4d1f-535d-469f-8520-8b21103f2053 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:20.764120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a4d1f-535d-469f-8520-8b21103f2053 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:20.765602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a4d1f-535d-469f-8520-8b21103f2053 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:20.781078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-df8a4d1f-535d-469f-8520-8b21103f2053 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:20.781078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:20.781078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:20.781078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:20.781078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:20.781078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:20.781078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:20.781078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:20.781078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:20.781078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:20.781078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:20.781078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:20.781078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:20.781078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:20.781078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:20.782054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:20.782962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:20.782962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:20.782962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:20.782962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:20.782962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:20.782962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:20.782962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:20.782962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:20.786988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 304/605] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:20.787937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a4d1f-535d-469f-8520-8b21103f2053 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:20.797416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeaf440-8fcb-4891-83ae-75cbd8a135f5 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:20.835511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8c602-266f-42bf-abde-cdb88d36261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:20.836509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c602-266f-42bf-abde-cdb88d36261f None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:20.836867 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c602-266f-42bf-abde-cdb88d36261f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:20.837472 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c602-266f-42bf-abde-cdb88d36261f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:20.849516 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8c602-266f-42bf-abde-cdb88d36261f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-a0b8c602-266f-42bf-abde-cdb88d36261f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:20.858869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:20.860822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:20.862814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:20.862814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:20.862814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:20.862814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:20.862814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:20.862814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:20.862814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:20.862814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:20.862814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:20.862814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:20.862814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:20.862814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:20.870211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 302/606] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:20.870211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8c602-266f-42bf-abde-cdb88d36261f None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:20.901737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a4d1f-535d-469f-8520-8b21103f2053 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:20.953164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa419c-f462-40bb-bd29-9bcab43cf5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:20.953164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa419c-f462-40bb-bd29-9bcab43cf5eb None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:20.953164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa419c-f462-40bb-bd29-9bcab43cf5eb None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:20.953164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa419c-f462-40bb-bd29-9bcab43cf5eb None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:20.953987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa419c-f462-40bb-bd29-9bcab43cf5eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:20.953987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa419c-f462-40bb-bd29-9bcab43cf5eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:20.955150 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa419c-f462-40bb-bd29-9bcab43cf5eb None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:20.969631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 305/607] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:20.974330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa419c-f462-40bb-bd29-9bcab43cf5eb None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:20.979866 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8c602-266f-42bf-abde-cdb88d36261f None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:21.014817 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcdb3f-1343-434b-8fb7-2cd80a5bb39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:21.015487 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcdb3f-1343-434b-8fb7-2cd80a5bb39f None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:21.015770 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcdb3f-1343-434b-8fb7-2cd80a5bb39f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:21.016046 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcdb3f-1343-434b-8fb7-2cd80a5bb39f None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:21.016846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fcdb3f-1343-434b-8fb7-2cd80a5bb39f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:21.017155 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fcdb3f-1343-434b-8fb7-2cd80a5bb39f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:21.018651 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fcdb3f-1343-434b-8fb7-2cd80a5bb39f None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:21.031997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 303/608] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:21.032790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcdb3f-1343-434b-8fb7-2cd80a5bb39f None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:21.083452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa419c-f462-40bb-bd29-9bcab43cf5eb None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:21.119433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601e658-d054-4f01-b4d2-df99b38da9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:21.120107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601e658-d054-4f01-b4d2-df99b38da9d0 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:21.120390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601e658-d054-4f01-b4d2-df99b38da9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:21.121774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601e658-d054-4f01-b4d2-df99b38da9d0 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:21.122567 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601e658-d054-4f01-b4d2-df99b38da9d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:21.122881 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601e658-d054-4f01-b4d2-df99b38da9d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:21.124259 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601e658-d054-4f01-b4d2-df99b38da9d0 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:21.135425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcdb3f-1343-434b-8fb7-2cd80a5bb39f None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:21.137995 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 306/609] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:21.138912 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601e658-d054-4f01-b4d2-df99b38da9d0 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:21.171162 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1a68a-ca12-4c9f-bdf7-086cf0f3fe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:21.172088 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1a68a-ca12-4c9f-bdf7-086cf0f3fe3c None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:21.172370 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1a68a-ca12-4c9f-bdf7-086cf0f3fe3c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:21.172645 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1a68a-ca12-4c9f-bdf7-086cf0f3fe3c None admin] PATH_INFO: `/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/f34ff47d8c4f4d99955340ddbdc3d475/roles/4aa22f352696432bbf8fcd9d74ba0dc7` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:21.187932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1a68a-ca12-4c9f-bdf7-086cf0f3fe3c None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac7d1119033458393ad6f78fc0df7a3, user_id=f34ff47d8c4f4d99955340ddbdc3d475, role_id=4aa22f352696432bbf8fcd9d74ba0dc7)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:21.189391 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1a68a-ca12-4c9f-bdf7-086cf0f3fe3c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:21.213691 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 304/610] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:18:21 2022] PUT /identity/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/f34ff47d8c4f4d99955340ddbdc3d475/roles/4aa22f352696432bbf8fcd9d74ba0dc7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:18:21.215669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1a68a-ca12-4c9f-bdf7-086cf0f3fe3c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:21.280815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601e658-d054-4f01-b4d2-df99b38da9d0 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:21.319176 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbe6e1-ff86-4c3c-af01-e6e156559b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:21.320499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbe6e1-ff86-4c3c-af01-e6e156559b2b None admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:21.320975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbe6e1-ff86-4c3c-af01-e6e156559b2b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:21.321493 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbe6e1-ff86-4c3c-af01-e6e156559b2b None admin] PATH_INFO: `/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/7b03ca44da654c3a9a5d9762b8eee189/roles/4aa22f352696432bbf8fcd9d74ba0dc7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:21.340189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbe6e1-ff86-4c3c-af01-e6e156559b2b None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac7d1119033458393ad6f78fc0df7a3, user_id=7b03ca44da654c3a9a5d9762b8eee189, role_id=4aa22f352696432bbf8fcd9d74ba0dc7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:21.342111 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbe6e1-ff86-4c3c-af01-e6e156559b2b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:21.366013 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 307/611] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:18:21 2022] PUT /identity/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/7b03ca44da654c3a9a5d9762b8eee189/roles/4aa22f352696432bbf8fcd9d74ba0dc7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:18:21.398146 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1a68a-ca12-4c9f-bdf7-086cf0f3fe3c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:21.449764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e4dc9-480b-4c81-9d18-e841d5c702da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:21.450608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e4dc9-480b-4c81-9d18-e841d5c702da None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:21.450886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e4dc9-480b-4c81-9d18-e841d5c702da None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:21.451154 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e4dc9-480b-4c81-9d18-e841d5c702da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:21.462669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e4dc9-480b-4c81-9d18-e841d5c702da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:21.464229 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e4dc9-480b-4c81-9d18-e841d5c702da None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:21.485528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-a05e4dc9-480b-4c81-9d18-e841d5c702da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:21.485528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:21.485528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:21.485528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:21.485528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:21.485528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:21.485528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:21.485528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:21.485528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:21.485528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:21.485528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:21.485528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:21.485528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:21.485528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:21.485528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:21.486523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:21.488014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:21.488014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:21.488014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:21.488014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:21.488014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 305/612] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:21.492436 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbe6e1-ff86-4c3c-af01-e6e156559b2b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:21.643058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbe6e1-ff86-4c3c-af01-e6e156559b2b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:21.681973 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11179bf-eb17-44da-a291-ff217782d5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:21.682589 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11179bf-eb17-44da-a291-ff217782d5cb None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:21.682941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11179bf-eb17-44da-a291-ff217782d5cb None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:21.683359 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11179bf-eb17-44da-a291-ff217782d5cb None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:21.684548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11179bf-eb17-44da-a291-ff217782d5cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:21.684863 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11179bf-eb17-44da-a291-ff217782d5cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:21.686256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11179bf-eb17-44da-a291-ff217782d5cb None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:21.700903 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 308/613] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:21.707289 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e4dc9-480b-4c81-9d18-e841d5c702da None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:21.820220 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e4dc9-480b-4c81-9d18-e841d5c702da None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:21.867058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9354d4c-a279-401b-8ce2-91cc2bfc8f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:21.867864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9354d4c-a279-401b-8ce2-91cc2bfc8f4b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:21.868151 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9354d4c-a279-401b-8ce2-91cc2bfc8f4b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:21.868431 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9354d4c-a279-401b-8ce2-91cc2bfc8f4b None admin] PATH_INFO: `/v3/users/swift` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:21.876859 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9354d4c-a279-401b-8ce2-91cc2bfc8f4b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:21.878341 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9354d4c-a279-401b-8ce2-91cc2bfc8f4b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-b9354d4c-a279-401b-8ce2-91cc2bfc8f4b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:21.892997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:21.894030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:21.895700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:21.895700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:21.895700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:21.895700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:21.895700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:21.895700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:21.895700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:21.895700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:21.895700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 14:18:21.895700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:21.895700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 306/614] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:18:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:21.903931 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11179bf-eb17-44da-a291-ff217782d5cb None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:22.043112 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11179bf-eb17-44da-a291-ff217782d5cb None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:22.085276 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718323a-ca2f-4093-9779-6f6936ea7308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:22.085955 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718323a-ca2f-4093-9779-6f6936ea7308 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:22.086263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718323a-ca2f-4093-9779-6f6936ea7308 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:22.086540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718323a-ca2f-4093-9779-6f6936ea7308 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:22.087488 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718323a-ca2f-4093-9779-6f6936ea7308 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:22.087796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718323a-ca2f-4093-9779-6f6936ea7308 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:22.089874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718323a-ca2f-4093-9779-6f6936ea7308 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:22.113367 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 309/615] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 17 14:18:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:22.118756 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9354d4c-a279-401b-8ce2-91cc2bfc8f4b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:22.165785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512f786-da6a-4c38-9e78-1b85176d3ce5 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:22.166110 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512f786-da6a-4c38-9e78-1b85176d3ce5 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:22.166371 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512f786-da6a-4c38-9e78-1b85176d3ce5 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:22.169036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 310/616] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:18:22.175847 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cbc02-d26d-4fdb-be52-2743cbd36ac5 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:22.176134 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cbc02-d26d-4fdb-be52-2743cbd36ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:22.176412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cbc02-d26d-4fdb-be52-2743cbd36ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:22.210352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-2f7cbc02-d26d-4fdb-be52-2743cbd36ac5 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:22.211573 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2f7cbc02-d26d-4fdb-be52-2743cbd36ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:22.270553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9354d4c-a279-401b-8ce2-91cc2bfc8f4b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:22.326920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 311/617] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:18:22.353115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7cbc02-d26d-4fdb-be52-2743cbd36ac5 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:22.375808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c09ef3-713f-40b9-8555-55e36c41b73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:22.376621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09ef3-713f-40b9-8555-55e36c41b73b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:22.376906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09ef3-713f-40b9-8555-55e36c41b73b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:22.377182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09ef3-713f-40b9-8555-55e36c41b73b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:22.407040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c09ef3-713f-40b9-8555-55e36c41b73b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:22.408533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c09ef3-713f-40b9-8555-55e36c41b73b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:22.440879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-12c09ef3-713f-40b9-8555-55e36c41b73b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:22.440879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:22.440879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:22.440879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:22.440879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:22.440879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:22.440879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:22.440879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:22.440879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:22.440879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:22.440879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:22.440879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:22.440879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:22.440879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:22.440879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:22.441811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:22.442747 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:22.442747 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:22.442747 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:22.442747 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:22.448422 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 307/618] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:22.453654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c09ef3-713f-40b9-8555-55e36c41b73b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:22.492293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7cbc02-d26d-4fdb-be52-2743cbd36ac5 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:22.552314 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791ce3c-15c1-4808-8b3b-64a8667cb292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:22.553456 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791ce3c-15c1-4808-8b3b-64a8667cb292 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:22.553841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791ce3c-15c1-4808-8b3b-64a8667cb292 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:22.554290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791ce3c-15c1-4808-8b3b-64a8667cb292 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:22.566531 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c09ef3-713f-40b9-8555-55e36c41b73b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:22.575519 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791ce3c-15c1-4808-8b3b-64a8667cb292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-2791ce3c-15c1-4808-8b3b-64a8667cb292 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:22.588033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:22.589004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:22.594593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:22.594593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:22.594593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:22.594593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:22.594593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:22.594593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:22.594593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:22.594593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:22.594593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:22.594593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:22.594593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:22.594593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:22.594593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 312/619] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:22.607616 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791ce3c-15c1-4808-8b3b-64a8667cb292 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:22.610976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf8c5f-cb76-4985-b4a6-82bb19b1e97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:22.611815 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf8c5f-cb76-4985-b4a6-82bb19b1e97b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:22.612246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf8c5f-cb76-4985-b4a6-82bb19b1e97b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:22.612692 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf8c5f-cb76-4985-b4a6-82bb19b1e97b None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:22.613564 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf8c5f-cb76-4985-b4a6-82bb19b1e97b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:22.614039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf8c5f-cb76-4985-b4a6-82bb19b1e97b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:22.615590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf8c5f-cb76-4985-b4a6-82bb19b1e97b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:22.629573 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 308/620] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:22.638199 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf8c5f-cb76-4985-b4a6-82bb19b1e97b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:22.744872 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf8c5f-cb76-4985-b4a6-82bb19b1e97b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:22.780323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b273c-7856-4e93-88d6-38da00e5fb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:22.781365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b273c-7856-4e93-88d6-38da00e5fb90 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:22.781819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b273c-7856-4e93-88d6-38da00e5fb90 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:22.782288 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b273c-7856-4e93-88d6-38da00e5fb90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:22.789471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b273c-7856-4e93-88d6-38da00e5fb90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:22.791114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b273c-7856-4e93-88d6-38da00e5fb90 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:22.806476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-826b273c-7856-4e93-88d6-38da00e5fb90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:22.806476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:22.806476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:22.806476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:22.806476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:22.806476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:22.806476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:22.806476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:22.806476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:22.806476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:22.806476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:22.806476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:22.806476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:22.806476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:22.806476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:22.807615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:22.809250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:22.809250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:22.809250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:22.809250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:22.809250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:22.809250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:22.809250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:22.809250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:22.811420 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 309/621] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:22.817636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b273c-7856-4e93-88d6-38da00e5fb90 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:22.889235 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791ce3c-15c1-4808-8b3b-64a8667cb292 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:22.922549 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b273c-7856-4e93-88d6-38da00e5fb90 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:22.959985 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182af2a0-d96d-49d5-b204-3dc8a9b56402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:22.961400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182af2a0-d96d-49d5-b204-3dc8a9b56402 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:22.961971 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182af2a0-d96d-49d5-b204-3dc8a9b56402 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:22.963298 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182af2a0-d96d-49d5-b204-3dc8a9b56402 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:22.964676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182af2a0-d96d-49d5-b204-3dc8a9b56402 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:22.965580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182af2a0-d96d-49d5-b204-3dc8a9b56402 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:22.968925 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9b7fb-ee9a-4677-bdaa-ed29c82ca3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:22.969793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182af2a0-d96d-49d5-b204-3dc8a9b56402 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:22.970618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9b7fb-ee9a-4677-bdaa-ed29c82ca3c9 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:22.972686 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9b7fb-ee9a-4677-bdaa-ed29c82ca3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:22.973105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9b7fb-ee9a-4677-bdaa-ed29c82ca3c9 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:22.973988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9b7fb-ee9a-4677-bdaa-ed29c82ca3c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:22.975647 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9b7fb-ee9a-4677-bdaa-ed29c82ca3c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:22.977168 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9b7fb-ee9a-4677-bdaa-ed29c82ca3c9 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:22.992596 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 310/622] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:23.001637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182af2a0-d96d-49d5-b204-3dc8a9b56402 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:23.001838 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 313/623] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:23.006271 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9b7fb-ee9a-4677-bdaa-ed29c82ca3c9 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:23.124042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9b7fb-ee9a-4677-bdaa-ed29c82ca3c9 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:23.166580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba0cd1-d067-4873-b076-af38a548185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:23.168705 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba0cd1-d067-4873-b076-af38a548185a None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:23.169974 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba0cd1-d067-4873-b076-af38a548185a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:23.170436 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba0cd1-d067-4873-b076-af38a548185a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:23.194623 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba0cd1-d067-4873-b076-af38a548185a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:23.197415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba0cd1-d067-4873-b076-af38a548185a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:23.220264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-41ba0cd1-d067-4873-b076-af38a548185a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:23.220264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:23.220264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:23.220264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:23.220264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:23.220264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:23.220264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:23.220264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:23.220264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:23.220264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:23.220264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:23.220264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:23.220264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:23.220264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:23.220264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:23.221236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:23.222600 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:23.222600 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:23.222600 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:23.222600 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:23.222600 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 314/624] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:23.227653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba0cd1-d067-4873-b076-af38a548185a None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:23.250320 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182af2a0-d96d-49d5-b204-3dc8a9b56402 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:23.341855 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b75aef-488c-4f34-abce-83b7b4baaff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:23.342771 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b75aef-488c-4f34-abce-83b7b4baaff9 None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:23.343046 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b75aef-488c-4f34-abce-83b7b4baaff9 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:23.343311 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b75aef-488c-4f34-abce-83b7b4baaff9 None admin] PATH_INFO: `/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/055264c31c9e4d3dbf234a362ee82698/roles/4aa22f352696432bbf8fcd9d74ba0dc7` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:23.352266 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba0cd1-d067-4873-b076-af38a548185a None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:23.360414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b75aef-488c-4f34-abce-83b7b4baaff9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac7d1119033458393ad6f78fc0df7a3, user_id=055264c31c9e4d3dbf234a362ee82698, role_id=4aa22f352696432bbf8fcd9d74ba0dc7)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:23.361864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b75aef-488c-4f34-abce-83b7b4baaff9 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:23.377803 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 311/625] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:18:23 2022] PUT /identity/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/055264c31c9e4d3dbf234a362ee82698/roles/4aa22f352696432bbf8fcd9d74ba0dc7 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:18:23.379719 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e3d1a-fc2e-4379-be6b-181b710c40bf None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:23.380007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e3d1a-fc2e-4379-be6b-181b710c40bf None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:23.380376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e3d1a-fc2e-4379-be6b-181b710c40bf None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:23.386511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 312/626] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:23.389788 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc261730-3800-42f0-b0a2-0becfc38c696 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:23.390143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc261730-3800-42f0-b0a2-0becfc38c696 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:23.390547 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc261730-3800-42f0-b0a2-0becfc38c696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:23.401350 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409824ea-f0df-4850-9c76-8b89174c2041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:23.403026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409824ea-f0df-4850-9c76-8b89174c2041 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:23.403496 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409824ea-f0df-4850-9c76-8b89174c2041 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:23.403954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409824ea-f0df-4850-9c76-8b89174c2041 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:23.405627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409824ea-f0df-4850-9c76-8b89174c2041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:23.406221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409824ea-f0df-4850-9c76-8b89174c2041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:23.408223 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409824ea-f0df-4850-9c76-8b89174c2041 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:23.419713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-fc261730-3800-42f0-b0a2-0becfc38c696 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:23.420952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-fc261730-3800-42f0-b0a2-0becfc38c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:23.440876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 315/627] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:23.450129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409824ea-f0df-4850-9c76-8b89174c2041 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:23.576108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 313/628] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:18:23.603190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc261730-3800-42f0-b0a2-0becfc38c696 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:23.625358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409824ea-f0df-4850-9c76-8b89174c2041 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:23.661972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a8489-9298-4315-ae5a-826f6811a966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:23.663091 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a8489-9298-4315-ae5a-826f6811a966 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:23.663529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a8489-9298-4315-ae5a-826f6811a966 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:23.663951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a8489-9298-4315-ae5a-826f6811a966 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:23.673937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a8489-9298-4315-ae5a-826f6811a966 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:23.675786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a8489-9298-4315-ae5a-826f6811a966 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-f82a8489-9298-4315-ae5a-826f6811a966 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:23.693213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:23.694260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:23.695215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:23.695215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:23.695215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:23.695215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:23.695215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:23.695215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:23.695215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:23.695215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:23.695215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 14:18:23.695215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:23.698147 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 316/629] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 14:18:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:23.706633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a8489-9298-4315-ae5a-826f6811a966 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:23.740831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc261730-3800-42f0-b0a2-0becfc38c696 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:23.797864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263adfb0-0b62-4ff3-82e1-a05c3de663bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:23.798709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263adfb0-0b62-4ff3-82e1-a05c3de663bc None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:23.798982 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263adfb0-0b62-4ff3-82e1-a05c3de663bc None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:23.799246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263adfb0-0b62-4ff3-82e1-a05c3de663bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:23.819466 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263adfb0-0b62-4ff3-82e1-a05c3de663bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-263adfb0-0b62-4ff3-82e1-a05c3de663bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:23.827514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:23.828442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:23.829831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:23.829831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:23.829831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:23.829831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:23.829831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:23.829831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:23.829831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:23.829831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:23.829831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:23.829831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:23.829831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:23.829831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:23.829831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 314/630] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:23.837647 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263adfb0-0b62-4ff3-82e1-a05c3de663bc None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:23.846810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a8489-9298-4315-ae5a-826f6811a966 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:23.906939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff86fa-f2f1-4ba5-b98d-3343fbecc2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:23.907634 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff86fa-f2f1-4ba5-b98d-3343fbecc2a4 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:23.907923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff86fa-f2f1-4ba5-b98d-3343fbecc2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:23.908204 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff86fa-f2f1-4ba5-b98d-3343fbecc2a4 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:23.909313 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff86fa-f2f1-4ba5-b98d-3343fbecc2a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:23.909443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff86fa-f2f1-4ba5-b98d-3343fbecc2a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:23.910928 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff86fa-f2f1-4ba5-b98d-3343fbecc2a4 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:23.930900 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 317/631] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 14:18:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:23.932336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8294d2a-0d18-4468-bc2b-e04fd68dc54c None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:23.932642 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8294d2a-0d18-4468-bc2b-e04fd68dc54c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:23.932925 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8294d2a-0d18-4468-bc2b-e04fd68dc54c None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:23.938305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 318/632] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:23.939230 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8294d2a-0d18-4468-bc2b-e04fd68dc54c None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:23.984693 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263adfb0-0b62-4ff3-82e1-a05c3de663bc None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:24.033205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3291809-76c1-43de-a4c3-70d8c439a72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:24.034168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3291809-76c1-43de-a4c3-70d8c439a72e None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:24.034637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3291809-76c1-43de-a4c3-70d8c439a72e None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:24.035059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3291809-76c1-43de-a4c3-70d8c439a72e None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:24.036383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3291809-76c1-43de-a4c3-70d8c439a72e None admin] RBAC: Adding query filter params (name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:24.037094 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3291809-76c1-43de-a4c3-70d8c439a72e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:24.039135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3291809-76c1-43de-a4c3-70d8c439a72e None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:24.050671 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8294d2a-0d18-4468-bc2b-e04fd68dc54c None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:24.057212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 315/633] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:24.057212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1443bbf-f49c-4c24-aabd-081f0726efd7 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:24.057212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1443bbf-f49c-4c24-aabd-081f0726efd7 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:24.057212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1443bbf-f49c-4c24-aabd-081f0726efd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:24.074037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-c1443bbf-f49c-4c24-aabd-081f0726efd7 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:24.075091 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c1443bbf-f49c-4c24-aabd-081f0726efd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:24.097692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a6660-6e92-4a9e-8af1-6245f7924e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:24.098725 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a6660-6e92-4a9e-8af1-6245f7924e57 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:24.098725 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a6660-6e92-4a9e-8af1-6245f7924e57 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:24.099029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a6660-6e92-4a9e-8af1-6245f7924e57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:24.146210 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 316/634] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:24.147493 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1443bbf-f49c-4c24-aabd-081f0726efd7 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:24.188786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a6660-6e92-4a9e-8af1-6245f7924e57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:24.194365 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a6660-6e92-4a9e-8af1-6245f7924e57 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:24.253634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1443bbf-f49c-4c24-aabd-081f0726efd7 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:24.289588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afa5c8-70e1-44fe-9de2-6b5a78fc74e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:24.290793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afa5c8-70e1-44fe-9de2-6b5a78fc74e1 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:24.291381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afa5c8-70e1-44fe-9de2-6b5a78fc74e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:24.291850 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afa5c8-70e1-44fe-9de2-6b5a78fc74e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:24.301564 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 319/635] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:18:24.302450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a6660-6e92-4a9e-8af1-6245f7924e57 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:24.303108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afa5c8-70e1-44fe-9de2-6b5a78fc74e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:24.304790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afa5c8-70e1-44fe-9de2-6b5a78fc74e1 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:24.323282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-38afa5c8-70e1-44fe-9de2-6b5a78fc74e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:24.323282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:24.323282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:24.323282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:24.323282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:24.323282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:24.323282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:24.323282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:24.323282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:24.323282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:24.323282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:24.323282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:24.323282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:24.323282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:24.323282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:24.324278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:24.325163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:24.325163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:24.325163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:24.325163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:24.327410 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 317/636] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:24.332946 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afa5c8-70e1-44fe-9de2-6b5a78fc74e1 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:24.403338 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a6660-6e92-4a9e-8af1-6245f7924e57 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:24.434589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afa5c8-70e1-44fe-9de2-6b5a78fc74e1 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:24.439675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f8056-5534-4fa4-81ad-f3399b2a96a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:24.440426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f8056-5534-4fa4-81ad-f3399b2a96a9 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:24.440710 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f8056-5534-4fa4-81ad-f3399b2a96a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:24.440989 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f8056-5534-4fa4-81ad-f3399b2a96a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:24.451821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f8056-5534-4fa4-81ad-f3399b2a96a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-f62f8056-5534-4fa4-81ad-f3399b2a96a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:24.459790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:24.460722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:24.461572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:24.461572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:24.461572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:24.461572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:24.461572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:24.461572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:24.461572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:24.461572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:24.461572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:24.461572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:24.461572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:24.461572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:24.461572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 320/637] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:24.462863 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f8056-5534-4fa4-81ad-f3399b2a96a9 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:24.475691 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f809f-783a-4894-8631-4cfec0f8feeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:24.476486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f809f-783a-4894-8631-4cfec0f8feeb None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:24.476771 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f809f-783a-4894-8631-4cfec0f8feeb None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:24.477050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f809f-783a-4894-8631-4cfec0f8feeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:24.487120 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f809f-783a-4894-8631-4cfec0f8feeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:24.488574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f809f-783a-4894-8631-4cfec0f8feeb None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:24.505613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-5c7f809f-783a-4894-8631-4cfec0f8feeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:24.505613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:24.505613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:24.505613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:24.505613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:24.505613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:24.505613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:24.505613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:24.505613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:24.505613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:24.505613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:24.505613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:24.505613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:24.505613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:24.505613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:24.506723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:24.507634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:24.507634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:24.507634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:24.507634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:24.507634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 318/638] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:24.508204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fed7c-f854-4884-8483-73023ddb01a2 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:24.508376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fed7c-f854-4884-8483-73023ddb01a2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:24.508674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fed7c-f854-4884-8483-73023ddb01a2 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:24.514455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 319/639] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:24.514455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fed7c-f854-4884-8483-73023ddb01a2 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:24.568146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f8056-5534-4fa4-81ad-f3399b2a96a9 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:24.600718 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6f70e-0a4a-400a-86a7-4657bde33925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:24.601372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6f70e-0a4a-400a-86a7-4657bde33925 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:24.601662 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6f70e-0a4a-400a-86a7-4657bde33925 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:24.601930 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6f70e-0a4a-400a-86a7-4657bde33925 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:24.602682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6f70e-0a4a-400a-86a7-4657bde33925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:24.603006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6f70e-0a4a-400a-86a7-4657bde33925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:24.604354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6f70e-0a4a-400a-86a7-4657bde33925 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:24.613469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fed7c-f854-4884-8483-73023ddb01a2 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:24.616069 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 321/640] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:24.616866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6f70e-0a4a-400a-86a7-4657bde33925 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:24.651681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759efb4e-bda7-4b57-8fc6-a11ee041db5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:24.652525 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759efb4e-bda7-4b57-8fc6-a11ee041db5a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:24.652813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759efb4e-bda7-4b57-8fc6-a11ee041db5a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:24.653092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759efb4e-bda7-4b57-8fc6-a11ee041db5a None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:24.653842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759efb4e-bda7-4b57-8fc6-a11ee041db5a None admin] RBAC: Adding query filter params (name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:24.654149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759efb4e-bda7-4b57-8fc6-a11ee041db5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:24.655619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759efb4e-bda7-4b57-8fc6-a11ee041db5a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:24.663555 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 320/641] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:24.669691 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d534a-6cba-4fba-92d8-e187cb957bec None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:24.669984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d534a-6cba-4fba-92d8-e187cb957bec None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:24.670292 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d534a-6cba-4fba-92d8-e187cb957bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:24.686118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-9a3d534a-6cba-4fba-92d8-e187cb957bec None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:24.687333 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-9a3d534a-6cba-4fba-92d8-e187cb957bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:24.717632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6f70e-0a4a-400a-86a7-4657bde33925 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:24.752559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78511bda-7ea4-430c-93d0-1149b4eb0fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:24.753240 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78511bda-7ea4-430c-93d0-1149b4eb0fea None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:24.753613 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78511bda-7ea4-430c-93d0-1149b4eb0fea None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:24.753896 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78511bda-7ea4-430c-93d0-1149b4eb0fea None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:24.754659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78511bda-7ea4-430c-93d0-1149b4eb0fea None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:24.754970 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78511bda-7ea4-430c-93d0-1149b4eb0fea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:24.756429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78511bda-7ea4-430c-93d0-1149b4eb0fea None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:24.762708 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 321/642] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:24.764367 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d534a-6cba-4fba-92d8-e187cb957bec None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:24.773375 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 322/643] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:24.774318 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78511bda-7ea4-430c-93d0-1149b4eb0fea None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:24.867224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d534a-6cba-4fba-92d8-e187cb957bec None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:24.876341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78511bda-7ea4-430c-93d0-1149b4eb0fea None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:24.900911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1519ba5-33ea-4f9c-a58d-cc71cb6905da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:24.902254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1519ba5-33ea-4f9c-a58d-cc71cb6905da None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:24.902541 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1519ba5-33ea-4f9c-a58d-cc71cb6905da None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:24.902813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1519ba5-33ea-4f9c-a58d-cc71cb6905da None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:24.909681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1519ba5-33ea-4f9c-a58d-cc71cb6905da None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:24.910259 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83419ccd-5e15-4876-8b76-3bff513c0492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:24.911048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83419ccd-5e15-4876-8b76-3bff513c0492 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:24.911145 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1519ba5-33ea-4f9c-a58d-cc71cb6905da None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:24.911328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83419ccd-5e15-4876-8b76-3bff513c0492 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:24.911603 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83419ccd-5e15-4876-8b76-3bff513c0492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:24.922535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83419ccd-5e15-4876-8b76-3bff513c0492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:24.924023 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83419ccd-5e15-4876-8b76-3bff513c0492 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-f1519ba5-33ea-4f9c-a58d-cc71cb6905da None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:24.927138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:24.928200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:24.929182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:24.929182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:24.929182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:24.929182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:24.929182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:24.929182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:24.929182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:24.929182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:24.929182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 14:18:24.929182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:24.932818 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 322/644] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:18:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:24.934518 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1519ba5-33ea-4f9c-a58d-cc71cb6905da None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:24.942141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-83419ccd-5e15-4876-8b76-3bff513c0492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:24.942141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:24.942141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:24.942141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:24.942141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:24.942141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:24.942141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:24.942141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:24.942141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:24.942141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:24.942141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:24.942141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:24.942141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:24.942141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:24.942141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:24.944665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:24.946901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:24.946901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:24.946901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:24.946901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:24.946901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 323/645] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:24.946901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83419ccd-5e15-4876-8b76-3bff513c0492 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:25.041374 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1519ba5-33ea-4f9c-a58d-cc71cb6905da None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:25.041811 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83419ccd-5e15-4876-8b76-3bff513c0492 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:25.075170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3f880-7247-4700-87af-5f5edac8295f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:25.075975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3f880-7247-4700-87af-5f5edac8295f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:25.076364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3f880-7247-4700-87af-5f5edac8295f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:25.076639 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3f880-7247-4700-87af-5f5edac8295f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:25.081921 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645bfb4-7e1c-49bc-aa00-64351ab84528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:25.082746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645bfb4-7e1c-49bc-aa00-64351ab84528 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:25.083031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645bfb4-7e1c-49bc-aa00-64351ab84528 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:25.083310 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645bfb4-7e1c-49bc-aa00-64351ab84528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:25.088030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3f880-7247-4700-87af-5f5edac8295f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:25.090969 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645bfb4-7e1c-49bc-aa00-64351ab84528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:25.092424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645bfb4-7e1c-49bc-aa00-64351ab84528 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-3ce3f880-7247-4700-87af-5f5edac8295f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:25.096426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:25.097347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:25.098194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:25.098194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:25.098194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:25.098194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:25.098194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:25.098194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:25.098194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:25.098194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:25.098194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:25.098194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:25.098194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:25.098194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:25.098194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 324/646] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:25.098895 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3f880-7247-4700-87af-5f5edac8295f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:25.111331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-b645bfb4-7e1c-49bc-aa00-64351ab84528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:25.111331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:25.111331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:25.111331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:25.111331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:25.111331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:25.111331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:25.111331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:25.111331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:25.111331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:25.111331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:25.111331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:25.111331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:25.111331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:25.111331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:25.112260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:25.113129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:25.113129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:25.113129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:25.113129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:25.113129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:25.113129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:25.113129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:25.113129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:25.113129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 323/647] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:25.113616 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645bfb4-7e1c-49bc-aa00-64351ab84528 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:25.211555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3f880-7247-4700-87af-5f5edac8295f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:25.217193 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645bfb4-7e1c-49bc-aa00-64351ab84528 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:25.245397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e6206-5e7a-43e9-b078-3f8c1e718c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:25.247222 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e6206-5e7a-43e9-b078-3f8c1e718c6f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:25.247528 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e6206-5e7a-43e9-b078-3f8c1e718c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:25.247894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e6206-5e7a-43e9-b078-3f8c1e718c6f None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:25.248734 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e6206-5e7a-43e9-b078-3f8c1e718c6f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:25.249043 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e6206-5e7a-43e9-b078-3f8c1e718c6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:25.250510 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e6206-5e7a-43e9-b078-3f8c1e718c6f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:25.254563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bf92d-a7f7-45ee-8c51-d5414f2d490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:25.255232 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bf92d-a7f7-45ee-8c51-d5414f2d490d None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:25.255509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bf92d-a7f7-45ee-8c51-d5414f2d490d None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:25.255835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bf92d-a7f7-45ee-8c51-d5414f2d490d None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:25.256558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bf92d-a7f7-45ee-8c51-d5414f2d490d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:25.256860 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bf92d-a7f7-45ee-8c51-d5414f2d490d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:25.258259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bf92d-a7f7-45ee-8c51-d5414f2d490d None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:25.268675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 325/648] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 17 14:18:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:25.269894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e6206-5e7a-43e9-b078-3f8c1e718c6f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:25.275349 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 324/649] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:25.276202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bf92d-a7f7-45ee-8c51-d5414f2d490d None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:25.377738 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e6206-5e7a-43e9-b078-3f8c1e718c6f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:25.378832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bf92d-a7f7-45ee-8c51-d5414f2d490d None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:25.413402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8fecb-a2c1-41dc-addc-8985e002c571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:25.414211 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8fecb-a2c1-41dc-addc-8985e002c571 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:25.414491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8fecb-a2c1-41dc-addc-8985e002c571 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:25.414768 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8fecb-a2c1-41dc-addc-8985e002c571 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:25.415528 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8fecb-a2c1-41dc-addc-8985e002c571 None admin] RBAC: Adding query filter params (name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:25.415840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8fecb-a2c1-41dc-addc-8985e002c571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:25.416696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad68b4-ef30-4679-b6a2-75216a4fda65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:25.417800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8fecb-a2c1-41dc-addc-8985e002c571 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:25.418266 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad68b4-ef30-4679-b6a2-75216a4fda65 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:25.418956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad68b4-ef30-4679-b6a2-75216a4fda65 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:25.419236 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad68b4-ef30-4679-b6a2-75216a4fda65 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:25.420042 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad68b4-ef30-4679-b6a2-75216a4fda65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:25.420351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad68b4-ef30-4679-b6a2-75216a4fda65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:25.421835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad68b4-ef30-4679-b6a2-75216a4fda65 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:25.431541 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 326/650] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:25.431541 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8fecb-a2c1-41dc-addc-8985e002c571 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:25.439155 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 325/651] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:25.439155 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad68b4-ef30-4679-b6a2-75216a4fda65 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:25.537015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad68b4-ef30-4679-b6a2-75216a4fda65 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:25.542126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8fecb-a2c1-41dc-addc-8985e002c571 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:25.571439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a614c1-9c42-4854-8456-817b4afbbda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:25.572703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a614c1-9c42-4854-8456-817b4afbbda8 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:25.572995 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a614c1-9c42-4854-8456-817b4afbbda8 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:25.573630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a614c1-9c42-4854-8456-817b4afbbda8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:25.577253 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699412c-396c-4a89-88cb-47770c5bdd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:25.577898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699412c-396c-4a89-88cb-47770c5bdd21 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:25.578204 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699412c-396c-4a89-88cb-47770c5bdd21 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:25.578489 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699412c-396c-4a89-88cb-47770c5bdd21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:25.582931 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a614c1-9c42-4854-8456-817b4afbbda8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:25.584384 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a614c1-9c42-4854-8456-817b4afbbda8 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-00a614c1-9c42-4854-8456-817b4afbbda8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:25.599097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:25.600253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:25.606421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:25.606421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:25.606421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:25.606421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:25.606421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:25.606421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:25.606421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:25.606421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:25.606421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 14:18:25.606421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:25.606421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 326/652] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:18:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:25.606421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a614c1-9c42-4854-8456-817b4afbbda8 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:25.658285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699412c-396c-4a89-88cb-47770c5bdd21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:25.659907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699412c-396c-4a89-88cb-47770c5bdd21 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:25.711302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a614c1-9c42-4854-8456-817b4afbbda8 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:25.750296 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe3042-7bdd-4c4b-833b-ab041933d23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:25.751098 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe3042-7bdd-4c4b-833b-ab041933d23a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:25.751381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe3042-7bdd-4c4b-833b-ab041933d23a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:25.751661 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe3042-7bdd-4c4b-833b-ab041933d23a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:25.763299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe3042-7bdd-4c4b-833b-ab041933d23a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:25.768891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 327/653] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:18:25.769029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe3042-7bdd-4c4b-833b-ab041933d23a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:25.769108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699412c-396c-4a89-88cb-47770c5bdd21 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:25.786054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-b3fe3042-7bdd-4c4b-833b-ab041933d23a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:25.786054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:25.786054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:25.786054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:25.786054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:25.786054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:25.786054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:25.786054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:25.786054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:25.786054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:25.786054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:25.786054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:25.786054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:25.786054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:25.786054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:25.787057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:25.787936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:25.787936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:25.787936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:25.787936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:25.787936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 327/654] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:25.788217 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe3042-7bdd-4c4b-833b-ab041933d23a None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:25.864580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699412c-396c-4a89-88cb-47770c5bdd21 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:25.891024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe3042-7bdd-4c4b-833b-ab041933d23a None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:25.897248 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7858c-b24c-4cdb-88d8-0d84d65f2b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:25.897898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7858c-b24c-4cdb-88d8-0d84d65f2b87 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:25.898192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7858c-b24c-4cdb-88d8-0d84d65f2b87 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:25.898480 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7858c-b24c-4cdb-88d8-0d84d65f2b87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:25.899299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7858c-b24c-4cdb-88d8-0d84d65f2b87 None admin] RBAC: Adding query filter params (role.id=4aa22f352696432bbf8fcd9d74ba0dc7, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=1f443d2ca1534249bb2c4096300ddffd) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:25.899606 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7858c-b24c-4cdb-88d8-0d84d65f2b87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:25.901043 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7858c-b24c-4cdb-88d8-0d84d65f2b87 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:25.907320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 328/655] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:25 2022] GET /identity/v3/role_assignments?user.id=1f443d2ca1534249bb2c4096300ddffd&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=4aa22f352696432bbf8fcd9d74ba0dc7 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:25.908092 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7858c-b24c-4cdb-88d8-0d84d65f2b87 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:25.925465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8bf1c-2283-4392-9ce6-15ccdc5b7dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:25.926083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8bf1c-2283-4392-9ce6-15ccdc5b7dad None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:25.926403 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8bf1c-2283-4392-9ce6-15ccdc5b7dad None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:25.926681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8bf1c-2283-4392-9ce6-15ccdc5b7dad None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:25.927552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8bf1c-2283-4392-9ce6-15ccdc5b7dad None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:25.927865 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8bf1c-2283-4392-9ce6-15ccdc5b7dad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:25.929377 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8bf1c-2283-4392-9ce6-15ccdc5b7dad None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:25.949728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 328/656] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 17 14:18:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:25.950492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8bf1c-2283-4392-9ce6-15ccdc5b7dad None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:26.014954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7858c-b24c-4cdb-88d8-0d84d65f2b87 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:26.050630 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae45d29-07b4-4e3e-a554-65227b54ba8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:26.051793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae45d29-07b4-4e3e-a554-65227b54ba8d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:26.052267 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae45d29-07b4-4e3e-a554-65227b54ba8d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:26.052540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae45d29-07b4-4e3e-a554-65227b54ba8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:26.054714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8bf1c-2283-4392-9ce6-15ccdc5b7dad None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:26.065705 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae45d29-07b4-4e3e-a554-65227b54ba8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:26.065913 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae45d29-07b4-4e3e-a554-65227b54ba8d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:26.084257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-1ae45d29-07b4-4e3e-a554-65227b54ba8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:26.084257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:26.084257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:26.084257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:26.084257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:26.084257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:26.084257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:26.084257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:26.084257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:26.084257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:26.084257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:26.084257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:26.084257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:26.084257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:26.084257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:26.085774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:26.086860 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:26.086860 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:26.086860 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:26.086860 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:26.086860 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 329/657] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:26.087206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b48f26-5465-45bb-9493-8dfaf6d59bfd None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:26.087611 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b48f26-5465-45bb-9493-8dfaf6d59bfd None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:26.087761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b48f26-5465-45bb-9493-8dfaf6d59bfd None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:26.089335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 330/658] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:26.090357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b48f26-5465-45bb-9493-8dfaf6d59bfd None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:26.097408 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997efce-a340-4543-8efd-d0a79281568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:26.098079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997efce-a340-4543-8efd-d0a79281568a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:26.098882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997efce-a340-4543-8efd-d0a79281568a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:26.098882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997efce-a340-4543-8efd-d0a79281568a None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:26.099356 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997efce-a340-4543-8efd-d0a79281568a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:26.099677 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997efce-a340-4543-8efd-d0a79281568a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:26.101033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997efce-a340-4543-8efd-d0a79281568a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:26.113368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 329/659] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:26.114034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997efce-a340-4543-8efd-d0a79281568a None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:26.207231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b48f26-5465-45bb-9493-8dfaf6d59bfd None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:26.224464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997efce-a340-4543-8efd-d0a79281568a None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:26.239423 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5ae44-7e46-49c4-8a96-95b556f7485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:26.240069 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5ae44-7e46-49c4-8a96-95b556f7485f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:26.240398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5ae44-7e46-49c4-8a96-95b556f7485f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:26.240600 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5ae44-7e46-49c4-8a96-95b556f7485f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:26.260695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06040726-6d9e-4484-b5bb-415be7d7020a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:26.262001 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06040726-6d9e-4484-b5bb-415be7d7020a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:26.262220 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06040726-6d9e-4484-b5bb-415be7d7020a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:26.262655 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06040726-6d9e-4484-b5bb-415be7d7020a None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:26.263386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06040726-6d9e-4484-b5bb-415be7d7020a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:26.263696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06040726-6d9e-4484-b5bb-415be7d7020a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:26.265084 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06040726-6d9e-4484-b5bb-415be7d7020a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:26.281280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 330/660] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:26.281280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e05898-0096-478b-b99d-fcdd7696c19c None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:26.281280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e05898-0096-478b-b99d-fcdd7696c19c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:26.281280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e05898-0096-478b-b99d-fcdd7696c19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:26.295959 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-66e05898-0096-478b-b99d-fcdd7696c19c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:26.297142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-66e05898-0096-478b-b99d-fcdd7696c19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:26.309065 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5ae44-7e46-49c4-8a96-95b556f7485f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:26.310637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5ae44-7e46-49c4-8a96-95b556f7485f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:26.375888 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 331/661] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:26.375888 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e05898-0096-478b-b99d-fcdd7696c19c None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:26.416603 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 331/662] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:18:26.419016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5ae44-7e46-49c4-8a96-95b556f7485f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:26.480499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e05898-0096-478b-b99d-fcdd7696c19c None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:26.515673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0530780-713c-4ef9-9623-9a6976f20e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:26.516518 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0530780-713c-4ef9-9623-9a6976f20e43 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:26.516808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0530780-713c-4ef9-9623-9a6976f20e43 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:26.517091 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0530780-713c-4ef9-9623-9a6976f20e43 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:26.524746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5ae44-7e46-49c4-8a96-95b556f7485f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:26.524875 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0530780-713c-4ef9-9623-9a6976f20e43 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:26.526300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0530780-713c-4ef9-9623-9a6976f20e43 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-b0530780-713c-4ef9-9623-9a6976f20e43 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:26.541397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:26.542728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:26.543846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:26.543846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:26.543846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:26.543846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:26.543846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:26.543846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:26.543846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:26.543846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:26.543846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 14:18:26.543846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:26.543846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 332/663] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:26.543846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0530780-713c-4ef9-9623-9a6976f20e43 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:26.562374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f420c15-fdd4-442f-bca2-5b273e75aa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:26.563160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f420c15-fdd4-442f-bca2-5b273e75aa04 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:26.563434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f420c15-fdd4-442f-bca2-5b273e75aa04 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:26.563701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f420c15-fdd4-442f-bca2-5b273e75aa04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:26.570160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f420c15-fdd4-442f-bca2-5b273e75aa04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:26.571641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f420c15-fdd4-442f-bca2-5b273e75aa04 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:26.585867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-5f420c15-fdd4-442f-bca2-5b273e75aa04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:26.585867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:26.585867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:26.585867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:26.585867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:26.585867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:26.585867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:26.585867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:26.585867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:26.585867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:26.585867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:26.585867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:26.585867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:26.585867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:26.585867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:26.587006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:26.588192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:26.588192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:26.588192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:26.588192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:26.588192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:26.588192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:26.588192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:26.588192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:26.592473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 332/664] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:26.592473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f420c15-fdd4-442f-bca2-5b273e75aa04 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:26.657271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0530780-713c-4ef9-9623-9a6976f20e43 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:26.692316 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36dc53-e177-4590-9bc8-1bbd8f060e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:26.693117 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36dc53-e177-4590-9bc8-1bbd8f060e5c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:26.693400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36dc53-e177-4590-9bc8-1bbd8f060e5c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:26.693674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36dc53-e177-4590-9bc8-1bbd8f060e5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:26.697392 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f420c15-fdd4-442f-bca2-5b273e75aa04 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:26.703687 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36dc53-e177-4590-9bc8-1bbd8f060e5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-7a36dc53-e177-4590-9bc8-1bbd8f060e5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:26.711700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:26.712619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:26.718874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:26.718874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:26.718874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:26.718874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:26.718874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:26.718874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:26.718874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:26.718874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:26.718874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:26.718874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:26.718874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:26.718874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:26.718874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 333/665] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:26.718874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36dc53-e177-4590-9bc8-1bbd8f060e5c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:26.732416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8599d-9c52-46f3-b620-1c3b7a6598c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:26.733146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8599d-9c52-46f3-b620-1c3b7a6598c4 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:26.733430 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8599d-9c52-46f3-b620-1c3b7a6598c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:26.733708 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8599d-9c52-46f3-b620-1c3b7a6598c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:26.744284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8599d-9c52-46f3-b620-1c3b7a6598c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:26.746352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8599d-9c52-46f3-b620-1c3b7a6598c4 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:26.764256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-62d8599d-9c52-46f3-b620-1c3b7a6598c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:26.764256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:26.764256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:26.764256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:26.764256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:26.764256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:26.764256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:26.764256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:26.764256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:26.764256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:26.764256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:26.764256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:26.764256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:26.764256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:26.764256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:26.765335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:26.770874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:26.770874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:26.770874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:26.770874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:26.770874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 333/666] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:26.770874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8599d-9c52-46f3-b620-1c3b7a6598c4 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:26.828393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36dc53-e177-4590-9bc8-1bbd8f060e5c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:26.861975 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedffd1-887b-4a50-b179-88916a0bcb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:26.862756 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedffd1-887b-4a50-b179-88916a0bcb51 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:26.863107 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedffd1-887b-4a50-b179-88916a0bcb51 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:26.863448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedffd1-887b-4a50-b179-88916a0bcb51 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:26.864349 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedffd1-887b-4a50-b179-88916a0bcb51 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:26.864724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedffd1-887b-4a50-b179-88916a0bcb51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:26.866262 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedffd1-887b-4a50-b179-88916a0bcb51 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:26.869180 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8599d-9c52-46f3-b620-1c3b7a6598c4 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:26.883112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 334/667] 10.222.0.48 () {56 vars in 1139 bytes} [Tue May 17 14:18:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:26.884034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedffd1-887b-4a50-b179-88916a0bcb51 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:26.902879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa42eb-6d2b-41d4-8076-b10651b61c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:26.903783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa42eb-6d2b-41d4-8076-b10651b61c6d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:26.904205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa42eb-6d2b-41d4-8076-b10651b61c6d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:26.904635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa42eb-6d2b-41d4-8076-b10651b61c6d None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:26.905551 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa42eb-6d2b-41d4-8076-b10651b61c6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:26.905998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa42eb-6d2b-41d4-8076-b10651b61c6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:26.907596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa42eb-6d2b-41d4-8076-b10651b61c6d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:26.919739 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 334/668] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:26.920785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa42eb-6d2b-41d4-8076-b10651b61c6d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:26.983504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedffd1-887b-4a50-b179-88916a0bcb51 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:27.016679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa42eb-6d2b-41d4-8076-b10651b61c6d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:27.017186 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ab243-ea1c-4ec3-a079-2c3028923d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:27.018081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ab243-ea1c-4ec3-a079-2c3028923d88 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:27.018563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ab243-ea1c-4ec3-a079-2c3028923d88 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:27.018975 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ab243-ea1c-4ec3-a079-2c3028923d88 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:27.019852 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ab243-ea1c-4ec3-a079-2c3028923d88 None admin] RBAC: Adding query filter params (name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:27.020294 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ab243-ea1c-4ec3-a079-2c3028923d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:27.021792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ab243-ea1c-4ec3-a079-2c3028923d88 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:27.033498 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 335/669] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:27.034476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ab243-ea1c-4ec3-a079-2c3028923d88 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:27.050767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa3504-c243-4cf9-b90b-77d0eaab579e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:27.051666 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa3504-c243-4cf9-b90b-77d0eaab579e None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:27.052088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa3504-c243-4cf9-b90b-77d0eaab579e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:27.052519 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa3504-c243-4cf9-b90b-77d0eaab579e None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:27.053370 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa3504-c243-4cf9-b90b-77d0eaab579e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:27.053835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa3504-c243-4cf9-b90b-77d0eaab579e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:27.055265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa3504-c243-4cf9-b90b-77d0eaab579e None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:27.066511 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 335/670] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:27.067463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa3504-c243-4cf9-b90b-77d0eaab579e None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:27.134979 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ab243-ea1c-4ec3-a079-2c3028923d88 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:27.169004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa3504-c243-4cf9-b90b-77d0eaab579e None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:27.169949 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae803fcc-deec-4981-9d50-6673ae0636f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:27.170865 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae803fcc-deec-4981-9d50-6673ae0636f3 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:27.171397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae803fcc-deec-4981-9d50-6673ae0636f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:27.171740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae803fcc-deec-4981-9d50-6673ae0636f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:27.203083 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade7ac9-c14c-4c30-9807-77a16dabc0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:27.203739 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade7ac9-c14c-4c30-9807-77a16dabc0e5 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:27.204015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade7ac9-c14c-4c30-9807-77a16dabc0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:27.204286 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade7ac9-c14c-4c30-9807-77a16dabc0e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:27.205117 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade7ac9-c14c-4c30-9807-77a16dabc0e5 None admin] RBAC: Adding query filter params (role.id=4aa22f352696432bbf8fcd9d74ba0dc7, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=f7fd6429fee94c89a6a29467b014ec5f) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:27.205429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade7ac9-c14c-4c30-9807-77a16dabc0e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:27.207150 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade7ac9-c14c-4c30-9807-77a16dabc0e5 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:27.213061 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 336/671] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:27 2022] GET /identity/v3/role_assignments?user.id=f7fd6429fee94c89a6a29467b014ec5f&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=4aa22f352696432bbf8fcd9d74ba0dc7 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:27.213799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade7ac9-c14c-4c30-9807-77a16dabc0e5 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:27.244958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae803fcc-deec-4981-9d50-6673ae0636f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:27.247084 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae803fcc-deec-4981-9d50-6673ae0636f3 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:27.328627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade7ac9-c14c-4c30-9807-77a16dabc0e5 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:27.362371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 336/672] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:18:27.364160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae803fcc-deec-4981-9d50-6673ae0636f3 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:27.367924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4802a1-f6fc-4f1b-8311-a5c3e2f72059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:27.369070 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4802a1-f6fc-4f1b-8311-a5c3e2f72059 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:27.369221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4802a1-f6fc-4f1b-8311-a5c3e2f72059 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:27.369583 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4802a1-f6fc-4f1b-8311-a5c3e2f72059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:27.381966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4802a1-f6fc-4f1b-8311-a5c3e2f72059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:27.383694 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4802a1-f6fc-4f1b-8311-a5c3e2f72059 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:27.404463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-4b4802a1-f6fc-4f1b-8311-a5c3e2f72059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:27.404463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:27.404463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:27.404463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:27.404463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:27.404463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:27.404463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:27.404463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:27.404463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:27.404463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:27.404463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:27.404463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:27.404463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:27.404463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:27.404463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:27.405431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:27.406344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:27.406344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:27.406344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:27.406344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:27.406344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 337/673] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:27.406633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4802a1-f6fc-4f1b-8311-a5c3e2f72059 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:27.479160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae803fcc-deec-4981-9d50-6673ae0636f3 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:27.517214 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4802a1-f6fc-4f1b-8311-a5c3e2f72059 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:27.519817 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79acfe-beaa-47e1-919c-5be6a84f0f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:27.520692 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79acfe-beaa-47e1-919c-5be6a84f0f13 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:27.521054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79acfe-beaa-47e1-919c-5be6a84f0f13 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:27.521403 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79acfe-beaa-47e1-919c-5be6a84f0f13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:27.529327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79acfe-beaa-47e1-919c-5be6a84f0f13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:27.530919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79acfe-beaa-47e1-919c-5be6a84f0f13 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:27.545126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-6a79acfe-beaa-47e1-919c-5be6a84f0f13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:27.545126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:27.545126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:27.545126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:27.545126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:27.545126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:27.545126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:27.545126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:27.545126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:27.545126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:27.545126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:27.545126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:27.545126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:27.545126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:27.545126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:27.546047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:27.546970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:27.546970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:27.546970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:27.546970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:27.546970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:27.546970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:27.546970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:27.546970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:27.546970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 337/674] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:27.547449 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79acfe-beaa-47e1-919c-5be6a84f0f13 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:27.558067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941ec41-37e1-4681-8b8c-bd283a25db3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:27.559693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941ec41-37e1-4681-8b8c-bd283a25db3d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:27.560158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941ec41-37e1-4681-8b8c-bd283a25db3d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:27.560610 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941ec41-37e1-4681-8b8c-bd283a25db3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:27.573985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941ec41-37e1-4681-8b8c-bd283a25db3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:27.575778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941ec41-37e1-4681-8b8c-bd283a25db3d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:27.593985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-8941ec41-37e1-4681-8b8c-bd283a25db3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:27.593985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:27.593985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:27.593985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:27.593985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:27.593985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:27.593985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:27.593985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:27.593985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:27.593985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:27.593985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:27.593985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:27.593985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:27.593985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:27.593985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:27.594922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:27.595801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:27.595801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:27.595801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:27.595801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:27.595801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 338/675] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:27.600845 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941ec41-37e1-4681-8b8c-bd283a25db3d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:27.663535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79acfe-beaa-47e1-919c-5be6a84f0f13 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:27.697711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201751ad-9572-49b4-94d4-75a4b7e280bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:27.699340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201751ad-9572-49b4-94d4-75a4b7e280bf None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:27.699830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201751ad-9572-49b4-94d4-75a4b7e280bf None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:27.700276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201751ad-9572-49b4-94d4-75a4b7e280bf None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:27.701187 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201751ad-9572-49b4-94d4-75a4b7e280bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:27.701664 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201751ad-9572-49b4-94d4-75a4b7e280bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:27.703258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201751ad-9572-49b4-94d4-75a4b7e280bf None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:27.707131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941ec41-37e1-4681-8b8c-bd283a25db3d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:27.720507 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 338/676] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:27.721680 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201751ad-9572-49b4-94d4-75a4b7e280bf None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:27.743270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4f784-9109-42e6-b9d9-b6c9a0b21c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:27.743940 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4f784-9109-42e6-b9d9-b6c9a0b21c0c None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:27.744226 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4f784-9109-42e6-b9d9-b6c9a0b21c0c None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:27.744504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4f784-9109-42e6-b9d9-b6c9a0b21c0c None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:27.745390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4f784-9109-42e6-b9d9-b6c9a0b21c0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:27.745664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4f784-9109-42e6-b9d9-b6c9a0b21c0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:27.747151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4f784-9109-42e6-b9d9-b6c9a0b21c0c None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:27.760157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 339/677] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:27.761531 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4f784-9109-42e6-b9d9-b6c9a0b21c0c None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:27.825562 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201751ad-9572-49b4-94d4-75a4b7e280bf None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:27.864175 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4f784-9109-42e6-b9d9-b6c9a0b21c0c None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:27.867773 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221ff32-2cb0-40eb-838b-ee4b728ad259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:27.868650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221ff32-2cb0-40eb-838b-ee4b728ad259 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:27.869113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221ff32-2cb0-40eb-838b-ee4b728ad259 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:27.869591 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221ff32-2cb0-40eb-838b-ee4b728ad259 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:27.871223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221ff32-2cb0-40eb-838b-ee4b728ad259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:27.872186 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221ff32-2cb0-40eb-838b-ee4b728ad259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:27.874124 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221ff32-2cb0-40eb-838b-ee4b728ad259 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:27.890796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 339/678] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:27.892257 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221ff32-2cb0-40eb-838b-ee4b728ad259 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:27.898427 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88589f15-3ec8-44be-8464-1455ea789de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:27.899225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88589f15-3ec8-44be-8464-1455ea789de3 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:27.899509 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88589f15-3ec8-44be-8464-1455ea789de3 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:27.899785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88589f15-3ec8-44be-8464-1455ea789de3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:27.912415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88589f15-3ec8-44be-8464-1455ea789de3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:27.914601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88589f15-3ec8-44be-8464-1455ea789de3 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-88589f15-3ec8-44be-8464-1455ea789de3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:27.935088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:27.936067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:27.937001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:27.937001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:27.937001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:27.937001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:27.937001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:27.937001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:27.937001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:27.937001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:27.937001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 14:18:27.937001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:27.939341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 340/679] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:18:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:27.940727 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88589f15-3ec8-44be-8464-1455ea789de3 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:28.004364 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221ff32-2cb0-40eb-838b-ee4b728ad259 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:28.052972 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078fa4b-7522-4c76-a7d5-a47d8db7dbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:28.054556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078fa4b-7522-4c76-a7d5-a47d8db7dbbb None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:28.055037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078fa4b-7522-4c76-a7d5-a47d8db7dbbb None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:28.055766 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078fa4b-7522-4c76-a7d5-a47d8db7dbbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:28.056944 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078fa4b-7522-4c76-a7d5-a47d8db7dbbb None admin] RBAC: Adding query filter params (role.id=4aa22f352696432bbf8fcd9d74ba0dc7, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=f34ff47d8c4f4d99955340ddbdc3d475) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:28.057419 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078fa4b-7522-4c76-a7d5-a47d8db7dbbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:28.061236 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078fa4b-7522-4c76-a7d5-a47d8db7dbbb None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:28.065807 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88589f15-3ec8-44be-8464-1455ea789de3 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:28.070623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 340/680] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:27 2022] GET /identity/v3/role_assignments?user.id=f34ff47d8c4f4d99955340ddbdc3d475&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=4aa22f352696432bbf8fcd9d74ba0dc7 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:28.071882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078fa4b-7522-4c76-a7d5-a47d8db7dbbb None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:28.108932 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644a638-5ede-4724-9cdd-8615f1bbaf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:28.109892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644a638-5ede-4724-9cdd-8615f1bbaf9a None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:28.110314 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644a638-5ede-4724-9cdd-8615f1bbaf9a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:28.110695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644a638-5ede-4724-9cdd-8615f1bbaf9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:28.118453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644a638-5ede-4724-9cdd-8615f1bbaf9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:28.120203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644a638-5ede-4724-9cdd-8615f1bbaf9a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:28.135714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-5644a638-5ede-4724-9cdd-8615f1bbaf9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:28.135714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:28.135714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:28.135714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:28.135714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:28.135714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:28.135714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:28.135714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:28.135714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:28.135714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:28.135714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:28.135714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:28.135714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:28.135714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:28.135714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:28.137629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:28.138787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:28.138787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:28.138787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:28.138787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:28.138787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:28.138787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:28.138787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:28.138787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:28.143995 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 341/681] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:28.146251 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644a638-5ede-4724-9cdd-8615f1bbaf9a None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:28.209358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078fa4b-7522-4c76-a7d5-a47d8db7dbbb None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:28.247500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8e669-fa36-43e7-a136-c5b552292a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:28.248569 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8e669-fa36-43e7-a136-c5b552292a1c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:28.249066 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8e669-fa36-43e7-a136-c5b552292a1c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:28.249724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8e669-fa36-43e7-a136-c5b552292a1c None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:28.250955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8e669-fa36-43e7-a136-c5b552292a1c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:28.251503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8e669-fa36-43e7-a136-c5b552292a1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:28.253163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8e669-fa36-43e7-a136-c5b552292a1c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:28.274361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 341/682] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 17 14:18:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:28.275346 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644a638-5ede-4724-9cdd-8615f1bbaf9a None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:28.277595 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a76c0-f1ff-48e7-818b-10cfd6248854 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:28.278259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a76c0-f1ff-48e7-818b-10cfd6248854 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:28.279215 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a76c0-f1ff-48e7-818b-10cfd6248854 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:28.281172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 342/683] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:28.282328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a76c0-f1ff-48e7-818b-10cfd6248854 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:28.319980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c9577-9871-416b-bf75-7fa0c04de5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:28.321276 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c9577-9871-416b-bf75-7fa0c04de5a4 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:28.321835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c9577-9871-416b-bf75-7fa0c04de5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:28.322347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c9577-9871-416b-bf75-7fa0c04de5a4 None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:28.323914 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c9577-9871-416b-bf75-7fa0c04de5a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:28.324477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c9577-9871-416b-bf75-7fa0c04de5a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:28.326307 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c9577-9871-416b-bf75-7fa0c04de5a4 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:28.344604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 342/684] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:28.344604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89654a1e-a793-470a-9638-d8785c25162d None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:28.344604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89654a1e-a793-470a-9638-d8785c25162d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:28.344604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89654a1e-a793-470a-9638-d8785c25162d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:28.363773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-89654a1e-a793-470a-9638-d8785c25162d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:28.364262 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-89654a1e-a793-470a-9638-d8785c25162d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:28.407553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a76c0-f1ff-48e7-818b-10cfd6248854 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:28.444759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 343/685] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:28.446718 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89654a1e-a793-470a-9638-d8785c25162d None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:28.452962 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2fcad-d0b2-4db2-9fe7-a1a9715288c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:28.453931 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2fcad-d0b2-4db2-9fe7-a1a9715288c6 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:28.454537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2fcad-d0b2-4db2-9fe7-a1a9715288c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:28.455022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2fcad-d0b2-4db2-9fe7-a1a9715288c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:28.530447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2fcad-d0b2-4db2-9fe7-a1a9715288c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:28.532272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2fcad-d0b2-4db2-9fe7-a1a9715288c6 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:28.566365 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89654a1e-a793-470a-9638-d8785c25162d None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:28.602133 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb618b-b9c1-4ab6-80b1-98b4983886c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:28.603264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb618b-b9c1-4ab6-80b1-98b4983886c5 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:28.603760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb618b-b9c1-4ab6-80b1-98b4983886c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:28.604272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb618b-b9c1-4ab6-80b1-98b4983886c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:28.605627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb618b-b9c1-4ab6-80b1-98b4983886c5 None admin] RBAC: Adding query filter params (role.id=4aa22f352696432bbf8fcd9d74ba0dc7, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=7b03ca44da654c3a9a5d9762b8eee189) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:28.606230 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb618b-b9c1-4ab6-80b1-98b4983886c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:28.607936 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb618b-b9c1-4ab6-80b1-98b4983886c5 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:28.622343 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 344/686] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:28 2022] GET /identity/v3/role_assignments?user.id=7b03ca44da654c3a9a5d9762b8eee189&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=4aa22f352696432bbf8fcd9d74ba0dc7 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:28.623767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb618b-b9c1-4ab6-80b1-98b4983886c5 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:28.648661 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 343/687] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:18:28.655271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2fcad-d0b2-4db2-9fe7-a1a9715288c6 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:28.744821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb618b-b9c1-4ab6-80b1-98b4983886c5 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:28.787141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35dbdc-a7a7-4a61-a6e4-620047f3901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:28.789554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35dbdc-a7a7-4a61-a6e4-620047f3901e None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:28.793270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35dbdc-a7a7-4a61-a6e4-620047f3901e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:28.793831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35dbdc-a7a7-4a61-a6e4-620047f3901e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:28.818745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35dbdc-a7a7-4a61-a6e4-620047f3901e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:28.828100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2fcad-d0b2-4db2-9fe7-a1a9715288c6 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-7e35dbdc-a7a7-4a61-a6e4-620047f3901e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:28.828471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:28.829387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:28.830277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:28.830277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:28.830277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:28.830277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:28.830277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:28.830277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:28.830277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:28.830277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:28.830277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:28.830277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:28.830277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:18:28.830277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:28.833145 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 345/688] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:18:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:28.840443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35dbdc-a7a7-4a61-a6e4-620047f3901e None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:28.872719 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed72a7e-2b4d-41af-a79b-430eca8aa377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:28.874150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed72a7e-2b4d-41af-a79b-430eca8aa377 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:28.874845 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed72a7e-2b4d-41af-a79b-430eca8aa377 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:28.875334 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed72a7e-2b4d-41af-a79b-430eca8aa377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:28.888383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed72a7e-2b4d-41af-a79b-430eca8aa377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:28.891043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed72a7e-2b4d-41af-a79b-430eca8aa377 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:28.916025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-8ed72a7e-2b4d-41af-a79b-430eca8aa377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:28.916025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:28.916025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:28.916025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:28.916025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:28.916025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:28.916025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:28.916025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:28.916025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:28.916025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:28.916025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:28.916025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:28.916025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:28.916025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:28.916025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:28.917056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:28.918835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:28.918835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:28.918835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:28.918835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:28.920797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 344/689] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:28.927124 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed72a7e-2b4d-41af-a79b-430eca8aa377 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:28.989947 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35dbdc-a7a7-4a61-a6e4-620047f3901e None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:29.024741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b05fc-132f-4b41-991f-c296c805cebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:29.025754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b05fc-132f-4b41-991f-c296c805cebd None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:29.026333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b05fc-132f-4b41-991f-c296c805cebd None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:29.027342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b05fc-132f-4b41-991f-c296c805cebd None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:29.028306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b05fc-132f-4b41-991f-c296c805cebd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:29.028835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b05fc-132f-4b41-991f-c296c805cebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:29.030430 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b05fc-132f-4b41-991f-c296c805cebd None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:29.039455 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 346/690] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:18:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:29.045707 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b05fc-132f-4b41-991f-c296c805cebd None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:29.048888 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed72a7e-2b4d-41af-a79b-430eca8aa377 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:29.093096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234cf77-4a93-4ebf-8222-f48963f3472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:29.093992 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234cf77-4a93-4ebf-8222-f48963f3472c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:29.094312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234cf77-4a93-4ebf-8222-f48963f3472c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:29.094592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234cf77-4a93-4ebf-8222-f48963f3472c None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:29.095331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234cf77-4a93-4ebf-8222-f48963f3472c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:29.095640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234cf77-4a93-4ebf-8222-f48963f3472c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:29.097040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234cf77-4a93-4ebf-8222-f48963f3472c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:29.113185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 345/691] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:29.122898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234cf77-4a93-4ebf-8222-f48963f3472c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:29.179352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b05fc-132f-4b41-991f-c296c805cebd None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:29.221580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1c10-58bc-4d73-b55b-049088a2d36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:29.223117 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1c10-58bc-4d73-b55b-049088a2d36c None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:29.223964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1c10-58bc-4d73-b55b-049088a2d36c None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:29.224590 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1c10-58bc-4d73-b55b-049088a2d36c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:29.238550 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e1c10-58bc-4d73-b55b-049088a2d36c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:29.240993 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e1c10-58bc-4d73-b55b-049088a2d36c None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:29.248204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234cf77-4a93-4ebf-8222-f48963f3472c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:29.263626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-ff4e1c10-58bc-4d73-b55b-049088a2d36c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:29.263626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:29.263626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:29.263626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:29.263626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:29.263626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:29.263626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:29.263626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:29.263626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:29.263626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:29.263626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:29.263626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:29.263626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:29.263626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:29.263626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:29.264592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:29.265480 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:29.265480 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:29.265480 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:29.265480 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:29.267685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 347/692] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:29.275098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1c10-58bc-4d73-b55b-049088a2d36c None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:29.327997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785decd8-9bec-469f-9649-a1d1a5e74943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:29.328820 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785decd8-9bec-469f-9649-a1d1a5e74943 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:29.329106 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785decd8-9bec-469f-9649-a1d1a5e74943 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:29.329385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785decd8-9bec-469f-9649-a1d1a5e74943 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:29.345080 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785decd8-9bec-469f-9649-a1d1a5e74943 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:29.349294 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785decd8-9bec-469f-9649-a1d1a5e74943 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:29.375255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-785decd8-9bec-469f-9649-a1d1a5e74943 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:29.375255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:29.375255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:29.375255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:29.375255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:29.375255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:29.375255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:29.375255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:29.375255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:29.375255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:29.375255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:29.375255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:29.375255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:29.375255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:29.375255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:29.376166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:29.377050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:29.377050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:29.377050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:29.377050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:29.377050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:29.377050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:29.377050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:29.377050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:29.382933 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 346/693] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:29.391364 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785decd8-9bec-469f-9649-a1d1a5e74943 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:29.437951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1c10-58bc-4d73-b55b-049088a2d36c None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:29.481749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebf002-9699-4e60-885b-96713b9ab78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:29.482754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebf002-9699-4e60-885b-96713b9ab78e None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:29.482754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebf002-9699-4e60-885b-96713b9ab78e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:29.483015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebf002-9699-4e60-885b-96713b9ab78e None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:29.483726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebf002-9699-4e60-885b-96713b9ab78e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:29.484035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebf002-9699-4e60-885b-96713b9ab78e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:29.485415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebf002-9699-4e60-885b-96713b9ab78e None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:29.496247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785decd8-9bec-469f-9649-a1d1a5e74943 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:29.510587 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 348/694] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:29.523521 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebf002-9699-4e60-885b-96713b9ab78e None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:29.550687 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ee643-f396-4929-8881-9e30fee728c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:29.551795 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ee643-f396-4929-8881-9e30fee728c0 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:29.552282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ee643-f396-4929-8881-9e30fee728c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:29.552760 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ee643-f396-4929-8881-9e30fee728c0 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:29.553783 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ee643-f396-4929-8881-9e30fee728c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:29.554371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ee643-f396-4929-8881-9e30fee728c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:29.556347 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ee643-f396-4929-8881-9e30fee728c0 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:29.573226 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 347/695] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:29.579378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ee643-f396-4929-8881-9e30fee728c0 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:29.699955 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebf002-9699-4e60-885b-96713b9ab78e None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:29.737906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11878dd-9094-47bc-940b-cc83f07690b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:29.738736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11878dd-9094-47bc-940b-cc83f07690b6 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:29.739020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11878dd-9094-47bc-940b-cc83f07690b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:29.740246 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11878dd-9094-47bc-940b-cc83f07690b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:29.742662 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ee643-f396-4929-8881-9e30fee728c0 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:29.760728 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11878dd-9094-47bc-940b-cc83f07690b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:29.763225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11878dd-9094-47bc-940b-cc83f07690b6 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-f11878dd-9094-47bc-940b-cc83f07690b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:29.782605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:29.783571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:29.784507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:29.784507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:29.784507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:29.784507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:29.784507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:29.784507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:29.784507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:29.784507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:29.784507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 14:18:29.784507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:29.784507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 349/696] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 14:18:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:29.790900 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11878dd-9094-47bc-940b-cc83f07690b6 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:29.815892 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4171503-51e7-49c0-9f14-260ff6be01bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:29.816565 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4171503-51e7-49c0-9f14-260ff6be01bb None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:29.816847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4171503-51e7-49c0-9f14-260ff6be01bb None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:29.817116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4171503-51e7-49c0-9f14-260ff6be01bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:29.817954 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4171503-51e7-49c0-9f14-260ff6be01bb None admin] RBAC: Adding query filter params (role.id=4aa22f352696432bbf8fcd9d74ba0dc7, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=055264c31c9e4d3dbf234a362ee82698) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:29.818292 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4171503-51e7-49c0-9f14-260ff6be01bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:29.819751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4171503-51e7-49c0-9f14-260ff6be01bb None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:29.827563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 348/697] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:29 2022] GET /identity/v3/role_assignments?user.id=055264c31c9e4d3dbf234a362ee82698&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=4aa22f352696432bbf8fcd9d74ba0dc7 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:29.862017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6cb3c-c2a2-45f3-a5b8-0d6c324d78f6 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:29.862432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6cb3c-c2a2-45f3-a5b8-0d6c324d78f6 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:29.862610 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6cb3c-c2a2-45f3-a5b8-0d6c324d78f6 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:29.864305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 349/698] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:18:29.869936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6213-c780-4cba-af76-5754d820ba1f None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:29.870310 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6213-c780-4cba-af76-5754d820ba1f None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:29.870598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6213-c780-4cba-af76-5754d820ba1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:29.888445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-a3df6213-c780-4cba-af76-5754d820ba1f None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:29.889686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a3df6213-c780-4cba-af76-5754d820ba1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:29.937446 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11878dd-9094-47bc-940b-cc83f07690b6 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:30.000755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 350/699] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:18:30.014142 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943ab28-454b-46f0-9b48-b10df2a14de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:30.014862 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943ab28-454b-46f0-9b48-b10df2a14de7 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:30.015148 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943ab28-454b-46f0-9b48-b10df2a14de7 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:30.015426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943ab28-454b-46f0-9b48-b10df2a14de7 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:30.016342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943ab28-454b-46f0-9b48-b10df2a14de7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:30.016657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943ab28-454b-46f0-9b48-b10df2a14de7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:30.018160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943ab28-454b-46f0-9b48-b10df2a14de7 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:30.043452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 350/700] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 14:18:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:30.049319 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df6213-c780-4cba-af76-5754d820ba1f None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:30.055897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943ab28-454b-46f0-9b48-b10df2a14de7 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:30.158221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943ab28-454b-46f0-9b48-b10df2a14de7 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:30.161020 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df6213-c780-4cba-af76-5754d820ba1f None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:30.194864 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f504e22-2933-43f5-939b-ab4e8834fcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:30.195686 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f504e22-2933-43f5-939b-ab4e8834fcc8 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:30.195970 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f504e22-2933-43f5-939b-ab4e8834fcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:30.196244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f504e22-2933-43f5-939b-ab4e8834fcc8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:30.196903 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f504e22-2933-43f5-939b-ab4e8834fcc8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:30.198562 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f504e22-2933-43f5-939b-ab4e8834fcc8 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:30.202401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18862aa-1d2d-44c9-9434-18dcca0cca74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:30.203058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18862aa-1d2d-44c9-9434-18dcca0cca74 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:30.203340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18862aa-1d2d-44c9-9434-18dcca0cca74 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:30.203614 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18862aa-1d2d-44c9-9434-18dcca0cca74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-6f504e22-2933-43f5-939b-ab4e8834fcc8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:30.221108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:30.222129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:30.223014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 351/701] 10.222.0.48 () {56 vars in 1129 bytes} [Tue May 17 14:18:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:30.228333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f504e22-2933-43f5-939b-ab4e8834fcc8 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:30.290750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18862aa-1d2d-44c9-9434-18dcca0cca74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:30.292200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18862aa-1d2d-44c9-9434-18dcca0cca74 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:30.361234 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f504e22-2933-43f5-939b-ab4e8834fcc8 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:30.406581 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003551c-6579-45ff-9a8c-cd6548c7eb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:30.407668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003551c-6579-45ff-9a8c-cd6548c7eb54 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:30.408158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003551c-6579-45ff-9a8c-cd6548c7eb54 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:30.408637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003551c-6579-45ff-9a8c-cd6548c7eb54 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:30.409201 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 351/702] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:18:30.409732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003551c-6579-45ff-9a8c-cd6548c7eb54 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:30.411500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003551c-6579-45ff-9a8c-cd6548c7eb54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:30.411500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003551c-6579-45ff-9a8c-cd6548c7eb54 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:30.415369 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18862aa-1d2d-44c9-9434-18dcca0cca74 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:30.418473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 352/703] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 17 14:18:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:30.423764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003551c-6579-45ff-9a8c-cd6548c7eb54 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:30.525100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18862aa-1d2d-44c9-9434-18dcca0cca74 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:30.532934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003551c-6579-45ff-9a8c-cd6548c7eb54 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:30.562044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0626878-18a2-40e2-a4f4-df831d3eda86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:30.562799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0626878-18a2-40e2-a4f4-df831d3eda86 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:30.563078 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0626878-18a2-40e2-a4f4-df831d3eda86 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:30.563350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0626878-18a2-40e2-a4f4-df831d3eda86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:30.569543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375a675-c84b-4f4f-88cb-e8dbf696a4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:30.570520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375a675-c84b-4f4f-88cb-e8dbf696a4c7 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:30.571007 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375a675-c84b-4f4f-88cb-e8dbf696a4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:30.571482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375a675-c84b-4f4f-88cb-e8dbf696a4c7 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:30.572406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375a675-c84b-4f4f-88cb-e8dbf696a4c7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:30.572908 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375a675-c84b-4f4f-88cb-e8dbf696a4c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:30.575239 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0626878-18a2-40e2-a4f4-df831d3eda86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:30.576030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375a675-c84b-4f4f-88cb-e8dbf696a4c7 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:30.576690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0626878-18a2-40e2-a4f4-df831d3eda86 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:30.582897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 353/704] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 17 14:18:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:30.601868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-e0626878-18a2-40e2-a4f4-df831d3eda86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:30.601868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:30.601868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:30.601868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:30.601868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:30.601868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:30.601868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:30.601868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:30.601868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:30.601868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:30.601868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:30.601868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:30.601868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:30.601868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:30.601868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:30.602956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:30.604064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:30.604064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:30.604064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:30.604064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:30.607655 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 352/705] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:30.613104 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375a675-c84b-4f4f-88cb-e8dbf696a4c7 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:30.790085 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375a675-c84b-4f4f-88cb-e8dbf696a4c7 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:30.830564 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13febeb-afef-4e7f-88d5-97179b3b7d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:30.831413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13febeb-afef-4e7f-88d5-97179b3b7d67 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:30.831700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13febeb-afef-4e7f-88d5-97179b3b7d67 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:30.831985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13febeb-afef-4e7f-88d5-97179b3b7d67 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:30.832713 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13febeb-afef-4e7f-88d5-97179b3b7d67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:30.833022 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13febeb-afef-4e7f-88d5-97179b3b7d67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:30.834485 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13febeb-afef-4e7f-88d5-97179b3b7d67 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:30.847757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 354/706] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:30.852831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0626878-18a2-40e2-a4f4-df831d3eda86 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:30.966443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0626878-18a2-40e2-a4f4-df831d3eda86 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:31.003803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632175e6-2213-4a4b-98de-49f6b6cc4f07 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:31.004126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632175e6-2213-4a4b-98de-49f6b6cc4f07 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:31.004366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632175e6-2213-4a4b-98de-49f6b6cc4f07 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:31.005843 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 355/707] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:18:31.012252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1ceb8-5ee0-4ecf-acb1-d4ff8d9aba09 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:31.012811 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1ceb8-5ee0-4ecf-acb1-d4ff8d9aba09 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:31.013285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1ceb8-5ee0-4ecf-acb1-d4ff8d9aba09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:31.019523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11dabb-e57c-46b9-8dcf-61448722c4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:31.020382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11dabb-e57c-46b9-8dcf-61448722c4e2 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:31.020670 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11dabb-e57c-46b9-8dcf-61448722c4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:31.020948 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11dabb-e57c-46b9-8dcf-61448722c4e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:31.032238 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-8ef1ceb8-5ee0-4ecf-acb1-d4ff8d9aba09 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:31.032413 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11dabb-e57c-46b9-8dcf-61448722c4e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:31.033733 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11dabb-e57c-46b9-8dcf-61448722c4e2 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:31.034060 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-8ef1ceb8-5ee0-4ecf-acb1-d4ff8d9aba09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:31.055017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-1c11dabb-e57c-46b9-8dcf-61448722c4e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:31.055017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:31.055017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:31.055017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:31.055017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:31.055017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:31.055017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:31.055017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:31.055017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:31.055017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:31.055017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:31.055017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:31.055017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:31.055017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:31.055017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:31.055964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:31.056854 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:31.056854 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:31.056854 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:31.056854 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:31.056854 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:31.056854 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:31.056854 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:31.056854 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:31.056854 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 353/708] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:31.066488 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11dabb-e57c-46b9-8dcf-61448722c4e2 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:31.174640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11dabb-e57c-46b9-8dcf-61448722c4e2 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:31.212515 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 356/709] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:18:31.216057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48cc96-4847-4f28-b075-2340e7e2cfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:31.216722 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48cc96-4847-4f28-b075-2340e7e2cfc5 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:31.217011 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48cc96-4847-4f28-b075-2340e7e2cfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:31.217284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48cc96-4847-4f28-b075-2340e7e2cfc5 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:31.218079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48cc96-4847-4f28-b075-2340e7e2cfc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:31.218444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48cc96-4847-4f28-b075-2340e7e2cfc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:31.219848 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48cc96-4847-4f28-b075-2340e7e2cfc5 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:31.233271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 354/710] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:31.238941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1ceb8-5ee0-4ecf-acb1-d4ff8d9aba09 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:31.246049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48cc96-4847-4f28-b075-2340e7e2cfc5 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:31.344144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1ceb8-5ee0-4ecf-acb1-d4ff8d9aba09 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:31.395662 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08ba4b-933e-4584-ae49-639e54d87b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:31.396345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08ba4b-933e-4584-ae49-639e54d87b0c None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:31.396629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08ba4b-933e-4584-ae49-639e54d87b0c None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:31.396907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08ba4b-933e-4584-ae49-639e54d87b0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:31.397749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08ba4b-933e-4584-ae49-639e54d87b0c None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=1f443d2ca1534249bb2c4096300ddffd) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:31.398064 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08ba4b-933e-4584-ae49-639e54d87b0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:31.399566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08ba4b-933e-4584-ae49-639e54d87b0c None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:31.412887 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48cc96-4847-4f28-b075-2340e7e2cfc5 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:31.414693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 357/711] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:31 2022] GET /identity/v3/role_assignments?user.id=1f443d2ca1534249bb2c4096300ddffd&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:31.450144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32fe5f-e010-47cd-b645-914de26faf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:31.450893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32fe5f-e010-47cd-b645-914de26faf29 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:31.451179 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32fe5f-e010-47cd-b645-914de26faf29 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:31.451507 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32fe5f-e010-47cd-b645-914de26faf29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:31.462751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32fe5f-e010-47cd-b645-914de26faf29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:31.464968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32fe5f-e010-47cd-b645-914de26faf29 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:31.484509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-5d32fe5f-e010-47cd-b645-914de26faf29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:31.484509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:31.484509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:31.484509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:31.484509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:31.484509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:31.484509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:31.484509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:31.484509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:31.484509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:31.484509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:31.484509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:31.484509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:31.484509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:31.484509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:31.485489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:31.486814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:31.486814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:31.486814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:31.486814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:31.486814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 355/712] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:31.493306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08ba4b-933e-4584-ae49-639e54d87b0c None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:31.648227 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08ba4b-933e-4584-ae49-639e54d87b0c None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:31.676745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331721de-3908-4899-88d0-2e7be780be52 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:31.677394 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331721de-3908-4899-88d0-2e7be780be52 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:31.677394 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331721de-3908-4899-88d0-2e7be780be52 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:31.679057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 356/713] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:31.685873 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed38d6-10ea-4793-b6a3-7b3fc9ac5ed4 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:31.686161 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed38d6-10ea-4793-b6a3-7b3fc9ac5ed4 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:31.686593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed38d6-10ea-4793-b6a3-7b3fc9ac5ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:31.686995 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0591d-ab40-406d-89fd-a48d2429f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:31.687668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0591d-ab40-406d-89fd-a48d2429f0af None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:31.687955 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0591d-ab40-406d-89fd-a48d2429f0af None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:31.688303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0591d-ab40-406d-89fd-a48d2429f0af None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:31.688971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0591d-ab40-406d-89fd-a48d2429f0af None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:31.689281 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0591d-ab40-406d-89fd-a48d2429f0af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:31.690705 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0591d-ab40-406d-89fd-a48d2429f0af None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:31.704035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 358/714] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:31.710459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0591d-ab40-406d-89fd-a48d2429f0af None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:31.711863 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-d2ed38d6-10ea-4793-b6a3-7b3fc9ac5ed4 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:31.713100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d2ed38d6-10ea-4793-b6a3-7b3fc9ac5ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:31.837578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0591d-ab40-406d-89fd-a48d2429f0af None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:31.875867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9a750-4121-400b-a9d7-28d54d2fda82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:31.876547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9a750-4121-400b-a9d7-28d54d2fda82 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:31.876832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9a750-4121-400b-a9d7-28d54d2fda82 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:31.877108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9a750-4121-400b-a9d7-28d54d2fda82 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:31.877987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9a750-4121-400b-a9d7-28d54d2fda82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:31.880066 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9a750-4121-400b-a9d7-28d54d2fda82 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:31.887529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 357/715] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:31.921276 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 359/716] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:18:31 2022] POST /identity/v3/users => generated 254 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:18:31.923782 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed38d6-10ea-4793-b6a3-7b3fc9ac5ed4 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:32.079525 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed38d6-10ea-4793-b6a3-7b3fc9ac5ed4 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:32.132367 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e12b2-0443-47f2-aaa2-b51306867205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:32.133197 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e12b2-0443-47f2-aaa2-b51306867205 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:32.133479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e12b2-0443-47f2-aaa2-b51306867205 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:32.133749 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e12b2-0443-47f2-aaa2-b51306867205 None admin] PATH_INFO: `/v3/services/network` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:32.134448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e12b2-0443-47f2-aaa2-b51306867205 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:32.136592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e12b2-0443-47f2-aaa2-b51306867205 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-9d2e12b2-0443-47f2-aaa2-b51306867205 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:32.153372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:32.154479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:32.155513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:32.155513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:32.155513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:32.155513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:32.155513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:32.155513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:32.155513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:32.155513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:32.155513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:32.155513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:32.155513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:32.155513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:32.155513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 14:18:32.155513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:32.155513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 358/717] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:31 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:32.163939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9a750-4121-400b-a9d7-28d54d2fda82 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:32.300723 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9a750-4121-400b-a9d7-28d54d2fda82 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:32.343643 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebc83e-b061-4d63-839c-cdfc711f495a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:32.344251 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebc83e-b061-4d63-839c-cdfc711f495a None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:32.344534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebc83e-b061-4d63-839c-cdfc711f495a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:32.344810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebc83e-b061-4d63-839c-cdfc711f495a None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:32.345531 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebc83e-b061-4d63-839c-cdfc711f495a None admin] RBAC: Adding query filter params (name=network) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:32.345839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebc83e-b061-4d63-839c-cdfc711f495a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:32.347274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebc83e-b061-4d63-839c-cdfc711f495a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:32.353490 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 360/718] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 14:18:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:32.358327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e12b2-0443-47f2-aaa2-b51306867205 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:32.463243 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e12b2-0443-47f2-aaa2-b51306867205 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:32.499082 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f2ad5-d098-47c9-9f35-19d365a10618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:32.499759 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f2ad5-d098-47c9-9f35-19d365a10618 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:32.500045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f2ad5-d098-47c9-9f35-19d365a10618 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:32.500324 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f2ad5-d098-47c9-9f35-19d365a10618 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:32.501039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f2ad5-d098-47c9-9f35-19d365a10618 None admin] RBAC: Adding query filter params (type=network) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:32.501349 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f2ad5-d098-47c9-9f35-19d365a10618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:32.502793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f2ad5-d098-47c9-9f35-19d365a10618 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:32.514345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 359/719] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 14:18:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:33.044627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bba639-4372-4665-87b9-762dee698976 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:33.045652 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bba639-4372-4665-87b9-762dee698976 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:33.046140 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bba639-4372-4665-87b9-762dee698976 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:33.048001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 361/720] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:33.053386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bd16f-a499-4bee-afec-e412e29dce0b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:33.054285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bd16f-a499-4bee-afec-e412e29dce0b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:33.054788 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bd16f-a499-4bee-afec-e412e29dce0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:33.077717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-6b0bd16f-a499-4bee-afec-e412e29dce0b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:33.079322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6b0bd16f-a499-4bee-afec-e412e29dce0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:33.174382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 360/721] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:33.223642 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bba639-4372-4665-87b9-762dee698976 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:33.349905 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00d4b9-558c-4439-a9ce-caf197ff46b3 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:33.350251 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00d4b9-558c-4439-a9ce-caf197ff46b3 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:33.350429 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00d4b9-558c-4439-a9ce-caf197ff46b3 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:33.352013 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 361/722] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:33.356995 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de4e02-1703-42d0-8664-5a411b37724f None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:33.357280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de4e02-1703-42d0-8664-5a411b37724f None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:33.357554 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de4e02-1703-42d0-8664-5a411b37724f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:33.375823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bba639-4372-4665-87b9-762dee698976 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:33.383504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b5de4e02-1703-42d0-8664-5a411b37724f None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:33.384704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b5de4e02-1703-42d0-8664-5a411b37724f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:33.437773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58e55d-c6be-41c6-a553-654576ecf6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:33.438604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58e55d-c6be-41c6-a553-654576ecf6f9 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:33.438886 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58e55d-c6be-41c6-a553-654576ecf6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:33.439159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58e55d-c6be-41c6-a553-654576ecf6f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:33.457192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58e55d-c6be-41c6-a553-654576ecf6f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-6d58e55d-c6be-41c6-a553-654576ecf6f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:33.465535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:33.466591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:33.467416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:33.467416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:33.467416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:33.467416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:33.467416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:33.467416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:33.467416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:33.467416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:33.467416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:33.467416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:33.467416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:18:33.467416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:33.467416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 362/723] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:18:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:33.475042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58e55d-c6be-41c6-a553-654576ecf6f9 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:33.499509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 362/724] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 14:18:33.596695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de4e02-1703-42d0-8664-5a411b37724f None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:33.618192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58e55d-c6be-41c6-a553-654576ecf6f9 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:33.652865 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06eee8e-80f3-4074-b293-d3babe0db0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:33.653867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06eee8e-80f3-4074-b293-d3babe0db0d4 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:33.654359 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06eee8e-80f3-4074-b293-d3babe0db0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:33.654810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06eee8e-80f3-4074-b293-d3babe0db0d4 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:33.655749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06eee8e-80f3-4074-b293-d3babe0db0d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:33.656271 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06eee8e-80f3-4074-b293-d3babe0db0d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:33.657891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06eee8e-80f3-4074-b293-d3babe0db0d4 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:33.667482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 363/725] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:18:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:33.672577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06eee8e-80f3-4074-b293-d3babe0db0d4 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:33.783922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06eee8e-80f3-4074-b293-d3babe0db0d4 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:33.821986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09485527-b906-45e0-802d-42dd029b5d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:33.823397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09485527-b906-45e0-802d-42dd029b5d7b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:33.823881 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09485527-b906-45e0-802d-42dd029b5d7b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:33.824345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09485527-b906-45e0-802d-42dd029b5d7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:33.832716 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de4e02-1703-42d0-8664-5a411b37724f None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:33.836720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09485527-b906-45e0-802d-42dd029b5d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:33.838558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09485527-b906-45e0-802d-42dd029b5d7b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:33.861020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-09485527-b906-45e0-802d-42dd029b5d7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:33.861020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:33.861020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:33.861020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:33.861020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:33.861020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:33.861020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:33.861020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:33.861020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:33.861020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:33.861020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:33.861020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:33.861020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:33.861020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:33.861020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:33.861994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:33.862925 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:33.862925 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:33.862925 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:33.862925 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:33.865279 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 364/726] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:33.871610 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09485527-b906-45e0-802d-42dd029b5d7b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:33.926912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03236733-e86a-474e-885b-824140b053c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:33.927750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03236733-e86a-474e-885b-824140b053c0 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:33.928135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03236733-e86a-474e-885b-824140b053c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:33.928529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03236733-e86a-474e-885b-824140b053c0 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:33.929362 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03236733-e86a-474e-885b-824140b053c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:33.930870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03236733-e86a-474e-885b-824140b053c0 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:33.962735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 363/727] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 14:18:33 2022] POST /identity/v3/services => generated 251 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:18:33.998374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09485527-b906-45e0-802d-42dd029b5d7b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:34.041469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1751d-94b8-434c-a318-aa1966c9979d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:34.042571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1751d-94b8-434c-a318-aa1966c9979d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:34.043001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1751d-94b8-434c-a318-aa1966c9979d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:34.043441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1751d-94b8-434c-a318-aa1966c9979d None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:34.044324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1751d-94b8-434c-a318-aa1966c9979d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:34.044791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1751d-94b8-434c-a318-aa1966c9979d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:34.046920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1751d-94b8-434c-a318-aa1966c9979d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:34.064370 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 365/728] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:34.070031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03236733-e86a-474e-885b-824140b053c0 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:34.221674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03236733-e86a-474e-885b-824140b053c0 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:34.257774 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49abc06-9618-4994-a9df-e390f3d7b62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:34.258611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49abc06-9618-4994-a9df-e390f3d7b62e None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:34.258894 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49abc06-9618-4994-a9df-e390f3d7b62e None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:34.259179 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49abc06-9618-4994-a9df-e390f3d7b62e None admin] PATH_INFO: `/v3/users/swift` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:34.268532 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49abc06-9618-4994-a9df-e390f3d7b62e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:34.270028 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49abc06-9618-4994-a9df-e390f3d7b62e None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-f49abc06-9618-4994-a9df-e390f3d7b62e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:34.285808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:34.286870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:34.287800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:34.287800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:34.287800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:34.287800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:34.287800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:34.287800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:34.287800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:34.287800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:34.287800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 14:18:34.287800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:34.287800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 364/729] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:18:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:34.293669 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1751d-94b8-434c-a318-aa1966c9979d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:34.344273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99581fa-94ca-45c6-92cb-96fdfd05ac5a None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:34.344585 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99581fa-94ca-45c6-92cb-96fdfd05ac5a None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:34.344828 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99581fa-94ca-45c6-92cb-96fdfd05ac5a None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:34.346455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 365/730] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:34.351647 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5034b27-3bda-41cd-b59f-c059f3cfc9dd None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:34.351945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5034b27-3bda-41cd-b59f-c059f3cfc9dd None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:34.352388 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5034b27-3bda-41cd-b59f-c059f3cfc9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:34.372037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-f5034b27-3bda-41cd-b59f-c059f3cfc9dd None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:34.373229 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f5034b27-3bda-41cd-b59f-c059f3cfc9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:34.424669 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1751d-94b8-434c-a318-aa1966c9979d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:34.449212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 366/731] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:34.470080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0a0e0-d498-4b03-8b73-ceb86fe5eef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:34.470808 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a0e0-d498-4b03-8b73-ceb86fe5eef9 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:34.471092 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a0e0-d498-4b03-8b73-ceb86fe5eef9 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:34.471591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a0e0-d498-4b03-8b73-ceb86fe5eef9 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:34.472261 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0a0e0-d498-4b03-8b73-ceb86fe5eef9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:34.472574 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0a0e0-d498-4b03-8b73-ceb86fe5eef9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:34.474033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0a0e0-d498-4b03-8b73-ceb86fe5eef9 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:34.478469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5034b27-3bda-41cd-b59f-c059f3cfc9dd None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:34.498297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 366/732] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 17 14:18:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:34.500572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0a0e0-d498-4b03-8b73-ceb86fe5eef9 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:34.601502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5034b27-3bda-41cd-b59f-c059f3cfc9dd None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:34.624606 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0a0e0-d498-4b03-8b73-ceb86fe5eef9 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:34.642121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe2af0-74e1-45e5-9525-71ca295212cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:34.642971 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe2af0-74e1-45e5-9525-71ca295212cf None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:34.643255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe2af0-74e1-45e5-9525-71ca295212cf None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:34.643534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe2af0-74e1-45e5-9525-71ca295212cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:34.655919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe2af0-74e1-45e5-9525-71ca295212cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:34.664746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b83ee-140d-4dac-9f8a-6d1ba871c0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:34.665396 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b83ee-140d-4dac-9f8a-6d1ba871c0f0 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:34.665677 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b83ee-140d-4dac-9f8a-6d1ba871c0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-e7fe2af0-74e1-45e5-9525-71ca295212cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:34.665874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:34.667988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:34.669965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:34.669965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:34.669965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:34.669965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:34.669965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:34.669965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:34.669965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:34.669965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:34.669965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:34.669965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:34.669965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:18:34.669965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:34.671608 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b83ee-140d-4dac-9f8a-6d1ba871c0f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:34.678221 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 367/733] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:18:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:34.678221 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe2af0-74e1-45e5-9525-71ca295212cf None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:34.742051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b83ee-140d-4dac-9f8a-6d1ba871c0f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:34.743457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b83ee-140d-4dac-9f8a-6d1ba871c0f0 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:34.900333 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe2af0-74e1-45e5-9525-71ca295212cf None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:34.986967 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2826499-eaaf-41b0-ba99-aebaa6945520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:34.988092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2826499-eaaf-41b0-ba99-aebaa6945520 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:34.988610 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2826499-eaaf-41b0-ba99-aebaa6945520 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:34.989086 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2826499-eaaf-41b0-ba99-aebaa6945520 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:34.990081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2826499-eaaf-41b0-ba99-aebaa6945520 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:34.990631 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2826499-eaaf-41b0-ba99-aebaa6945520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:34.992302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 367/734] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:34 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 14:18:34.992544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2826499-eaaf-41b0-ba99-aebaa6945520 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:34.997880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b83ee-140d-4dac-9f8a-6d1ba871c0f0 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:35.014608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 368/735] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:18:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:35.020260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2826499-eaaf-41b0-ba99-aebaa6945520 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:35.121534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b83ee-140d-4dac-9f8a-6d1ba871c0f0 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:35.166532 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b5a8e-7005-497c-9140-ee63956e51e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:35.168784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b5a8e-7005-497c-9140-ee63956e51e9 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:35.169064 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b5a8e-7005-497c-9140-ee63956e51e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:35.169334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b5a8e-7005-497c-9140-ee63956e51e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:35.183913 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b5a8e-7005-497c-9140-ee63956e51e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:35.185693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b5a8e-7005-497c-9140-ee63956e51e9 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:35.211062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-5b4b5a8e-7005-497c-9140-ee63956e51e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:35.211062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:35.211062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:35.211062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:35.211062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:35.211062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:35.211062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:35.211062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:35.211062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:35.211062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:35.211062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:35.211062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:35.211062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:35.211062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:35.211062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:35.211980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:35.212894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:35.212894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:35.212894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:35.212894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:35.215909 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 368/736] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:35.218007 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd9af9-a01a-46c0-ae51-674302fd8237 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:35.218674 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd9af9-a01a-46c0-ae51-674302fd8237 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:35.219472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd9af9-a01a-46c0-ae51-674302fd8237 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:35.225781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 369/737] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:35.225781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd9af9-a01a-46c0-ae51-674302fd8237 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:35.228942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2826499-eaaf-41b0-ba99-aebaa6945520 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:35.270230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dfb80-d00f-49bb-a4e8-55045301dc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:35.271015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dfb80-d00f-49bb-a4e8-55045301dc3f None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:35.271302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dfb80-d00f-49bb-a4e8-55045301dc3f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:35.271584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dfb80-d00f-49bb-a4e8-55045301dc3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:35.283001 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dfb80-d00f-49bb-a4e8-55045301dc3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:35.284455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dfb80-d00f-49bb-a4e8-55045301dc3f None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:35.301139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-b40dfb80-d00f-49bb-a4e8-55045301dc3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:35.301139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:35.301139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:35.301139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:35.301139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:35.301139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:35.301139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:35.301139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:35.301139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:35.301139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:35.301139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:35.301139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:35.301139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:35.301139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:35.301139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:35.302096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:35.303093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:35.303093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:35.303093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:35.303093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:35.310202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 369/738] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:35.310202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f36c28-3113-4f2f-b097-42b004741bb1 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:35.310202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f36c28-3113-4f2f-b097-42b004741bb1 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:35.310202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f36c28-3113-4f2f-b097-42b004741bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:35.327400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-e8f36c28-3113-4f2f-b097-42b004741bb1 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:35.328592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e8f36c28-3113-4f2f-b097-42b004741bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:35.334254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd9af9-a01a-46c0-ae51-674302fd8237 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:35.370487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a905d3c-cef3-4417-b8a1-205c591283d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:35.371568 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a905d3c-cef3-4417-b8a1-205c591283d6 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:35.371861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a905d3c-cef3-4417-b8a1-205c591283d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:35.372142 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a905d3c-cef3-4417-b8a1-205c591283d6 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:35.372869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a905d3c-cef3-4417-b8a1-205c591283d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:35.373181 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a905d3c-cef3-4417-b8a1-205c591283d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:35.374578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a905d3c-cef3-4417-b8a1-205c591283d6 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:35.390840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 370/739] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:35.390840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14d081-0ceb-4e2e-81ba-e05d1fd3a16d None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:35.390840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14d081-0ceb-4e2e-81ba-e05d1fd3a16d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:35.390840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14d081-0ceb-4e2e-81ba-e05d1fd3a16d None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:35.390840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 371/740] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:35.390840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14d081-0ceb-4e2e-81ba-e05d1fd3a16d None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:35.407759 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 370/741] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:35 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:35.409827 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f36c28-3113-4f2f-b097-42b004741bb1 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:35.524270 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f36c28-3113-4f2f-b097-42b004741bb1 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:35.525781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14d081-0ceb-4e2e-81ba-e05d1fd3a16d None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:35.558109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2e454-a15a-44a9-80a6-6ab601404852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:35.558654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ad655-7fa6-4517-9807-f19ae888ffa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:35.558984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2e454-a15a-44a9-80a6-6ab601404852 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:35.559270 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2e454-a15a-44a9-80a6-6ab601404852 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:35.559386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ad655-7fa6-4517-9807-f19ae888ffa8 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:35.559538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2e454-a15a-44a9-80a6-6ab601404852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:35.559630 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ad655-7fa6-4517-9807-f19ae888ffa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:35.559841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ad655-7fa6-4517-9807-f19ae888ffa8 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:35.560560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ad655-7fa6-4517-9807-f19ae888ffa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:35.560871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ad655-7fa6-4517-9807-f19ae888ffa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:35.562266 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ad655-7fa6-4517-9807-f19ae888ffa8 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:35.566284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2e454-a15a-44a9-80a6-6ab601404852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:35.567764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2e454-a15a-44a9-80a6-6ab601404852 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:35.577182 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 372/742] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:35.577182 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3ea9-5422-4ae3-9522-2e412619a177 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:35.577182 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3ea9-5422-4ae3-9522-2e412619a177 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:35.577182 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3ea9-5422-4ae3-9522-2e412619a177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:35.586439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-52b2e454-a15a-44a9-80a6-6ab601404852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:35.586439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:35.586439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:35.586439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:35.586439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:35.586439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:35.586439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:35.586439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:35.586439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:35.586439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:35.586439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:35.586439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:35.586439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:35.586439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:35.586439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:35.587303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:35.588206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:35.588206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:35.588206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:35.588206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:35.588206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:35.588206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:35.588206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:35.588206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:35.588206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 371/743] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:35.588682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2e454-a15a-44a9-80a6-6ab601404852 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:35.600729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-777e3ea9-5422-4ae3-9522-2e412619a177 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:35.601907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-777e3ea9-5422-4ae3-9522-2e412619a177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:35.668030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 373/744] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:35 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 14:18:35.668884 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e3ea9-5422-4ae3-9522-2e412619a177 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:35.704602 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2e454-a15a-44a9-80a6-6ab601404852 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:35.746853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccfe26-8564-47ac-8167-a2dd9847cd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:35.747658 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccfe26-8564-47ac-8167-a2dd9847cd38 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:35.747934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccfe26-8564-47ac-8167-a2dd9847cd38 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:35.748201 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccfe26-8564-47ac-8167-a2dd9847cd38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:35.758357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccfe26-8564-47ac-8167-a2dd9847cd38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-bfccfe26-8564-47ac-8167-a2dd9847cd38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:35.766715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:35.767650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:35.768563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:35.768563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:35.768563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:35.768563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:35.768563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:35.768563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:35.768563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:35.768563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:35.768563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:35.768563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:35.768563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:35.768563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:35.768563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 372/745] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:35.769253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccfe26-8564-47ac-8167-a2dd9847cd38 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:35.788167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e3ea9-5422-4ae3-9522-2e412619a177 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:35.823645 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de897ae0-93f8-4bed-a244-89122141b173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:35.824440 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de897ae0-93f8-4bed-a244-89122141b173 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:35.824717 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de897ae0-93f8-4bed-a244-89122141b173 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:35.824979 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de897ae0-93f8-4bed-a244-89122141b173 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:35.832283 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de897ae0-93f8-4bed-a244-89122141b173 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:35.833752 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de897ae0-93f8-4bed-a244-89122141b173 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-de897ae0-93f8-4bed-a244-89122141b173 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:35.847866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:35.849029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:35.849987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:35.849987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:35.849987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:35.849987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:35.849987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:35.849987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:35.849987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:35.849987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:35.849987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 14:18:35.849987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:35.849987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 374/746] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 14:18:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:35.850679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de897ae0-93f8-4bed-a244-89122141b173 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:35.893393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccfe26-8564-47ac-8167-a2dd9847cd38 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:35.926859 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e60b17-0255-430e-a604-c4d15a597df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:35.927525 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e60b17-0255-430e-a604-c4d15a597df1 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:35.927810 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e60b17-0255-430e-a604-c4d15a597df1 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:35.928086 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e60b17-0255-430e-a604-c4d15a597df1 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:35.928869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e60b17-0255-430e-a604-c4d15a597df1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:35.929178 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e60b17-0255-430e-a604-c4d15a597df1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:35.930667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e60b17-0255-430e-a604-c4d15a597df1 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:35.944043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 373/747] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:35.945055 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e60b17-0255-430e-a604-c4d15a597df1 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:35.954216 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de897ae0-93f8-4bed-a244-89122141b173 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:35.987897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6448d-5729-4ecd-93b5-b31225a6fa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:35.988560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6448d-5729-4ecd-93b5-b31225a6fa97 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:35.988861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6448d-5729-4ecd-93b5-b31225a6fa97 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:35.989114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6448d-5729-4ecd-93b5-b31225a6fa97 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:35.989834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6448d-5729-4ecd-93b5-b31225a6fa97 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:35.991228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6448d-5729-4ecd-93b5-b31225a6fa97 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:36.014518 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 375/748] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 14:18:35 2022] POST /identity/v3/services => generated 240 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:18:36.014518 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6448d-5729-4ecd-93b5-b31225a6fa97 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:36.046403 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e60b17-0255-430e-a604-c4d15a597df1 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:36.093576 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4de79-0d4f-4dbd-8929-8de66ac5ac79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:36.094288 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4de79-0d4f-4dbd-8929-8de66ac5ac79 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:36.094572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4de79-0d4f-4dbd-8929-8de66ac5ac79 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:36.094845 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4de79-0d4f-4dbd-8929-8de66ac5ac79 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:36.095599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4de79-0d4f-4dbd-8929-8de66ac5ac79 None admin] RBAC: Adding query filter params (name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:36.095949 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4de79-0d4f-4dbd-8929-8de66ac5ac79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:36.097367 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4de79-0d4f-4dbd-8929-8de66ac5ac79 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:36.107735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 374/749] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:36.108709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4de79-0d4f-4dbd-8929-8de66ac5ac79 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:36.144604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6448d-5729-4ecd-93b5-b31225a6fa97 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:36.194272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae1cb1-b248-458b-a93d-078e8e1e490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:36.195469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae1cb1-b248-458b-a93d-078e8e1e490d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:36.195908 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae1cb1-b248-458b-a93d-078e8e1e490d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:36.196188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae1cb1-b248-458b-a93d-078e8e1e490d None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:36.197052 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae1cb1-b248-458b-a93d-078e8e1e490d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:36.197363 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae1cb1-b248-458b-a93d-078e8e1e490d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:36.199323 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae1cb1-b248-458b-a93d-078e8e1e490d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:36.222037 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 376/750] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 14:18:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:36.222828 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae1cb1-b248-458b-a93d-078e8e1e490d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:36.224583 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4de79-0d4f-4dbd-8929-8de66ac5ac79 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:36.266251 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79770a-ece3-4f00-a2f8-79d5fc7eb57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:36.266867 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79770a-ece3-4f00-a2f8-79d5fc7eb57c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:36.267155 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79770a-ece3-4f00-a2f8-79d5fc7eb57c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:36.267434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79770a-ece3-4f00-a2f8-79d5fc7eb57c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:36.268272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79770a-ece3-4f00-a2f8-79d5fc7eb57c None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=055264c31c9e4d3dbf234a362ee82698) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:36.268586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79770a-ece3-4f00-a2f8-79d5fc7eb57c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:36.270033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79770a-ece3-4f00-a2f8-79d5fc7eb57c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:36.275592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 375/751] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:36 2022] GET /identity/v3/role_assignments?user.id=055264c31c9e4d3dbf234a362ee82698&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:36.276927 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79770a-ece3-4f00-a2f8-79d5fc7eb57c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:36.348716 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae1cb1-b248-458b-a93d-078e8e1e490d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:36.394537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79770a-ece3-4f00-a2f8-79d5fc7eb57c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:36.395480 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86125913-6a54-40e1-a63d-62b723ce6ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:36.396497 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86125913-6a54-40e1-a63d-62b723ce6ff6 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:36.396947 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86125913-6a54-40e1-a63d-62b723ce6ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:36.397411 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86125913-6a54-40e1-a63d-62b723ce6ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:36.409985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86125913-6a54-40e1-a63d-62b723ce6ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:36.411776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86125913-6a54-40e1-a63d-62b723ce6ff6 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:36.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-86125913-6a54-40e1-a63d-62b723ce6ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:36.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:36.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:36.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:36.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:36.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:36.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:36.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:36.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:36.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:36.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:36.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:36.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:36.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:36.433476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:36.434472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:36.435345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:36.435345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:36.435345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:36.435345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:36.437895 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 377/752] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:36.443948 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86125913-6a54-40e1-a63d-62b723ce6ff6 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:36.503832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a7905-f593-435c-9e87-8907a582ec4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:36.504887 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a7905-f593-435c-9e87-8907a582ec4b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:36.504887 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a7905-f593-435c-9e87-8907a582ec4b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:36.505182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a7905-f593-435c-9e87-8907a582ec4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:36.521041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a7905-f593-435c-9e87-8907a582ec4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:36.522520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a7905-f593-435c-9e87-8907a582ec4b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:36.540332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-705a7905-f593-435c-9e87-8907a582ec4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:36.540332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:36.540332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:36.540332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:36.540332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:36.540332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:36.540332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:36.540332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:36.540332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:36.540332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:36.540332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:36.540332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:36.540332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:36.540332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:36.540332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:36.541405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:36.542965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:36.542965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:36.542965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:36.542965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:36.546518 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 376/753] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:36.548023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a7905-f593-435c-9e87-8907a582ec4b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:36.560656 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86125913-6a54-40e1-a63d-62b723ce6ff6 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:36.607172 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42288f7b-136b-4c43-9154-2030ec572c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:36.608234 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42288f7b-136b-4c43-9154-2030ec572c27 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:36.608965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42288f7b-136b-4c43-9154-2030ec572c27 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:36.609653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42288f7b-136b-4c43-9154-2030ec572c27 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:36.610706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42288f7b-136b-4c43-9154-2030ec572c27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:36.611476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42288f7b-136b-4c43-9154-2030ec572c27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:36.613452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42288f7b-136b-4c43-9154-2030ec572c27 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:36.628317 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 378/754] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:36.634704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42288f7b-136b-4c43-9154-2030ec572c27 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:36.758986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42288f7b-136b-4c43-9154-2030ec572c27 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:36.833566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612dd69-21f5-4099-ac08-884f4c1a57f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:36.834409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612dd69-21f5-4099-ac08-884f4c1a57f7 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:36.834692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612dd69-21f5-4099-ac08-884f4c1a57f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:36.834966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612dd69-21f5-4099-ac08-884f4c1a57f7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:36.847658 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612dd69-21f5-4099-ac08-884f4c1a57f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:36.849120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612dd69-21f5-4099-ac08-884f4c1a57f7 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:36.851652 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a7905-f593-435c-9e87-8907a582ec4b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-9612dd69-21f5-4099-ac08-884f4c1a57f7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:36.874553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:36.875522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:36.876451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:36.876451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:36.876451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:36.876451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:36.876451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:36.876451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:36.876451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:36.876451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:36.876451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 14:18:36.876451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:36.876451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 379/755] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 14:18:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:36.883545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612dd69-21f5-4099-ac08-884f4c1a57f7 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:36.924817 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfee5f-1ddf-4e9d-9b6d-6d1fcae71134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:36.925491 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfee5f-1ddf-4e9d-9b6d-6d1fcae71134 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:36.925774 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfee5f-1ddf-4e9d-9b6d-6d1fcae71134 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:36.926048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfee5f-1ddf-4e9d-9b6d-6d1fcae71134 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:36.926819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfee5f-1ddf-4e9d-9b6d-6d1fcae71134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:36.927124 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfee5f-1ddf-4e9d-9b6d-6d1fcae71134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:36.928514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfee5f-1ddf-4e9d-9b6d-6d1fcae71134 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:36.948989 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 377/756] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:36.952467 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78bd38-cc11-4c58-b092-16487b9a26a9 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:36.952756 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78bd38-cc11-4c58-b092-16487b9a26a9 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:36.953034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78bd38-cc11-4c58-b092-16487b9a26a9 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:36.955105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 378/757] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:36.956130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78bd38-cc11-4c58-b092-16487b9a26a9 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:37.038604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612dd69-21f5-4099-ac08-884f4c1a57f7 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:37.072408 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78bd38-cc11-4c58-b092-16487b9a26a9 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:37.078445 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc041218-57c6-4355-8913-adf137568047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:37.079117 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc041218-57c6-4355-8913-adf137568047 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:37.079400 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc041218-57c6-4355-8913-adf137568047 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:37.079674 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc041218-57c6-4355-8913-adf137568047 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:37.080518 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc041218-57c6-4355-8913-adf137568047 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:37.081084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc041218-57c6-4355-8913-adf137568047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:37.082658 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc041218-57c6-4355-8913-adf137568047 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:37.105036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 380/758] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 17 14:18:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:37.105036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a3122-52c7-4cc0-be44-cb2077dbd151 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:37.105036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a3122-52c7-4cc0-be44-cb2077dbd151 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:37.105036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a3122-52c7-4cc0-be44-cb2077dbd151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:37.115603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b7baf-0b3d-4420-b948-1aad97604237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:37.116696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b7baf-0b3d-4420-b948-1aad97604237 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:37.117200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b7baf-0b3d-4420-b948-1aad97604237 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:37.117668 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b7baf-0b3d-4420-b948-1aad97604237 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:37.121122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-696a3122-52c7-4cc0-be44-cb2077dbd151 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:37.122401 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-696a3122-52c7-4cc0-be44-cb2077dbd151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:37.126530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b7baf-0b3d-4420-b948-1aad97604237 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:37.128210 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b7baf-0b3d-4420-b948-1aad97604237 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:37.142337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-5d9b7baf-0b3d-4420-b948-1aad97604237 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:37.142337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:37.142337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:37.142337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:37.142337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:37.142337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:37.142337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:37.142337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:37.142337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:37.142337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:37.142337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:37.142337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:37.142337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:37.142337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:37.142337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:37.143224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:37.144113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:37.144113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:37.144113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:37.144113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:37.144113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:37.144113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:37.144113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:37.144113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:37.146211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 379/759] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:37.147197 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b7baf-0b3d-4420-b948-1aad97604237 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:37.206206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 381/760] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:18:37.206206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a3122-52c7-4cc0-be44-cb2077dbd151 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:37.271998 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b7baf-0b3d-4420-b948-1aad97604237 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:37.306206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53766a-b3b7-48ce-9266-47d86d7c6b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:37.306903 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53766a-b3b7-48ce-9266-47d86d7c6b26 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:37.307187 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53766a-b3b7-48ce-9266-47d86d7c6b26 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:37.307690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53766a-b3b7-48ce-9266-47d86d7c6b26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:37.310239 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a3122-52c7-4cc0-be44-cb2077dbd151 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:37.349146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdadb0d-bc9f-41f4-9cfb-9a346e3c0a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:37.349811 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdadb0d-bc9f-41f4-9cfb-9a346e3c0a1c None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:37.350442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdadb0d-bc9f-41f4-9cfb-9a346e3c0a1c None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:37.350442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdadb0d-bc9f-41f4-9cfb-9a346e3c0a1c None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:37.351254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdadb0d-bc9f-41f4-9cfb-9a346e3c0a1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:37.351566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdadb0d-bc9f-41f4-9cfb-9a346e3c0a1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:37.352992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdadb0d-bc9f-41f4-9cfb-9a346e3c0a1c None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:37.370165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 382/761] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:37.371283 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdadb0d-bc9f-41f4-9cfb-9a346e3c0a1c None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:37.380698 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53766a-b3b7-48ce-9266-47d86d7c6b26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:37.382425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53766a-b3b7-48ce-9266-47d86d7c6b26 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:37.473741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdadb0d-bc9f-41f4-9cfb-9a346e3c0a1c None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:37.491101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 380/762] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:18:37.492196 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53766a-b3b7-48ce-9266-47d86d7c6b26 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:37.508812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b365c7-7b25-44a2-aa10-f29318a66f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:37.509619 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b365c7-7b25-44a2-aa10-f29318a66f84 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:37.509904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b365c7-7b25-44a2-aa10-f29318a66f84 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:37.510202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b365c7-7b25-44a2-aa10-f29318a66f84 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:37.511494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b365c7-7b25-44a2-aa10-f29318a66f84 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:37.513056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b365c7-7b25-44a2-aa10-f29318a66f84 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-48b365c7-7b25-44a2-aa10-f29318a66f84 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:37.528016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:37.528987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:37.529810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:37.529810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:37.529810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:37.529810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:37.529810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:37.529810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:37.529810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:37.529810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:37.529810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:37.529810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:37.529810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:37.529810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:37.529810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:37.529810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 14:18:37.529810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:37.534345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 383/763] 10.222.0.48 () {56 vars in 1129 bytes} [Tue May 17 14:18:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:37.535111 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b365c7-7b25-44a2-aa10-f29318a66f84 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:37.598937 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53766a-b3b7-48ce-9266-47d86d7c6b26 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:37.634709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17761e9-4e06-47da-95e1-d2db89f1ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:37.636090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17761e9-4e06-47da-95e1-d2db89f1ea12 None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:37.636583 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17761e9-4e06-47da-95e1-d2db89f1ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:37.637046 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17761e9-4e06-47da-95e1-d2db89f1ea12 None admin] PATH_INFO: `/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/1f443d2ca1534249bb2c4096300ddffd/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:37.638915 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b365c7-7b25-44a2-aa10-f29318a66f84 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:37.639531 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17761e9-4e06-47da-95e1-d2db89f1ea12 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac7d1119033458393ad6f78fc0df7a3, user_id=1f443d2ca1534249bb2c4096300ddffd, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:37.641175 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17761e9-4e06-47da-95e1-d2db89f1ea12 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:37.658637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 381/764] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:18:37 2022] PUT /identity/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/1f443d2ca1534249bb2c4096300ddffd/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:18:37.659829 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17761e9-4e06-47da-95e1-d2db89f1ea12 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:37.695761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162535b5-a11c-4576-8d43-6d0953cb1109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:37.696605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162535b5-a11c-4576-8d43-6d0953cb1109 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:37.696903 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162535b5-a11c-4576-8d43-6d0953cb1109 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:37.697187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162535b5-a11c-4576-8d43-6d0953cb1109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:37.720556 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162535b5-a11c-4576-8d43-6d0953cb1109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:37.721932 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162535b5-a11c-4576-8d43-6d0953cb1109 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:37.757655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-162535b5-a11c-4576-8d43-6d0953cb1109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:37.757655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:37.757655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:37.757655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:37.757655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:37.757655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:37.757655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:37.757655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:37.757655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:37.757655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:37.757655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:37.757655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:37.757655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:37.757655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:37.757655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:37.758733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:37.759633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:37.759633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:37.759633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:37.759633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:37.759633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 384/765] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:37.764752 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162535b5-a11c-4576-8d43-6d0953cb1109 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:37.780586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17761e9-4e06-47da-95e1-d2db89f1ea12 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:37.821743 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f4549-7086-4137-b90d-2d8fc52d81e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:37.822945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f4549-7086-4137-b90d-2d8fc52d81e2 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:37.824682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f4549-7086-4137-b90d-2d8fc52d81e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:37.825219 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f4549-7086-4137-b90d-2d8fc52d81e2 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:37.826347 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f4549-7086-4137-b90d-2d8fc52d81e2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:37.826889 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f4549-7086-4137-b90d-2d8fc52d81e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:37.828511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f4549-7086-4137-b90d-2d8fc52d81e2 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:37.834802 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 382/766] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 17 14:18:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:37.844190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f4549-7086-4137-b90d-2d8fc52d81e2 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:37.978964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162535b5-a11c-4576-8d43-6d0953cb1109 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:38.007139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f4549-7086-4137-b90d-2d8fc52d81e2 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:38.023181 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4b2dc-9a9a-4ddc-a6ec-214a0d62aedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:38.024177 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4b2dc-9a9a-4ddc-a6ec-214a0d62aedd None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:38.024469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4b2dc-9a9a-4ddc-a6ec-214a0d62aedd None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:38.025050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4b2dc-9a9a-4ddc-a6ec-214a0d62aedd None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:38.025794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4b2dc-9a9a-4ddc-a6ec-214a0d62aedd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:38.026133 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4b2dc-9a9a-4ddc-a6ec-214a0d62aedd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:38.028845 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4b2dc-9a9a-4ddc-a6ec-214a0d62aedd None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:38.045355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 385/767] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:38.050444 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4b2dc-9a9a-4ddc-a6ec-214a0d62aedd None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:38.054272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d3a43-8153-493d-879d-0f943b542862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:38.054956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d3a43-8153-493d-879d-0f943b542862 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:38.055238 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d3a43-8153-493d-879d-0f943b542862 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:38.055514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d3a43-8153-493d-879d-0f943b542862 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:38.056234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d3a43-8153-493d-879d-0f943b542862 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:38.056538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d3a43-8153-493d-879d-0f943b542862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:38.057998 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d3a43-8153-493d-879d-0f943b542862 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:38.063480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 383/768] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 17 14:18:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:38.069793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d3a43-8153-493d-879d-0f943b542862 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:38.167414 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4b2dc-9a9a-4ddc-a6ec-214a0d62aedd None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:38.216305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c3cdc-2208-46f4-93ea-403693db124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:38.217107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c3cdc-2208-46f4-93ea-403693db124f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:38.217391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c3cdc-2208-46f4-93ea-403693db124f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:38.217665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c3cdc-2208-46f4-93ea-403693db124f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:38.218836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d3a43-8153-493d-879d-0f943b542862 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:38.228816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c3cdc-2208-46f4-93ea-403693db124f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:38.230916 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c3cdc-2208-46f4-93ea-403693db124f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:38.255397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117451c2-1d28-452e-a86d-aa299fc283cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:38.256400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117451c2-1d28-452e-a86d-aa299fc283cd None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:38.256904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117451c2-1d28-452e-a86d-aa299fc283cd None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:38.257381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117451c2-1d28-452e-a86d-aa299fc283cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:38.258415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117451c2-1d28-452e-a86d-aa299fc283cd None admin] RBAC: Adding query filter params (interface=public, service_id=e1ae015e8c43420b90734a68d72b0563, region_id=RegionOne) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:38.258924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117451c2-1d28-452e-a86d-aa299fc283cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:38.259638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-db4c3cdc-2208-46f4-93ea-403693db124f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:38.259638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:38.259638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:38.259638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:38.259638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:38.259638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:38.259638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:38.259638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:38.259638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:38.259638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:38.259638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:38.259638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:38.259638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:38.259638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:38.259638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:38.260516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:38.261499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:38.261499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:38.261499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:38.261499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:38.261499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:38.261499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:38.261499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:38.261499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:38.263276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117451c2-1d28-452e-a86d-aa299fc283cd None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:38.265675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 386/769] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:38.271211 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c3cdc-2208-46f4-93ea-403693db124f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:38.272478 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 384/770] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 14:18:38 2022] GET /identity/v3/endpoints?service_id=e1ae015e8c43420b90734a68d72b0563&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:38.279171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117451c2-1d28-452e-a86d-aa299fc283cd None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:38.387883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117451c2-1d28-452e-a86d-aa299fc283cd None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:38.422200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5af58-3292-43f6-93b4-dfdd2290b437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:38.423231 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5af58-3292-43f6-93b4-dfdd2290b437 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:38.423733 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5af58-3292-43f6-93b4-dfdd2290b437 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:38.424205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5af58-3292-43f6-93b4-dfdd2290b437 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:38.425075 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5af58-3292-43f6-93b4-dfdd2290b437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:38.426681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5af58-3292-43f6-93b4-dfdd2290b437 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:38.433139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 385/771] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 14:18:38 2022] GET /identity/v3/services => generated 772 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:38.458716 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c3cdc-2208-46f4-93ea-403693db124f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:38.525249 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e248c-c43d-4fb0-96ac-6e92f427dbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:38.525847 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e248c-c43d-4fb0-96ac-6e92f427dbca None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:38.526678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e248c-c43d-4fb0-96ac-6e92f427dbca None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:38.527563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e248c-c43d-4fb0-96ac-6e92f427dbca None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:38.528434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e248c-c43d-4fb0-96ac-6e92f427dbca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:38.528746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e248c-c43d-4fb0-96ac-6e92f427dbca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:38.530302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e248c-c43d-4fb0-96ac-6e92f427dbca None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:38.549191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 387/772] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:38.555471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5af58-3292-43f6-93b4-dfdd2290b437 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:38.687838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5af58-3292-43f6-93b4-dfdd2290b437 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:38.726121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce418ee-a8e3-45fb-a30c-e014783d98c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:38.726803 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce418ee-a8e3-45fb-a30c-e014783d98c2 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:38.727085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce418ee-a8e3-45fb-a30c-e014783d98c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:38.727358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce418ee-a8e3-45fb-a30c-e014783d98c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:38.728185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce418ee-a8e3-45fb-a30c-e014783d98c2 None admin] RBAC: Adding query filter params (role.id=4aa22f352696432bbf8fcd9d74ba0dc7, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=ba800a3364ee46f395d040f7eb8f775f) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:38.728493 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce418ee-a8e3-45fb-a30c-e014783d98c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:38.730758 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce418ee-a8e3-45fb-a30c-e014783d98c2 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:38.736615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 386/773] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:38 2022] GET /identity/v3/role_assignments?user.id=ba800a3364ee46f395d040f7eb8f775f&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=4aa22f352696432bbf8fcd9d74ba0dc7 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:38.744180 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b437f8-f80b-4a93-a88d-d16d7001a2bd None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:38.744805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b437f8-f80b-4a93-a88d-d16d7001a2bd None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:38.745791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b437f8-f80b-4a93-a88d-d16d7001a2bd None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:38.747586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 388/774] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:38.753788 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10376-bc0b-42dd-9db8-7015425cd5cf None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:38.754110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10376-bc0b-42dd-9db8-7015425cd5cf None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:38.754382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10376-bc0b-42dd-9db8-7015425cd5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:38.774053 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-4ea10376-bc0b-42dd-9db8-7015425cd5cf None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:38.775347 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-4ea10376-bc0b-42dd-9db8-7015425cd5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:38.856041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 387/775] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:18:38.889290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b437f8-f80b-4a93-a88d-d16d7001a2bd None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:38.923927 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cce5d5-aa98-4a48-9d23-6d23adefb391 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:38.924254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cce5d5-aa98-4a48-9d23-6d23adefb391 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:38.924496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cce5d5-aa98-4a48-9d23-6d23adefb391 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:38.926368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 388/776] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:18:38.935865 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce697d-77d2-4223-ac8e-fd9c545d30f1 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:38.936484 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce697d-77d2-4223-ac8e-fd9c545d30f1 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:38.936967 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce697d-77d2-4223-ac8e-fd9c545d30f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:38.965440 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-1dce697d-77d2-4223-ac8e-fd9c545d30f1 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:38.967285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1dce697d-77d2-4223-ac8e-fd9c545d30f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:39.018487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b437f8-f80b-4a93-a88d-d16d7001a2bd None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:39.055296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f2497-f2c6-4cc7-bf1b-90472a2001be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:39.056009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2497-f2c6-4cc7-bf1b-90472a2001be None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:39.056284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2497-f2c6-4cc7-bf1b-90472a2001be None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:39.056550 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2497-f2c6-4cc7-bf1b-90472a2001be None admin] PATH_INFO: `/v3/services/network` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:39.057198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f2497-f2c6-4cc7-bf1b-90472a2001be None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:39.062207 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f2497-f2c6-4cc7-bf1b-90472a2001be None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-f43f2497-f2c6-4cc7-bf1b-90472a2001be None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:39.071840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:39.072841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:39.074513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:39.074513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:39.074513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:39.074513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:39.074513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:39.074513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:39.074513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:39.074513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:39.074513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:39.074513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:39.074513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:39.074513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:39.074513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 14:18:39.074513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:39.074513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 389/777] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:38 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:39.079105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f2497-f2c6-4cc7-bf1b-90472a2001be None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:39.117409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 389/778] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) May 17 14:18:39.142398 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce697d-77d2-4223-ac8e-fd9c545d30f1 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:39.275418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f2497-f2c6-4cc7-bf1b-90472a2001be None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:39.304333 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce697d-77d2-4223-ac8e-fd9c545d30f1 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:39.342284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29139137-ce00-4697-a7cd-7f1c0529d8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:39.343339 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29139137-ce00-4697-a7cd-7f1c0529d8f4 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:39.344383 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29139137-ce00-4697-a7cd-7f1c0529d8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:39.345066 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29139137-ce00-4697-a7cd-7f1c0529d8f4 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:39.347045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29139137-ce00-4697-a7cd-7f1c0529d8f4 None admin] RBAC: Adding query filter params (name=network) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:39.347560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29139137-ce00-4697-a7cd-7f1c0529d8f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:39.349818 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29139137-ce00-4697-a7cd-7f1c0529d8f4 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:39.358482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 390/779] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 14:18:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:39.365716 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29139137-ce00-4697-a7cd-7f1c0529d8f4 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:39.379895 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa2bae-4b37-46ab-9045-57910020ac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:39.381020 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa2bae-4b37-46ab-9045-57910020ac68 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:39.381524 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa2bae-4b37-46ab-9045-57910020ac68 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:39.381993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa2bae-4b37-46ab-9045-57910020ac68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:39.394237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa2bae-4b37-46ab-9045-57910020ac68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-cafa2bae-4b37-46ab-9045-57910020ac68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:39.401745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:39.402730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:39.403550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:39.403550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:39.403550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:39.403550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:39.403550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:39.403550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:39.403550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:39.403550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:39.403550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:39.403550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:39.403550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:18:39.403550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:39.411118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 390/780] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:18:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:39.417462 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa2bae-4b37-46ab-9045-57910020ac68 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:39.491783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29139137-ce00-4697-a7cd-7f1c0529d8f4 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:39.526866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a838118-8fbc-4b10-b42b-660f14819bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:39.527937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a838118-8fbc-4b10-b42b-660f14819bf3 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:39.528509 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a838118-8fbc-4b10-b42b-660f14819bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:39.528978 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a838118-8fbc-4b10-b42b-660f14819bf3 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:39.529879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a838118-8fbc-4b10-b42b-660f14819bf3 None admin] RBAC: Adding query filter params (type=network) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:39.530402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a838118-8fbc-4b10-b42b-660f14819bf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:39.531984 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a838118-8fbc-4b10-b42b-660f14819bf3 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:39.537420 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 391/781] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 14:18:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:39.543977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a838118-8fbc-4b10-b42b-660f14819bf3 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:39.644441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a838118-8fbc-4b10-b42b-660f14819bf3 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:39.670960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa2bae-4b37-46ab-9045-57910020ac68 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:39.678838 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9ae8b-cdd6-49aa-a15f-17fff8287fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:39.679850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9ae8b-cdd6-49aa-a15f-17fff8287fb3 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:39.680332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9ae8b-cdd6-49aa-a15f-17fff8287fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:39.680818 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9ae8b-cdd6-49aa-a15f-17fff8287fb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:39.681802 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9ae8b-cdd6-49aa-a15f-17fff8287fb3 None admin] RBAC: Adding query filter params (interface=public, service_id=cd6412a15a484bc2af397075c30dbb61, region_id=RegionOne) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:39.682995 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9ae8b-cdd6-49aa-a15f-17fff8287fb3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:39.684833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9ae8b-cdd6-49aa-a15f-17fff8287fb3 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:39.693108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 392/782] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 14:18:39 2022] GET /identity/v3/endpoints?service_id=cd6412a15a484bc2af397075c30dbb61&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:39.698704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9ae8b-cdd6-49aa-a15f-17fff8287fb3 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:39.752372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a3c75-082e-4365-98a8-bb7b0aa02664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:39.753056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a3c75-082e-4365-98a8-bb7b0aa02664 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:39.753341 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a3c75-082e-4365-98a8-bb7b0aa02664 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:39.753620 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a3c75-082e-4365-98a8-bb7b0aa02664 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:39.754395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a3c75-082e-4365-98a8-bb7b0aa02664 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:39.754704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a3c75-082e-4365-98a8-bb7b0aa02664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:39.756080 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a3c75-082e-4365-98a8-bb7b0aa02664 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:39.773706 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 391/783] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:18:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:39.779769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a3c75-082e-4365-98a8-bb7b0aa02664 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:39.802459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9ae8b-cdd6-49aa-a15f-17fff8287fb3 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:39.838090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05683528-0440-4546-820e-4a9a31213c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:39.839342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05683528-0440-4546-820e-4a9a31213c84 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:39.839847 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05683528-0440-4546-820e-4a9a31213c84 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:39.840332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05683528-0440-4546-820e-4a9a31213c84 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:39.841206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05683528-0440-4546-820e-4a9a31213c84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:39.842813 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05683528-0440-4546-820e-4a9a31213c84 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:39.852592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 393/784] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 14:18:39 2022] GET /identity/v3/services => generated 772 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:39.981741 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a3c75-082e-4365-98a8-bb7b0aa02664 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:40.033346 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefead9-6ded-4f49-bd70-b79d143c75d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:40.034160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefead9-6ded-4f49-bd70-b79d143c75d4 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:40.034477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefead9-6ded-4f49-bd70-b79d143c75d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:40.034747 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefead9-6ded-4f49-bd70-b79d143c75d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:40.048415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefead9-6ded-4f49-bd70-b79d143c75d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:40.049871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefead9-6ded-4f49-bd70-b79d143c75d4 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:40.067882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-5fefead9-6ded-4f49-bd70-b79d143c75d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:40.067882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:40.067882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:40.067882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:40.067882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:40.067882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:40.067882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:40.067882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:40.067882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:40.067882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:40.067882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:40.067882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:40.067882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:40.067882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:40.067882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:40.068842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:40.069717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:40.069717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:40.069717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:40.069717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:40.069717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 392/785] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:40.075065 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05683528-0440-4546-820e-4a9a31213c84 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:40.213781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05683528-0440-4546-820e-4a9a31213c84 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:40.269329 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9592338-d269-4e31-8c03-de79eda47345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:40.269927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9592338-d269-4e31-8c03-de79eda47345 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:40.270232 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9592338-d269-4e31-8c03-de79eda47345 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:40.270514 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9592338-d269-4e31-8c03-de79eda47345 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:40.271243 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9592338-d269-4e31-8c03-de79eda47345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:40.271551 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9592338-d269-4e31-8c03-de79eda47345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:40.272929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9592338-d269-4e31-8c03-de79eda47345 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:40.293182 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 394/786] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:40.298361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefead9-6ded-4f49-bd70-b79d143c75d4 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:40.424616 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefead9-6ded-4f49-bd70-b79d143c75d4 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:40.472121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa758a1-7bd5-4a20-b80f-37c811a65f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:40.472960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa758a1-7bd5-4a20-b80f-37c811a65f33 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:40.473246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa758a1-7bd5-4a20-b80f-37c811a65f33 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:40.473529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa758a1-7bd5-4a20-b80f-37c811a65f33 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:40.489013 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa758a1-7bd5-4a20-b80f-37c811a65f33 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:40.490657 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa758a1-7bd5-4a20-b80f-37c811a65f33 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-daa758a1-7bd5-4a20-b80f-37c811a65f33 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:40.518114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:40.519164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:40.520150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:40.520150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:40.520150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:40.520150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:40.520150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:40.520150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:40.520150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:40.520150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:40.520150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 14:18:40.520150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:40.520150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 393/787] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:18:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:40.524893 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9592338-d269-4e31-8c03-de79eda47345 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:40.724572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb0771-4650-4156-825b-6f9e4c2dcab0 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:40.725348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb0771-4650-4156-825b-6f9e4c2dcab0 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:40.725831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb0771-4650-4156-825b-6f9e4c2dcab0 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:40.727710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 394/788] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:18:40.732068 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9592338-d269-4e31-8c03-de79eda47345 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:40.733608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594e862-5373-4285-b951-dfc31b5791dc None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:40.734131 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594e862-5373-4285-b951-dfc31b5791dc None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:40.734636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594e862-5373-4285-b951-dfc31b5791dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:40.775265 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-6594e862-5373-4285-b951-dfc31b5791dc None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:40.777584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6594e862-5373-4285-b951-dfc31b5791dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:40.818310 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b962af0-47ba-441c-a96e-205a5e2448e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:40.818997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b962af0-47ba-441c-a96e-205a5e2448e1 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:40.819280 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b962af0-47ba-441c-a96e-205a5e2448e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:40.819560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b962af0-47ba-441c-a96e-205a5e2448e1 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:40.822196 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b962af0-47ba-441c-a96e-205a5e2448e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:40.822196 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b962af0-47ba-441c-a96e-205a5e2448e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:40.823799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b962af0-47ba-441c-a96e-205a5e2448e1 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:40.864381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 395/789] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 17 14:18:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:40.869441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b962af0-47ba-441c-a96e-205a5e2448e1 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:40.921825 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 395/790] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:18:40.958252 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594e862-5373-4285-b951-dfc31b5791dc None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:41.050654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b962af0-47ba-441c-a96e-205a5e2448e1 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:41.106983 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d143c-637c-4c9b-8ec5-59cab4297ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:41.107811 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d143c-637c-4c9b-8ec5-59cab4297ee6 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:41.108098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d143c-637c-4c9b-8ec5-59cab4297ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:41.108378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d143c-637c-4c9b-8ec5-59cab4297ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:41.133531 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d143c-637c-4c9b-8ec5-59cab4297ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:41.137478 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d143c-637c-4c9b-8ec5-59cab4297ee6 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:41.171312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-0c7d143c-637c-4c9b-8ec5-59cab4297ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:41.171312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:41.171312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:41.171312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:41.171312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:41.171312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:41.171312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:41.171312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:41.171312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:41.171312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:41.171312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:41.171312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:41.171312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:41.171312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:41.171312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:41.172270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:41.173139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:41.173139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:41.173139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:41.173139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:41.182079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594e862-5373-4285-b951-dfc31b5791dc None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:41.185997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 396/791] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:41.186956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d143c-637c-4c9b-8ec5-59cab4297ee6 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:41.258223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301a705-40b2-44ac-a105-92cfcd94c9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:41.261269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301a705-40b2-44ac-a105-92cfcd94c9fb None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:41.261727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301a705-40b2-44ac-a105-92cfcd94c9fb None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:41.262137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301a705-40b2-44ac-a105-92cfcd94c9fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:41.311006 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301a705-40b2-44ac-a105-92cfcd94c9fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-a301a705-40b2-44ac-a105-92cfcd94c9fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:41.329690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:41.330976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:41.331823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:41.331823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:41.331823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:41.331823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:41.331823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:41.331823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:41.331823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:41.331823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:41.331823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:41.331823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:41.331823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:18:41.331823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:41.336296 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 396/792] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:18:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:41.337735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e312-08a1-40e4-9a47-f833ebb6788f None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:41.338167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e312-08a1-40e4-9a47-f833ebb6788f None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:41.342204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9e312-08a1-40e4-9a47-f833ebb6788f None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:41.344607 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 397/793] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:41.345608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9e312-08a1-40e4-9a47-f833ebb6788f None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:41.391976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d143c-637c-4c9b-8ec5-59cab4297ee6 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:41.433973 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45344a8a-7b30-4df8-8ca5-d8ef97067de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:41.434675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45344a8a-7b30-4df8-8ca5-d8ef97067de5 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:41.434981 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45344a8a-7b30-4df8-8ca5-d8ef97067de5 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:41.435257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45344a8a-7b30-4df8-8ca5-d8ef97067de5 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:41.435991 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45344a8a-7b30-4df8-8ca5-d8ef97067de5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:41.436295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45344a8a-7b30-4df8-8ca5-d8ef97067de5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:41.437679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45344a8a-7b30-4df8-8ca5-d8ef97067de5 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:41.450433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 397/794] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:41.451926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7217b-01fb-4226-86d8-2fc1c24f8c9a None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:41.452108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7217b-01fb-4226-86d8-2fc1c24f8c9a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:41.452350 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7217b-01fb-4226-86d8-2fc1c24f8c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:41.470804 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-44c7217b-01fb-4226-86d8-2fc1c24f8c9a None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:41.472289 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-44c7217b-01fb-4226-86d8-2fc1c24f8c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:41.521271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9e312-08a1-40e4-9a47-f833ebb6788f None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:41.547804 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 398/795] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:18:41.549084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ab38a-5872-4e7c-a93b-96a96844f5ab None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:41.549374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ab38a-5872-4e7c-a93b-96a96844f5ab None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:41.549642 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ab38a-5872-4e7c-a93b-96a96844f5ab None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:41.551031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 399/796] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:41.554061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea697c5-80a7-49cd-a78f-fcce1fd5b07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:41.554786 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea697c5-80a7-49cd-a78f-fcce1fd5b07e None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:41.555214 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea697c5-80a7-49cd-a78f-fcce1fd5b07e None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:41.555400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea697c5-80a7-49cd-a78f-fcce1fd5b07e None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:41.555661 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ab38a-5872-4e7c-a93b-96a96844f5ab None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:41.556140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea697c5-80a7-49cd-a78f-fcce1fd5b07e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:41.556455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea697c5-80a7-49cd-a78f-fcce1fd5b07e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:41.562573 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea697c5-80a7-49cd-a78f-fcce1fd5b07e None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:41.572181 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 398/797] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:18:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:41.574304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4276f3-7026-4ae3-8a09-ee4f68a53bca None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:41.574596 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4276f3-7026-4ae3-8a09-ee4f68a53bca None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:41.574872 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4276f3-7026-4ae3-8a09-ee4f68a53bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:41.591301 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-dc4276f3-7026-4ae3-8a09-ee4f68a53bca None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:41.592476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-dc4276f3-7026-4ae3-8a09-ee4f68a53bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:41.662434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 399/798] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:18:41.663958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ab38a-5872-4e7c-a93b-96a96844f5ab None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:41.671146 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4276f3-7026-4ae3-8a09-ee4f68a53bca None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:41.702670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7989e-956d-4377-8dd5-e545681aa6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:41.703461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7989e-956d-4377-8dd5-e545681aa6a2 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:41.703743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7989e-956d-4377-8dd5-e545681aa6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:41.704017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7989e-956d-4377-8dd5-e545681aa6a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:41.710877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7989e-956d-4377-8dd5-e545681aa6a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:41.712470 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7989e-956d-4377-8dd5-e545681aa6a2 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:41.726384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-dad7989e-956d-4377-8dd5-e545681aa6a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:41.726384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:41.726384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:41.726384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:41.726384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:41.726384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:41.726384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:41.726384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:41.726384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:41.726384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:41.726384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:41.726384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:41.726384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:41.726384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:41.726384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:41.727263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:41.728154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:41.728154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:41.728154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:41.728154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:41.728154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:41.728154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:41.728154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:41.728154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:41.728154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 400/799] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:41.729859 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7989e-956d-4377-8dd5-e545681aa6a2 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:41.786693 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4276f3-7026-4ae3-8a09-ee4f68a53bca None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:41.822719 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d13f06-457e-4a4a-85f6-b55d61c80d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:41.823986 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d13f06-457e-4a4a-85f6-b55d61c80d37 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:41.824265 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d13f06-457e-4a4a-85f6-b55d61c80d37 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:41.824559 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d13f06-457e-4a4a-85f6-b55d61c80d37 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:41.825180 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d13f06-457e-4a4a-85f6-b55d61c80d37 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:41.826573 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d13f06-457e-4a4a-85f6-b55d61c80d37 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:41.826673 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7989e-956d-4377-8dd5-e545681aa6a2 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-d2d13f06-457e-4a4a-85f6-b55d61c80d37 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:41.838864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:41.840010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:41.840847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 400/800] 10.222.0.48 () {56 vars in 1129 bytes} [Tue May 17 14:18:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:41.842256 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d13f06-457e-4a4a-85f6-b55d61c80d37 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:41.867232 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6ccea-d486-422f-997c-d9085c7338ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:41.868250 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6ccea-d486-422f-997c-d9085c7338ab None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:41.868539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6ccea-d486-422f-997c-d9085c7338ab None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:41.868817 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6ccea-d486-422f-997c-d9085c7338ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:41.879743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6ccea-d486-422f-997c-d9085c7338ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:41.881208 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6ccea-d486-422f-997c-d9085c7338ab None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:41.897901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-56b6ccea-d486-422f-997c-d9085c7338ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:41.897901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:41.897901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:41.897901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:41.897901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:41.897901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:41.897901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:41.897901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:41.897901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:41.897901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:41.897901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:41.897901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:41.897901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:41.897901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:41.897901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:41.898944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:41.900002 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:41.900002 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:41.900002 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:41.900002 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:41.903740 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 401/801] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:41.904441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6ccea-d486-422f-997c-d9085c7338ab None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:41.941428 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d13f06-457e-4a4a-85f6-b55d61c80d37 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:41.976226 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a2473-50fb-487d-b0f6-6eb41fcb763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:41.977101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a2473-50fb-487d-b0f6-6eb41fcb763b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:41.977386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a2473-50fb-487d-b0f6-6eb41fcb763b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:41.977658 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a2473-50fb-487d-b0f6-6eb41fcb763b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:41.987703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a2473-50fb-487d-b0f6-6eb41fcb763b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-3b4a2473-50fb-487d-b0f6-6eb41fcb763b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:41.995589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:41.996581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:41.997412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:41.997412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:41.997412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:41.997412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:41.997412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:41.997412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:41.997412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:41.997412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:41.997412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:41.997412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:41.997412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:41.997412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:41.997412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 401/802] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:41.998121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a2473-50fb-487d-b0f6-6eb41fcb763b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:42.012257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6ccea-d486-422f-997c-d9085c7338ab None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:42.054716 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b5dd-90d6-4416-b161-3c7a55f45c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:42.055488 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b5dd-90d6-4416-b161-3c7a55f45c18 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:42.055779 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b5dd-90d6-4416-b161-3c7a55f45c18 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:42.056056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b5dd-90d6-4416-b161-3c7a55f45c18 None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:42.056844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943b5dd-90d6-4416-b161-3c7a55f45c18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:42.057156 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943b5dd-90d6-4416-b161-3c7a55f45c18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:42.059345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943b5dd-90d6-4416-b161-3c7a55f45c18 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:42.071820 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 402/803] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:42.072639 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b5dd-90d6-4416-b161-3c7a55f45c18 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:42.120672 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a2473-50fb-487d-b0f6-6eb41fcb763b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:42.171139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937b452-57a7-4c3a-8012-d6827635f39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:42.172122 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937b452-57a7-4c3a-8012-d6827635f39f None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:42.172580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937b452-57a7-4c3a-8012-d6827635f39f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:42.173035 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937b452-57a7-4c3a-8012-d6827635f39f None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:42.173955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937b452-57a7-4c3a-8012-d6827635f39f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:42.174483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937b452-57a7-4c3a-8012-d6827635f39f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:42.176830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937b452-57a7-4c3a-8012-d6827635f39f None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:42.183625 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 402/804] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 17 14:18:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:42.184438 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937b452-57a7-4c3a-8012-d6827635f39f None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:42.213117 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b5dd-90d6-4416-b161-3c7a55f45c18 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:42.247872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155d9d0-0f84-40d0-a89b-b4f4408bb28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:42.248802 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d9d0-0f84-40d0-a89b-b4f4408bb28f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:42.249232 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d9d0-0f84-40d0-a89b-b4f4408bb28f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:42.249645 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d9d0-0f84-40d0-a89b-b4f4408bb28f None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:42.250535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155d9d0-0f84-40d0-a89b-b4f4408bb28f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:42.250970 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155d9d0-0f84-40d0-a89b-b4f4408bb28f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:42.252490 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155d9d0-0f84-40d0-a89b-b4f4408bb28f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:42.264188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 403/805] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:42.265184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155d9d0-0f84-40d0-a89b-b4f4408bb28f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:42.293405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937b452-57a7-4c3a-8012-d6827635f39f None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:42.332878 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d7756-0455-4a2c-9848-17a0151290b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:42.333607 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d7756-0455-4a2c-9848-17a0151290b6 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:42.333900 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d7756-0455-4a2c-9848-17a0151290b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:42.334199 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d7756-0455-4a2c-9848-17a0151290b6 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:42.334953 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d7756-0455-4a2c-9848-17a0151290b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:42.335261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d7756-0455-4a2c-9848-17a0151290b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:42.336668 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d7756-0455-4a2c-9848-17a0151290b6 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:42.350012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 403/806] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:42.350012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d7756-0455-4a2c-9848-17a0151290b6 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:42.372485 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155d9d0-0f84-40d0-a89b-b4f4408bb28f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:42.404151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355d18f-d4db-4043-af2a-766c6a69856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:42.405035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355d18f-d4db-4043-af2a-766c6a69856f None admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:42.405311 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355d18f-d4db-4043-af2a-766c6a69856f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:42.405576 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355d18f-d4db-4043-af2a-766c6a69856f None admin] PATH_INFO: `/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/055264c31c9e4d3dbf234a362ee82698/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:42.407540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355d18f-d4db-4043-af2a-766c6a69856f None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac7d1119033458393ad6f78fc0df7a3, user_id=055264c31c9e4d3dbf234a362ee82698, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:42.408970 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355d18f-d4db-4043-af2a-766c6a69856f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:42.423670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 404/807] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:18:42 2022] PUT /identity/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/055264c31c9e4d3dbf234a362ee82698/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:18:42.424777 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355d18f-d4db-4043-af2a-766c6a69856f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:42.452837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d7756-0455-4a2c-9848-17a0151290b6 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:42.492213 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cb604-6879-4d9c-8842-0bf28ce40cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:42.492905 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb604-6879-4d9c-8842-0bf28ce40cfb None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:42.493187 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb604-6879-4d9c-8842-0bf28ce40cfb None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:42.493463 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb604-6879-4d9c-8842-0bf28ce40cfb None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:42.494219 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cb604-6879-4d9c-8842-0bf28ce40cfb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:42.494534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cb604-6879-4d9c-8842-0bf28ce40cfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:42.496662 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cb604-6879-4d9c-8842-0bf28ce40cfb None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:42.502368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 404/808] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 17 14:18:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:42.507356 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cb604-6879-4d9c-8842-0bf28ce40cfb None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:42.555158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355d18f-d4db-4043-af2a-766c6a69856f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:42.592575 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67907ae7-314d-48a4-88ec-235b36d19cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:42.593825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67907ae7-314d-48a4-88ec-235b36d19cbf None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:42.594352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67907ae7-314d-48a4-88ec-235b36d19cbf None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:42.594849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67907ae7-314d-48a4-88ec-235b36d19cbf None admin] PATH_INFO: `/v3/users/nova` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:42.603726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67907ae7-314d-48a4-88ec-235b36d19cbf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:42.606755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67907ae7-314d-48a4-88ec-235b36d19cbf None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:42.617189 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cb604-6879-4d9c-8842-0bf28ce40cfb None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-67907ae7-314d-48a4-88ec-235b36d19cbf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:42.623653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:42.624649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:42.625749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:42.625749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:42.625749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:42.625749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:42.625749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:42.625749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:42.625749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:42.625749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:42.625749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 14:18:42.625749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:42.628519 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 405/809] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 14:18:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:42.629540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67907ae7-314d-48a4-88ec-235b36d19cbf None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:42.653408 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d1639-db3c-42d3-98c8-3956e2c2f84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:42.654244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d1639-db3c-42d3-98c8-3956e2c2f84e None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:42.654534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d1639-db3c-42d3-98c8-3956e2c2f84e None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:42.654807 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d1639-db3c-42d3-98c8-3956e2c2f84e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:42.665918 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d1639-db3c-42d3-98c8-3956e2c2f84e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:42.668010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d1639-db3c-42d3-98c8-3956e2c2f84e None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:42.685520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-894d1639-db3c-42d3-98c8-3956e2c2f84e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:42.685520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:42.685520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:42.685520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:42.685520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:42.685520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:42.685520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:42.685520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:42.685520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:42.685520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:42.685520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:42.685520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:42.685520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:42.685520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:42.685520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:42.686501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:42.687414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:42.687414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:42.687414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:42.687414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:42.687414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 405/810] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:42.687716 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d1639-db3c-42d3-98c8-3956e2c2f84e None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:42.735923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67907ae7-314d-48a4-88ec-235b36d19cbf None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:42.768587 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54067b8a-e603-4449-a8fa-e42060a1cb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:42.769253 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54067b8a-e603-4449-a8fa-e42060a1cb0b None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:42.769532 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54067b8a-e603-4449-a8fa-e42060a1cb0b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:42.769810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54067b8a-e603-4449-a8fa-e42060a1cb0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:42.770614 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54067b8a-e603-4449-a8fa-e42060a1cb0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:42.771980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54067b8a-e603-4449-a8fa-e42060a1cb0b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:42.792502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d1639-db3c-42d3-98c8-3956e2c2f84e None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:42.798412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 406/811] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 14:18:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:18:42.798412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b734d0-b79a-49ac-a964-4fd6f3e55650 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:42.798412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b734d0-b79a-49ac-a964-4fd6f3e55650 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:42.798412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b734d0-b79a-49ac-a964-4fd6f3e55650 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:42.798412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 407/812] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:42.798412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b734d0-b79a-49ac-a964-4fd6f3e55650 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:42.840511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379130fe-5f70-4422-9a9d-28cd1317919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:42.841196 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379130fe-5f70-4422-9a9d-28cd1317919e None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:42.841478 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379130fe-5f70-4422-9a9d-28cd1317919e None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:42.841754 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379130fe-5f70-4422-9a9d-28cd1317919e None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:42.842772 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379130fe-5f70-4422-9a9d-28cd1317919e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:42.843122 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379130fe-5f70-4422-9a9d-28cd1317919e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:42.844697 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379130fe-5f70-4422-9a9d-28cd1317919e None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:42.864583 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 406/813] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 14:18:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:42.866056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6d43c-76d3-4d80-a96d-a4663e3d308e None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:42.866375 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6d43c-76d3-4d80-a96d-a4663e3d308e None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:42.866652 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6d43c-76d3-4d80-a96d-a4663e3d308e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:42.885749 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-4fc6d43c-76d3-4d80-a96d-a4663e3d308e None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:42.886917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-4fc6d43c-76d3-4d80-a96d-a4663e3d308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:42.918262 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b734d0-b79a-49ac-a964-4fd6f3e55650 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:42.955443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd08dd2-7a84-400c-bca1-8483cf65df62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:42.956375 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd08dd2-7a84-400c-bca1-8483cf65df62 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:42.956660 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd08dd2-7a84-400c-bca1-8483cf65df62 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:42.956937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd08dd2-7a84-400c-bca1-8483cf65df62 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:42.957683 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd08dd2-7a84-400c-bca1-8483cf65df62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:42.957992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd08dd2-7a84-400c-bca1-8483cf65df62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:42.959512 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd08dd2-7a84-400c-bca1-8483cf65df62 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:42.961690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 407/814] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:18:42.962664 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6d43c-76d3-4d80-a96d-a4663e3d308e None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:42.980181 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 408/815] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:42.988606 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd08dd2-7a84-400c-bca1-8483cf65df62 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:43.096221 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6d43c-76d3-4d80-a96d-a4663e3d308e None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:43.107861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd08dd2-7a84-400c-bca1-8483cf65df62 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:43.136428 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27f9cc-becf-4e6f-b31d-5fceee05606f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:43.136995 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27f9cc-becf-4e6f-b31d-5fceee05606f None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:43.137326 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27f9cc-becf-4e6f-b31d-5fceee05606f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:43.137602 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27f9cc-becf-4e6f-b31d-5fceee05606f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:43.146866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0453f-733b-493e-8b70-031322fc5e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:43.147666 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0453f-733b-493e-8b70-031322fc5e40 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:43.147942 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0453f-733b-493e-8b70-031322fc5e40 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:43.148210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0453f-733b-493e-8b70-031322fc5e40 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:43.159601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0453f-733b-493e-8b70-031322fc5e40 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:43.161071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0453f-733b-493e-8b70-031322fc5e40 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-a9c0453f-733b-493e-8b70-031322fc5e40 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:43.181380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:43.182526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:43.183450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:43.183450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:43.183450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:43.183450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:43.183450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:43.183450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:43.183450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:43.183450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:43.183450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 14:18:43.183450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:43.183450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 409/816] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 14:18:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:43.186336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0453f-733b-493e-8b70-031322fc5e40 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:43.222398 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27f9cc-becf-4e6f-b31d-5fceee05606f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:43.224030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27f9cc-becf-4e6f-b31d-5fceee05606f None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:43.300965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0453f-733b-493e-8b70-031322fc5e40 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:43.336706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74134e06-091e-44d2-be6b-0d4d5e985e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:43.337494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74134e06-091e-44d2-be6b-0d4d5e985e4c None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:43.337767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74134e06-091e-44d2-be6b-0d4d5e985e4c None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:43.338042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74134e06-091e-44d2-be6b-0d4d5e985e4c None admin] PATH_INFO: `/v3/services/network` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:43.338749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74134e06-091e-44d2-be6b-0d4d5e985e4c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:43.340113 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74134e06-091e-44d2-be6b-0d4d5e985e4c None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:43.350212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 408/817] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:18:43.351318 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27f9cc-becf-4e6f-b31d-5fceee05606f None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-74134e06-091e-44d2-be6b-0d4d5e985e4c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:43.357191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:43.358221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:43.359072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:43.359072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:43.359072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:43.359072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:43.359072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:43.359072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:43.359072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:43.359072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:43.359072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:43.359072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:43.359072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:43.359072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:43.359072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 14:18:43.359072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:43.359072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 410/818] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:43 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:43.359848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74134e06-091e-44d2-be6b-0d4d5e985e4c None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:43.456038 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27f9cc-becf-4e6f-b31d-5fceee05606f None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:43.463968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74134e06-091e-44d2-be6b-0d4d5e985e4c None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:43.498426 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ff767-037b-430f-ac74-fe5499022c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:43.499108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ff767-037b-430f-ac74-fe5499022c5b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:43.499481 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ff767-037b-430f-ac74-fe5499022c5b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:43.499784 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ff767-037b-430f-ac74-fe5499022c5b None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:43.500079 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b0642-6f72-46f3-9f62-ca854f816138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:43.500610 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ff767-037b-430f-ac74-fe5499022c5b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:43.500922 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ff767-037b-430f-ac74-fe5499022c5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:43.501132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b0642-6f72-46f3-9f62-ca854f816138 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:43.501504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b0642-6f72-46f3-9f62-ca854f816138 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:43.501869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b0642-6f72-46f3-9f62-ca854f816138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:43.502387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ff767-037b-430f-ac74-fe5499022c5b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:43.513003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b0642-6f72-46f3-9f62-ca854f816138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:43.514590 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b0642-6f72-46f3-9f62-ca854f816138 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:43.527085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 409/819] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 17 14:18:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:43.528189 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ff767-037b-430f-ac74-fe5499022c5b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:43.533837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-235b0642-6f72-46f3-9f62-ca854f816138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:43.533837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:43.533837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:43.533837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:43.533837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:43.533837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:43.533837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:43.533837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:43.533837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:43.533837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:43.533837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:43.533837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:43.533837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:43.533837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:43.533837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:43.534897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:43.535999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:43.535999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:43.535999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:43.535999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:43.537675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 411/820] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:43.543058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b0642-6f72-46f3-9f62-ca854f816138 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:43.630120 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ff767-037b-430f-ac74-fe5499022c5b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:43.645244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b0642-6f72-46f3-9f62-ca854f816138 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:43.668191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb13921-f764-4269-8433-e49bc0677420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:43.668872 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb13921-f764-4269-8433-e49bc0677420 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:43.669155 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb13921-f764-4269-8433-e49bc0677420 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:43.669432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb13921-f764-4269-8433-e49bc0677420 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:43.670148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb13921-f764-4269-8433-e49bc0677420 None admin] RBAC: Adding query filter params (name=network) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:43.670489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb13921-f764-4269-8433-e49bc0677420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:43.671870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb13921-f764-4269-8433-e49bc0677420 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:43.678270 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 410/821] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 14:18:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:43.679214 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb13921-f764-4269-8433-e49bc0677420 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:43.685286 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fa036-9c5c-49b8-8f8d-b3a00ff60252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:43.686231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fa036-9c5c-49b8-8f8d-b3a00ff60252 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:43.686617 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fa036-9c5c-49b8-8f8d-b3a00ff60252 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:43.686984 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fa036-9c5c-49b8-8f8d-b3a00ff60252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:43.699293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fa036-9c5c-49b8-8f8d-b3a00ff60252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:43.700894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fa036-9c5c-49b8-8f8d-b3a00ff60252 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:43.718668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-6e5fa036-9c5c-49b8-8f8d-b3a00ff60252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:43.718668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:43.718668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:43.718668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:43.718668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:43.718668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:43.718668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:43.718668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:43.718668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:43.718668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:43.718668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:43.718668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:43.718668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:43.718668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:43.718668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:43.719744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:43.720822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:43.720822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:43.720822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:43.720822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:43.726200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 412/822] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:43.726200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fa036-9c5c-49b8-8f8d-b3a00ff60252 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:43.790168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb13921-f764-4269-8433-e49bc0677420 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:43.823682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fa036-9c5c-49b8-8f8d-b3a00ff60252 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:43.824731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0ec63-7097-4e2b-8293-2d72c8d87712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:43.825399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0ec63-7097-4e2b-8293-2d72c8d87712 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:43.825681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0ec63-7097-4e2b-8293-2d72c8d87712 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:43.825958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0ec63-7097-4e2b-8293-2d72c8d87712 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:43.826709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0ec63-7097-4e2b-8293-2d72c8d87712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:43.827014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0ec63-7097-4e2b-8293-2d72c8d87712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:43.828391 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0ec63-7097-4e2b-8293-2d72c8d87712 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:43.841108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 411/823] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:43.841934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0ec63-7097-4e2b-8293-2d72c8d87712 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:43.865715 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2cd98-c83a-4cce-94a1-3fb97bfb7f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:43.866548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2cd98-c83a-4cce-94a1-3fb97bfb7f9c None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:43.866926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2cd98-c83a-4cce-94a1-3fb97bfb7f9c None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:43.867296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2cd98-c83a-4cce-94a1-3fb97bfb7f9c None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:43.868092 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2cd98-c83a-4cce-94a1-3fb97bfb7f9c None admin] RBAC: Adding query filter params (type=network) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:43.868512 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2cd98-c83a-4cce-94a1-3fb97bfb7f9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:43.870506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2cd98-c83a-4cce-94a1-3fb97bfb7f9c None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:43.875675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 413/824] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 14:18:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:43.876533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2cd98-c83a-4cce-94a1-3fb97bfb7f9c None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:43.946387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0ec63-7097-4e2b-8293-2d72c8d87712 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:43.974870 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2cd98-c83a-4cce-94a1-3fb97bfb7f9c None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:43.981533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ea7a6-6eee-4e7a-8126-07a2b9186d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:43.982241 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ea7a6-6eee-4e7a-8126-07a2b9186d2a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:43.982577 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ea7a6-6eee-4e7a-8126-07a2b9186d2a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:43.982857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ea7a6-6eee-4e7a-8126-07a2b9186d2a None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:43.983579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ea7a6-6eee-4e7a-8126-07a2b9186d2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:43.983886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ea7a6-6eee-4e7a-8126-07a2b9186d2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:43.985260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ea7a6-6eee-4e7a-8126-07a2b9186d2a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:44.001848 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 412/825] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:44.002739 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ea7a6-6eee-4e7a-8126-07a2b9186d2a None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:44.011069 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0134a-2a7d-4ea6-98ec-c879705c8cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:44.012063 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0134a-2a7d-4ea6-98ec-c879705c8cc9 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:44.012440 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0134a-2a7d-4ea6-98ec-c879705c8cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:44.012826 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0134a-2a7d-4ea6-98ec-c879705c8cc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:44.020017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0134a-2a7d-4ea6-98ec-c879705c8cc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:44.021760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0134a-2a7d-4ea6-98ec-c879705c8cc9 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:44.038031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-d5f0134a-2a7d-4ea6-98ec-c879705c8cc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:44.038031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:44.038031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:44.038031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:44.038031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:44.038031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:44.038031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:44.038031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:44.038031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:44.038031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:44.038031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:44.038031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:44.038031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:44.038031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:44.038031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:44.039217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:44.040294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:44.040294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:44.040294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:44.040294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:44.040294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:44.040294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:44.040294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:44.040294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:44.047616 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 414/826] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:44.048766 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0134a-2a7d-4ea6-98ec-c879705c8cc9 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:44.108694 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ea7a6-6eee-4e7a-8126-07a2b9186d2a None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:44.145053 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa5d42-c307-4d32-ab1e-9057f874de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:44.145927 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa5d42-c307-4d32-ab1e-9057f874de41 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:44.146237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa5d42-c307-4d32-ab1e-9057f874de41 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:44.146521 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa5d42-c307-4d32-ab1e-9057f874de41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:44.147845 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa5d42-c307-4d32-ab1e-9057f874de41 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:44.149218 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa5d42-c307-4d32-ab1e-9057f874de41 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:44.149584 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0134a-2a7d-4ea6-98ec-c879705c8cc9 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:44.178259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 413/827] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 14:18:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:18:44.179451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa5d42-c307-4d32-ab1e-9057f874de41 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:44.227125 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1640f8-2622-4612-a8f1-12a55ef342e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:44.227880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1640f8-2622-4612-a8f1-12a55ef342e3 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:44.228170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1640f8-2622-4612-a8f1-12a55ef342e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:44.228449 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1640f8-2622-4612-a8f1-12a55ef342e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:44.245888 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1640f8-2622-4612-a8f1-12a55ef342e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:44.251054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1640f8-2622-4612-a8f1-12a55ef342e3 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:44.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-aa1640f8-2622-4612-a8f1-12a55ef342e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:44.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:44.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:44.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:44.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:44.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:44.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:44.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:44.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:44.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:44.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:44.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:44.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:44.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:44.283960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:44.285053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:44.286118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:44.286118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:44.286118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:44.286118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:44.286118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:44.286118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:44.286118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:44.286118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:44.292529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 415/828] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:44.297383 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1640f8-2622-4612-a8f1-12a55ef342e3 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:44.373644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa5d42-c307-4d32-ab1e-9057f874de41 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:44.417746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f205f0a-920d-4e90-9098-e04487eda8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:44.418448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f205f0a-920d-4e90-9098-e04487eda8cd None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:44.418731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f205f0a-920d-4e90-9098-e04487eda8cd None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:44.419007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f205f0a-920d-4e90-9098-e04487eda8cd None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:44.419801 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f205f0a-920d-4e90-9098-e04487eda8cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:44.421257 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f205f0a-920d-4e90-9098-e04487eda8cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:44.421553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f205f0a-920d-4e90-9098-e04487eda8cd None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:44.437242 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 414/829] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:44.445554 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f205f0a-920d-4e90-9098-e04487eda8cd None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:44.462137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1640f8-2622-4612-a8f1-12a55ef342e3 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:44.507748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df00457-020c-41f3-9cf8-2859037027d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:44.508379 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df00457-020c-41f3-9cf8-2859037027d3 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:44.508694 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df00457-020c-41f3-9cf8-2859037027d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:44.509051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df00457-020c-41f3-9cf8-2859037027d3 None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:44.510432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df00457-020c-41f3-9cf8-2859037027d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:44.510817 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df00457-020c-41f3-9cf8-2859037027d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:44.512858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df00457-020c-41f3-9cf8-2859037027d3 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:44.533484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 416/830] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:44.540320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df00457-020c-41f3-9cf8-2859037027d3 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:44.569843 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f205f0a-920d-4e90-9098-e04487eda8cd None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:44.623216 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afc34a-4a36-47fd-b82f-9723fc51208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:44.624009 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afc34a-4a36-47fd-b82f-9723fc51208f None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:44.624353 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afc34a-4a36-47fd-b82f-9723fc51208f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:44.624694 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afc34a-4a36-47fd-b82f-9723fc51208f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:44.625601 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afc34a-4a36-47fd-b82f-9723fc51208f None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=1f443d2ca1534249bb2c4096300ddffd) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:44.625982 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afc34a-4a36-47fd-b82f-9723fc51208f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:44.627551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afc34a-4a36-47fd-b82f-9723fc51208f None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:44.636777 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 415/831] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:44 2022] GET /identity/v3/role_assignments?user.id=1f443d2ca1534249bb2c4096300ddffd&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:44.658937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df00457-020c-41f3-9cf8-2859037027d3 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:44.698653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4eb6e9-d6e3-48bc-8678-fb456f2159ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:44.700030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4eb6e9-d6e3-48bc-8678-fb456f2159ea None admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:44.700527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4eb6e9-d6e3-48bc-8678-fb456f2159ea None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:44.701001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4eb6e9-d6e3-48bc-8678-fb456f2159ea None admin] PATH_INFO: `/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/ba800a3364ee46f395d040f7eb8f775f/roles/4aa22f352696432bbf8fcd9d74ba0dc7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:44.718839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4eb6e9-d6e3-48bc-8678-fb456f2159ea None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac7d1119033458393ad6f78fc0df7a3, user_id=ba800a3364ee46f395d040f7eb8f775f, role_id=4aa22f352696432bbf8fcd9d74ba0dc7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:44.720697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4eb6e9-d6e3-48bc-8678-fb456f2159ea None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:44.740588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 417/832] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:18:44 2022] PUT /identity/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/ba800a3364ee46f395d040f7eb8f775f/roles/4aa22f352696432bbf8fcd9d74ba0dc7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:18:44.785750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f692a2-894f-41e7-bd7e-655e47e010b3 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:44.786136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f692a2-894f-41e7-bd7e-655e47e010b3 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:44.786457 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f692a2-894f-41e7-bd7e-655e47e010b3 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:44.788068 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 416/833] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:44.794922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975f326-1534-4738-8487-bfa94bc1e7fb None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:44.795300 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975f326-1534-4738-8487-bfa94bc1e7fb None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:44.795476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975f326-1534-4738-8487-bfa94bc1e7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:44.818512 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-2975f326-1534-4738-8487-bfa94bc1e7fb None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:44.819841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2975f326-1534-4738-8487-bfa94bc1e7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:44.899586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 418/834] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:18:44.923866 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f692a2-894f-41e7-bd7e-655e47e010b3 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:45.039545 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f692a2-894f-41e7-bd7e-655e47e010b3 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:45.079684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b4e59-f6b7-4754-8510-0df56a320d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:45.081120 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b4e59-f6b7-4754-8510-0df56a320d2a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:45.081598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b4e59-f6b7-4754-8510-0df56a320d2a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:45.082092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b4e59-f6b7-4754-8510-0df56a320d2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:45.094024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b4e59-f6b7-4754-8510-0df56a320d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-c41b4e59-f6b7-4754-8510-0df56a320d2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:45.102007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:45.103103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:45.104359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:45.104359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:45.104359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:45.104359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:45.104359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:45.104359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:45.104359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:45.104359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:45.104359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:45.104359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:45.104359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:18:45.104359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:45.106725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 417/835] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:18:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:45.112623 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975f326-1534-4738-8487-bfa94bc1e7fb None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:45.217514 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975f326-1534-4738-8487-bfa94bc1e7fb None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:45.237735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102b1ed-3068-4041-9353-2224c71220f3 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:45.238393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102b1ed-3068-4041-9353-2224c71220f3 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:45.238877 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102b1ed-3068-4041-9353-2224c71220f3 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:45.240737 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 418/836] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:45.246873 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c587dda-344c-43d9-abb2-615e35401cf3 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:45.247442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c587dda-344c-43d9-abb2-615e35401cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:45.247942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c587dda-344c-43d9-abb2-615e35401cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:45.259159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30f826-a689-4060-bad7-51f64f6d7310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:45.259838 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30f826-a689-4060-bad7-51f64f6d7310 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:45.260116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30f826-a689-4060-bad7-51f64f6d7310 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:45.260445 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30f826-a689-4060-bad7-51f64f6d7310 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:45.261199 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30f826-a689-4060-bad7-51f64f6d7310 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:45.261503 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30f826-a689-4060-bad7-51f64f6d7310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:45.262911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30f826-a689-4060-bad7-51f64f6d7310 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:45.271811 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 419/837] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:18:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:45.273247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7c587dda-344c-43d9-abb2-615e35401cf3 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:45.274650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7c587dda-344c-43d9-abb2-615e35401cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:45.277559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30f826-a689-4060-bad7-51f64f6d7310 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:45.370197 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 419/838] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:18:45.386804 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c587dda-344c-43d9-abb2-615e35401cf3 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:45.401792 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30f826-a689-4060-bad7-51f64f6d7310 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:45.435974 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d9798-7f0c-47e1-ae64-4ce41dbc3548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:45.436770 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d9798-7f0c-47e1-ae64-4ce41dbc3548 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:45.437084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d9798-7f0c-47e1-ae64-4ce41dbc3548 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:45.437306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d9798-7f0c-47e1-ae64-4ce41dbc3548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:45.448720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d9798-7f0c-47e1-ae64-4ce41dbc3548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:45.450205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d9798-7f0c-47e1-ae64-4ce41dbc3548 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:45.467844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-1e1d9798-7f0c-47e1-ae64-4ce41dbc3548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:45.467844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:45.467844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:45.467844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:45.467844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:45.467844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:45.467844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:45.467844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:45.467844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:45.467844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:45.467844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:45.467844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:45.467844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:45.467844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:45.467844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:45.468791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:45.469678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:45.469678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:45.469678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:45.469678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:45.469678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 420/839] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:45.474564 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d9798-7f0c-47e1-ae64-4ce41dbc3548 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:45.497829 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c587dda-344c-43d9-abb2-615e35401cf3 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:45.541267 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab297ea-9470-429e-bab9-845c353ee554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:45.542834 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab297ea-9470-429e-bab9-845c353ee554 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:45.543326 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab297ea-9470-429e-bab9-845c353ee554 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:45.543822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab297ea-9470-429e-bab9-845c353ee554 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:45.544737 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab297ea-9470-429e-bab9-845c353ee554 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:45.546580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab297ea-9470-429e-bab9-845c353ee554 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-dab297ea-9470-429e-bab9-845c353ee554 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:45.559321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:45.560329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:45.561140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:45.561140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:45.561140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:45.561140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:45.561140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:45.561140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:45.561140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:45.561140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:45.561140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:45.561140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:45.561140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:45.561140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:45.561140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 14:18:45.561140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:45.569834 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 420/840] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:18:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:45.571017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab297ea-9470-429e-bab9-845c353ee554 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:45.583732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d9798-7f0c-47e1-ae64-4ce41dbc3548 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:45.618306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70138916-7347-4b2a-93a3-37a0e03be2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:45.618975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70138916-7347-4b2a-93a3-37a0e03be2f4 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:45.619258 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70138916-7347-4b2a-93a3-37a0e03be2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:45.619534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70138916-7347-4b2a-93a3-37a0e03be2f4 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:45.620838 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70138916-7347-4b2a-93a3-37a0e03be2f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:45.621094 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70138916-7347-4b2a-93a3-37a0e03be2f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:45.622549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70138916-7347-4b2a-93a3-37a0e03be2f4 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:45.638298 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 421/841] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:45.643927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70138916-7347-4b2a-93a3-37a0e03be2f4 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:45.678298 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab297ea-9470-429e-bab9-845c353ee554 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:45.719411 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0759c83-82ae-4736-8d21-ea58fbc3bfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:45.720502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0759c83-82ae-4736-8d21-ea58fbc3bfc8 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:45.720886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0759c83-82ae-4736-8d21-ea58fbc3bfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:45.721169 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0759c83-82ae-4736-8d21-ea58fbc3bfc8 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:45.721879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0759c83-82ae-4736-8d21-ea58fbc3bfc8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:45.722212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0759c83-82ae-4736-8d21-ea58fbc3bfc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:45.723650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0759c83-82ae-4736-8d21-ea58fbc3bfc8 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:45.735341 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 421/842] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:18:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:45.736353 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0759c83-82ae-4736-8d21-ea58fbc3bfc8 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:45.766355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70138916-7347-4b2a-93a3-37a0e03be2f4 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:45.799680 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1e07f-894e-43e3-8771-c7f5c5b7b36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:45.800439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1e07f-894e-43e3-8771-c7f5c5b7b36b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:45.800747 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1e07f-894e-43e3-8771-c7f5c5b7b36b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:45.801038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1e07f-894e-43e3-8771-c7f5c5b7b36b None admin] PATH_INFO: `/v3/users/swift` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:45.808597 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1e07f-894e-43e3-8771-c7f5c5b7b36b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:45.810054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1e07f-894e-43e3-8771-c7f5c5b7b36b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-8eb1e07f-894e-43e3-8771-c7f5c5b7b36b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:45.824516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:45.825637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:45.826644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:45.826644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:45.826644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:45.826644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:45.826644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:45.826644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:45.826644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:45.826644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:45.826644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 14:18:45.826644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:45.830536 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 422/843] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:18:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:45.831692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1e07f-894e-43e3-8771-c7f5c5b7b36b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:45.844510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0759c83-82ae-4736-8d21-ea58fbc3bfc8 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:45.879596 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8121d9-4191-444d-babe-7817a10d0baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:45.880505 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8121d9-4191-444d-babe-7817a10d0baf None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:45.880941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8121d9-4191-444d-babe-7817a10d0baf None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:45.881363 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8121d9-4191-444d-babe-7817a10d0baf None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:45.882246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8121d9-4191-444d-babe-7817a10d0baf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:45.882761 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8121d9-4191-444d-babe-7817a10d0baf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:45.884325 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8121d9-4191-444d-babe-7817a10d0baf None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:45.894489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 422/844] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:18:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:45.939009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1e07f-894e-43e3-8771-c7f5c5b7b36b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:45.978148 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b932b-03db-45b2-9a2d-eada69d1fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:45.978874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b932b-03db-45b2-9a2d-eada69d1fa0b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:45.979188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b932b-03db-45b2-9a2d-eada69d1fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:45.979467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b932b-03db-45b2-9a2d-eada69d1fa0b None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:45.980336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b932b-03db-45b2-9a2d-eada69d1fa0b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:45.980645 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b932b-03db-45b2-9a2d-eada69d1fa0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:45.982122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b932b-03db-45b2-9a2d-eada69d1fa0b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:46.005706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 423/845] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 17 14:18:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:46.012204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8121d9-4191-444d-babe-7817a10d0baf None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:46.120910 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8121d9-4191-444d-babe-7817a10d0baf None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:46.156618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c67be-e10f-40b9-ac15-527349b677ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:46.157203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c67be-e10f-40b9-ac15-527349b677ff None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:46.157483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c67be-e10f-40b9-ac15-527349b677ff None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:46.157755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c67be-e10f-40b9-ac15-527349b677ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:46.225752 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c67be-e10f-40b9-ac15-527349b677ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:46.227469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c67be-e10f-40b9-ac15-527349b677ff None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:46.345821 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 423/846] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:18:46.352279 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b932b-03db-45b2-9a2d-eada69d1fa0b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:46.463147 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b932b-03db-45b2-9a2d-eada69d1fa0b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:46.498087 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43665b-c771-4cd8-9a99-482e6f8db967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:46.499191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43665b-c771-4cd8-9a99-482e6f8db967 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:46.499623 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43665b-c771-4cd8-9a99-482e6f8db967 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:46.500041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43665b-c771-4cd8-9a99-482e6f8db967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:46.511522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43665b-c771-4cd8-9a99-482e6f8db967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:46.514673 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43665b-c771-4cd8-9a99-482e6f8db967 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:46.534220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-7a43665b-c771-4cd8-9a99-482e6f8db967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:46.534220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:46.534220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:46.534220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:46.534220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:46.534220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:46.534220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:46.534220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:46.534220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:46.534220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:46.534220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:46.534220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:46.534220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:46.534220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:46.534220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:46.535158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:46.536053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:46.536053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:46.536053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:46.536053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:46.536053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 424/847] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:46.543731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c67be-e10f-40b9-ac15-527349b677ff None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:46.645336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c67be-e10f-40b9-ac15-527349b677ff None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:46.693968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7406640-24b0-4ea9-8e89-8b0ef67e897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:46.695540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406640-24b0-4ea9-8e89-8b0ef67e897b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:46.696034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406640-24b0-4ea9-8e89-8b0ef67e897b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:46.696533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406640-24b0-4ea9-8e89-8b0ef67e897b None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:46.697509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7406640-24b0-4ea9-8e89-8b0ef67e897b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:46.698263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7406640-24b0-4ea9-8e89-8b0ef67e897b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:46.699938 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7406640-24b0-4ea9-8e89-8b0ef67e897b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:46.718325 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 424/848] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:46.719996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43665b-c771-4cd8-9a99-482e6f8db967 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:46.824323 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43665b-c771-4cd8-9a99-482e6f8db967 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:46.859472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec3590-f582-4a51-a29e-62e42e81d611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:46.860292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec3590-f582-4a51-a29e-62e42e81d611 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:46.860573 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec3590-f582-4a51-a29e-62e42e81d611 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:46.860847 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec3590-f582-4a51-a29e-62e42e81d611 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:46.868763 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec3590-f582-4a51-a29e-62e42e81d611 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:46.871103 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec3590-f582-4a51-a29e-62e42e81d611 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:46.886464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-74ec3590-f582-4a51-a29e-62e42e81d611 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:46.886464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:46.886464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:46.886464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:46.886464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:46.886464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:46.886464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:46.886464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:46.886464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:46.886464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:46.886464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:46.886464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:46.886464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:46.886464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:46.886464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:46.887437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:46.888332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:46.888332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:46.888332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:46.888332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:46.888332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:46.888332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:46.888332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:46.888332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:46.888332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 425/849] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:46.895175 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7406640-24b0-4ea9-8e89-8b0ef67e897b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:47.000766 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7406640-24b0-4ea9-8e89-8b0ef67e897b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:47.035193 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789df96-ce34-485c-bb5d-aae6996a349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:47.036202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789df96-ce34-485c-bb5d-aae6996a349f None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:47.036685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789df96-ce34-485c-bb5d-aae6996a349f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:47.037160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789df96-ce34-485c-bb5d-aae6996a349f None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:47.038142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789df96-ce34-485c-bb5d-aae6996a349f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:47.038700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789df96-ce34-485c-bb5d-aae6996a349f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:47.040348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789df96-ce34-485c-bb5d-aae6996a349f None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:47.053829 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 425/850] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:47.058238 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e53d-784d-43ff-8036-fae28aed9248 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:47.058238 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e53d-784d-43ff-8036-fae28aed9248 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:47.058238 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e53d-784d-43ff-8036-fae28aed9248 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:47.059922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 426/851] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:47.061050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789df96-ce34-485c-bb5d-aae6996a349f None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:47.063468 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2af765-8556-4127-9c57-8b2e2f4849da None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:47.063756 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2af765-8556-4127-9c57-8b2e2f4849da None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:47.064038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2af765-8556-4127-9c57-8b2e2f4849da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:47.080985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-9b2af765-8556-4127-9c57-8b2e2f4849da None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:47.081993 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-9b2af765-8556-4127-9c57-8b2e2f4849da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:47.149229 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 427/852] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:18:47.150616 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc62ec-43ab-4a88-88ea-6b3a45e60053 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:47.151081 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc62ec-43ab-4a88-88ea-6b3a45e60053 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:47.151214 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc62ec-43ab-4a88-88ea-6b3a45e60053 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:47.157198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 428/853] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:47.158854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d39b2f-ac9f-49cf-95ec-cdda03d6dccb None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:47.159150 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d39b2f-ac9f-49cf-95ec-cdda03d6dccb None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:47.159434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d39b2f-ac9f-49cf-95ec-cdda03d6dccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:47.167633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789df96-ce34-485c-bb5d-aae6996a349f None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:47.177608 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-61d39b2f-ac9f-49cf-95ec-cdda03d6dccb None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:47.178809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-61d39b2f-ac9f-49cf-95ec-cdda03d6dccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:47.208427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afc7a6-a2eb-4808-a382-6e3b33cd48e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:47.209086 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afc7a6-a2eb-4808-a382-6e3b33cd48e3 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:47.209372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afc7a6-a2eb-4808-a382-6e3b33cd48e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:47.209648 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afc7a6-a2eb-4808-a382-6e3b33cd48e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:47.210514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afc7a6-a2eb-4808-a382-6e3b33cd48e3 None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=055264c31c9e4d3dbf234a362ee82698) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:47.210832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afc7a6-a2eb-4808-a382-6e3b33cd48e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:47.212332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afc7a6-a2eb-4808-a382-6e3b33cd48e3 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:47.226211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 426/854] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:47 2022] GET /identity/v3/role_assignments?user.id=055264c31c9e4d3dbf234a362ee82698&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:47.226211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afc7a6-a2eb-4808-a382-6e3b33cd48e3 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:47.258209 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 429/855] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:18:47.286256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d39b2f-ac9f-49cf-95ec-cdda03d6dccb None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:47.378535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afc7a6-a2eb-4808-a382-6e3b33cd48e3 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:47.393647 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d39b2f-ac9f-49cf-95ec-cdda03d6dccb None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:47.428509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e1d0e-e22b-45b0-be96-eea3fb7ff6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:47.429997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e1d0e-e22b-45b0-be96-eea3fb7ff6ec None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:47.429997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e1d0e-e22b-45b0-be96-eea3fb7ff6ec None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:47.430421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e1d0e-e22b-45b0-be96-eea3fb7ff6ec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:47.432892 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e1d0e-e22b-45b0-be96-eea3fb7ff6ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:47.433282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e1d0e-e22b-45b0-be96-eea3fb7ff6ec None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:47.438748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af3cd1-671a-489e-bac5-f4cefc37dfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:47.439555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af3cd1-671a-489e-bac5-f4cefc37dfc8 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:47.439843 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af3cd1-671a-489e-bac5-f4cefc37dfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:47.440123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af3cd1-671a-489e-bac5-f4cefc37dfc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-ae6e1d0e-e22b-45b0-be96-eea3fb7ff6ec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:47.449908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:47.450898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:47.451740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:47.451740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:47.451740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:47.451740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:47.451740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:47.451740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:47.451740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:47.451740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:47.451740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:47.451740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:47.451740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:47.451740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:47.451740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:47.451740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 14:18:47.451740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:47.452546 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af3cd1-671a-489e-bac5-f4cefc37dfc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:47.457040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 427/856] 10.222.0.48 () {56 vars in 1132 bytes} [Tue May 17 14:18:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:47.458211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e1d0e-e22b-45b0-be96-eea3fb7ff6ec None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-06af3cd1-671a-489e-bac5-f4cefc37dfc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:47.460901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:47.464841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:47.469120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:47.469120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:47.469120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:47.469120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:47.469120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:47.469120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:47.469120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:47.469120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:47.469120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:47.469120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:47.469120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:18:47.469120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:47.469120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 430/857] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:18:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:47.469120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af3cd1-671a-489e-bac5-f4cefc37dfc8 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:47.579355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e1d0e-e22b-45b0-be96-eea3fb7ff6ec None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:47.585110 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af3cd1-671a-489e-bac5-f4cefc37dfc8 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:47.614642 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e839ff-3f57-46cd-9814-bd3604fd6051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:47.615292 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e839ff-3f57-46cd-9814-bd3604fd6051 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:47.615581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e839ff-3f57-46cd-9814-bd3604fd6051 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:47.615865 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e839ff-3f57-46cd-9814-bd3604fd6051 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:47.616569 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e839ff-3f57-46cd-9814-bd3604fd6051 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:47.616880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e839ff-3f57-46cd-9814-bd3604fd6051 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:47.618289 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e839ff-3f57-46cd-9814-bd3604fd6051 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:47.621925 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcc3ec-eaf7-48d4-8987-536fc4499d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:47.622895 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcc3ec-eaf7-48d4-8987-536fc4499d7d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:47.623404 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcc3ec-eaf7-48d4-8987-536fc4499d7d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:47.623688 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 428/858] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 14:18:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:47.624052 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcc3ec-eaf7-48d4-8987-536fc4499d7d None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:47.624799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcc3ec-eaf7-48d4-8987-536fc4499d7d None admin] RBAC: Adding query filter params (name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:47.625120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcc3ec-eaf7-48d4-8987-536fc4499d7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:47.630300 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcc3ec-eaf7-48d4-8987-536fc4499d7d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:47.630469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e839ff-3f57-46cd-9814-bd3604fd6051 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:47.635808 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 431/859] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:18:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:47.641264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcc3ec-eaf7-48d4-8987-536fc4499d7d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:47.749422 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e839ff-3f57-46cd-9814-bd3604fd6051 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:47.755184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcc3ec-eaf7-48d4-8987-536fc4499d7d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:47.790354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145931c-2822-4f4b-8948-556e45222aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:47.790763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70c593-b649-4146-85dc-bb84d6a0b6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:47.792036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70c593-b649-4146-85dc-bb84d6a0b6bd None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:47.792436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70c593-b649-4146-85dc-bb84d6a0b6bd None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:47.792723 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145931c-2822-4f4b-8948-556e45222aba None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:47.792842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70c593-b649-4146-85dc-bb84d6a0b6bd None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:47.793377 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145931c-2822-4f4b-8948-556e45222aba None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:47.793550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70c593-b649-4146-85dc-bb84d6a0b6bd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:47.793826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70c593-b649-4146-85dc-bb84d6a0b6bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:47.794272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145931c-2822-4f4b-8948-556e45222aba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:47.795244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70c593-b649-4146-85dc-bb84d6a0b6bd None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:47.802225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 429/860] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 14:18:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:47.817186 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145931c-2822-4f4b-8948-556e45222aba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:47.818809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145931c-2822-4f4b-8948-556e45222aba None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:47.839114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-1145931c-2822-4f4b-8948-556e45222aba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:47.839114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:47.839114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:47.839114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:47.839114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:47.839114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:47.839114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:47.839114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:47.839114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:47.839114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:47.839114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:47.839114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:47.839114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:47.839114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:47.839114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:47.840093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:47.840998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:47.840998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:47.840998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:47.840998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:47.840998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 432/861] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:47.847581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70c593-b649-4146-85dc-bb84d6a0b6bd None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:47.961216 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70c593-b649-4146-85dc-bb84d6a0b6bd None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:47.998711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4734e-0657-4108-9c84-81e9fc8ff688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:47.999789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4734e-0657-4108-9c84-81e9fc8ff688 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:48.000280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4734e-0657-4108-9c84-81e9fc8ff688 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:48.000771 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4734e-0657-4108-9c84-81e9fc8ff688 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:48.001709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4734e-0657-4108-9c84-81e9fc8ff688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:48.002250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4734e-0657-4108-9c84-81e9fc8ff688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:48.003840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4734e-0657-4108-9c84-81e9fc8ff688 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:48.018653 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 430/862] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:48.024522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145931c-2822-4f4b-8948-556e45222aba None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:48.142028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145931c-2822-4f4b-8948-556e45222aba None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:48.179924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd0efa-6e33-4be2-b117-1483f9af4818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:48.180739 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd0efa-6e33-4be2-b117-1483f9af4818 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:48.181020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd0efa-6e33-4be2-b117-1483f9af4818 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:48.181295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd0efa-6e33-4be2-b117-1483f9af4818 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:48.190090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd0efa-6e33-4be2-b117-1483f9af4818 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:48.191562 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd0efa-6e33-4be2-b117-1483f9af4818 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-55bd0efa-6e33-4be2-b117-1483f9af4818 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:48.207816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:48.208800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:48.209736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:48.209736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:48.209736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:48.209736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:48.209736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:48.209736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:48.209736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:48.209736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:48.209736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 14:18:48.209736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:48.209736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 433/863] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 14:18:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:48.217082 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4734e-0657-4108-9c84-81e9fc8ff688 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:48.310499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1ce2d-3aba-40ef-98fe-46fe0f9ca75e None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:48.310844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1ce2d-3aba-40ef-98fe-46fe0f9ca75e None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:48.311065 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1ce2d-3aba-40ef-98fe-46fe0f9ca75e None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:48.312687 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 434/864] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:48.317831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2163552-e635-4ee3-b5de-502a32a682cd None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:48.318117 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2163552-e635-4ee3-b5de-502a32a682cd None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:48.318423 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2163552-e635-4ee3-b5de-502a32a682cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:48.331798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4734e-0657-4108-9c84-81e9fc8ff688 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:48.336447 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c2163552-e635-4ee3-b5de-502a32a682cd None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:48.337627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c2163552-e635-4ee3-b5de-502a32a682cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:48.369903 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86e828-58f3-4676-ac7c-612a7939caf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:48.370984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e828-58f3-4676-ac7c-612a7939caf4 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:48.371743 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e828-58f3-4676-ac7c-612a7939caf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:48.372444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e828-58f3-4676-ac7c-612a7939caf4 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:48.373463 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86e828-58f3-4676-ac7c-612a7939caf4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:48.373780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86e828-58f3-4676-ac7c-612a7939caf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:48.375282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86e828-58f3-4676-ac7c-612a7939caf4 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:48.402491 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 431/865] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 17 14:18:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:48.406144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86e828-58f3-4676-ac7c-612a7939caf4 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:48.426206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 435/866] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:18:48.442345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2163552-e635-4ee3-b5de-502a32a682cd None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:48.532430 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86e828-58f3-4676-ac7c-612a7939caf4 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:48.554015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2163552-e635-4ee3-b5de-502a32a682cd None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:48.569173 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3c6c4-7f66-41d5-a5f2-0dd828fe88a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:48.570236 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3c6c4-7f66-41d5-a5f2-0dd828fe88a1 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:48.570721 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3c6c4-7f66-41d5-a5f2-0dd828fe88a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:48.571195 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3c6c4-7f66-41d5-a5f2-0dd828fe88a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:48.590018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f21001-3c75-482c-b120-3845ee5c7976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:48.590830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f21001-3c75-482c-b120-3845ee5c7976 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:48.591038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f21001-3c75-482c-b120-3845ee5c7976 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:48.591357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f21001-3c75-482c-b120-3845ee5c7976 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:48.592102 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f21001-3c75-482c-b120-3845ee5c7976 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:48.593476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f21001-3c75-482c-b120-3845ee5c7976 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:48.614229 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 436/867] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 14:18:48 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:18:48.661933 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3c6c4-7f66-41d5-a5f2-0dd828fe88a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:48.663451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3c6c4-7f66-41d5-a5f2-0dd828fe88a1 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:48.784513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 432/868] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:18:48.786474 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f21001-3c75-482c-b120-3845ee5c7976 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:48.902290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f21001-3c75-482c-b120-3845ee5c7976 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:48.936683 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b60ac4-f3d5-4099-8136-88df2df4dfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:48.937450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60ac4-f3d5-4099-8136-88df2df4dfb5 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:48.937735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60ac4-f3d5-4099-8136-88df2df4dfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:48.938006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60ac4-f3d5-4099-8136-88df2df4dfb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:48.949205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b60ac4-f3d5-4099-8136-88df2df4dfb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:48.950694 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b60ac4-f3d5-4099-8136-88df2df4dfb5 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:48.968898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-d2b60ac4-f3d5-4099-8136-88df2df4dfb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:48.968898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:48.968898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:48.968898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:48.968898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:48.968898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:48.968898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:48.968898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:48.968898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:48.968898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:48.968898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:48.968898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:48.968898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:48.968898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:48.968898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:48.969919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:48.970906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:48.970906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:48.970906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:48.970906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:48.974316 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 437/869] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:48.976129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3c6c4-7f66-41d5-a5f2-0dd828fe88a1 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:49.084598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3c6c4-7f66-41d5-a5f2-0dd828fe88a1 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:49.121841 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f356314-16fb-4792-b3da-77fa8ae82fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:49.122546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f356314-16fb-4792-b3da-77fa8ae82fd2 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:49.122830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f356314-16fb-4792-b3da-77fa8ae82fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:49.123109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f356314-16fb-4792-b3da-77fa8ae82fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:49.123895 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f356314-16fb-4792-b3da-77fa8ae82fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:49.124205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f356314-16fb-4792-b3da-77fa8ae82fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:49.125573 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f356314-16fb-4792-b3da-77fa8ae82fd2 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:49.142509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 433/870] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:49.143853 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b60ac4-f3d5-4099-8136-88df2df4dfb5 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:49.257067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b60ac4-f3d5-4099-8136-88df2df4dfb5 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:49.292037 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc3f37-8f51-4933-98bd-94728df1f3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:49.292861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3f37-8f51-4933-98bd-94728df1f3ad None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:49.293104 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3f37-8f51-4933-98bd-94728df1f3ad None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:49.293359 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3f37-8f51-4933-98bd-94728df1f3ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:49.300214 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc3f37-8f51-4933-98bd-94728df1f3ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:49.301663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc3f37-8f51-4933-98bd-94728df1f3ad None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:49.316154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-04bc3f37-8f51-4933-98bd-94728df1f3ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:49.316154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:49.316154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:49.316154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:49.316154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:49.316154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:49.316154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:49.316154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:49.316154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:49.316154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:49.316154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:49.316154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:49.316154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:49.316154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:49.316154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:49.317055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:49.318106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:49.318106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:49.318106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:49.318106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:49.318106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:49.318106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:49.318106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:49.318106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:49.318106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 438/871] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:49.326343 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f356314-16fb-4792-b3da-77fa8ae82fd2 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:49.437192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f356314-16fb-4792-b3da-77fa8ae82fd2 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:49.473487 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09aa289-61d2-4860-86fa-58fb83e37daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:49.474543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aa289-61d2-4860-86fa-58fb83e37daa None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:49.475052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aa289-61d2-4860-86fa-58fb83e37daa None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:49.475536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aa289-61d2-4860-86fa-58fb83e37daa None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:49.476522 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09aa289-61d2-4860-86fa-58fb83e37daa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:49.477045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09aa289-61d2-4860-86fa-58fb83e37daa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:49.478749 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09aa289-61d2-4860-86fa-58fb83e37daa None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:49.498170 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 434/872] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:49.499833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc3f37-8f51-4933-98bd-94728df1f3ad None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:49.582624 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc223ca0-7978-46b8-aef1-208d71a39d90 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:49.583265 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc223ca0-7978-46b8-aef1-208d71a39d90 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:49.583764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc223ca0-7978-46b8-aef1-208d71a39d90 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:49.590295 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 435/873] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:18:49.592480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bd7f0-ca1b-4de9-b0fb-2a605bb63cbb None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:49.592988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bd7f0-ca1b-4de9-b0fb-2a605bb63cbb None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:49.593471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bd7f0-ca1b-4de9-b0fb-2a605bb63cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:49.607446 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc3f37-8f51-4933-98bd-94728df1f3ad None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:49.615099 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-eb5bd7f0-ca1b-4de9-b0fb-2a605bb63cbb None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:49.616907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-eb5bd7f0-ca1b-4de9-b0fb-2a605bb63cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:49.652580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ebffd-13fc-4efc-acc7-d6d809d97cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:49.653616 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ebffd-13fc-4efc-acc7-d6d809d97cd3 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:49.654279 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ebffd-13fc-4efc-acc7-d6d809d97cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:49.655621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ebffd-13fc-4efc-acc7-d6d809d97cd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:49.656676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ebffd-13fc-4efc-acc7-d6d809d97cd3 None admin] RBAC: Adding query filter params (role.id=4aa22f352696432bbf8fcd9d74ba0dc7, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=ba800a3364ee46f395d040f7eb8f775f) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:49.657200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ebffd-13fc-4efc-acc7-d6d809d97cd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:49.658883 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ebffd-13fc-4efc-acc7-d6d809d97cd3 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:49.674203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 439/874] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:49 2022] GET /identity/v3/role_assignments?user.id=ba800a3364ee46f395d040f7eb8f775f&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=4aa22f352696432bbf8fcd9d74ba0dc7 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:49.690859 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 436/875] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:18:49.714445 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ebffd-13fc-4efc-acc7-d6d809d97cd3 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:49.820739 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ebffd-13fc-4efc-acc7-d6d809d97cd3 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:49.863535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafbb2f-6b5e-469d-840e-41d088a71ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:49.864762 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafbb2f-6b5e-469d-840e-41d088a71ae3 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:49.865312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafbb2f-6b5e-469d-840e-41d088a71ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:49.865903 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafbb2f-6b5e-469d-840e-41d088a71ae3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:49.866853 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafbb2f-6b5e-469d-840e-41d088a71ae3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:49.868550 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafbb2f-6b5e-469d-840e-41d088a71ae3 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-4bafbb2f-6b5e-469d-840e-41d088a71ae3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:49.883225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:49.884320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:49.885926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:49.885926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:49.885926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:49.885926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:49.885926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:49.885926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:49.885926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:49.885926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:49.885926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:49.885926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:49.885926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:49.885926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:49.885926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 14:18:49.885926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:49.894111 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 440/876] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 14:18:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:49.895708 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bd7f0-ca1b-4de9-b0fb-2a605bb63cbb None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:50.015293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bd7f0-ca1b-4de9-b0fb-2a605bb63cbb None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:50.050816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f903a10-2bc4-4820-bc83-7d2ea04f6e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:50.052022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f903a10-2bc4-4820-bc83-7d2ea04f6e26 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:50.052510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f903a10-2bc4-4820-bc83-7d2ea04f6e26 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:50.052989 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f903a10-2bc4-4820-bc83-7d2ea04f6e26 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:50.053930 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f903a10-2bc4-4820-bc83-7d2ea04f6e26 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:50.054475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f903a10-2bc4-4820-bc83-7d2ea04f6e26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:50.056101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f903a10-2bc4-4820-bc83-7d2ea04f6e26 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:50.061580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 437/877] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 14:18:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:50.067137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafbb2f-6b5e-469d-840e-41d088a71ae3 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:50.167731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ca723-6768-4b40-9a27-cba53ba35b2d None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:50.168399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ca723-6768-4b40-9a27-cba53ba35b2d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:50.168881 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ca723-6768-4b40-9a27-cba53ba35b2d None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:50.170716 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 438/878] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:50.174279 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafbb2f-6b5e-469d-840e-41d088a71ae3 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:50.176113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b440e-b5f2-4cc4-ace4-9fbd5f910c13 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:50.176798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b440e-b5f2-4cc4-ace4-9fbd5f910c13 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:50.177281 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b440e-b5f2-4cc4-ace4-9fbd5f910c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:50.194117 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-8a9b440e-b5f2-4cc4-ace4-9fbd5f910c13 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:50.195636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-8a9b440e-b5f2-4cc4-ace4-9fbd5f910c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:50.218900 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83894785-a162-4afb-aed4-32be9b3f7300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:50.219577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83894785-a162-4afb-aed4-32be9b3f7300 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:50.219856 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83894785-a162-4afb-aed4-32be9b3f7300 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:50.220127 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83894785-a162-4afb-aed4-32be9b3f7300 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:50.220989 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83894785-a162-4afb-aed4-32be9b3f7300 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:50.221301 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83894785-a162-4afb-aed4-32be9b3f7300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:50.223761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83894785-a162-4afb-aed4-32be9b3f7300 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:50.230835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 441/879] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 14:18:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:50.283979 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 439/880] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:50 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:18:50.307979 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83894785-a162-4afb-aed4-32be9b3f7300 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:50.418027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83894785-a162-4afb-aed4-32be9b3f7300 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:50.453644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3701b59-43a0-4e65-a9b1-5f80a70d521e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:50.454341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3701b59-43a0-4e65-a9b1-5f80a70d521e None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:50.454620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3701b59-43a0-4e65-a9b1-5f80a70d521e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:50.454894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3701b59-43a0-4e65-a9b1-5f80a70d521e None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:50.455879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3701b59-43a0-4e65-a9b1-5f80a70d521e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:50.457241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3701b59-43a0-4e65-a9b1-5f80a70d521e None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:50.472520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 442/881] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 14:18:50 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:18:51.038864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b493fa-1a17-4750-92f1-3a99c634f369 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:51.039394 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b493fa-1a17-4750-92f1-3a99c634f369 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:51.039698 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b493fa-1a17-4750-92f1-3a99c634f369 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:51.041536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 440/882] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:51.047289 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021347a6-b485-4a6b-ad8b-4ebe8d9bd4bc None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:51.047760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021347a6-b485-4a6b-ad8b-4ebe8d9bd4bc None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:51.048042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021347a6-b485-4a6b-ad8b-4ebe8d9bd4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:51.065775 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-021347a6-b485-4a6b-ad8b-4ebe8d9bd4bc None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:51.067100 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-021347a6-b485-4a6b-ad8b-4ebe8d9bd4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:51.146365 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 443/883] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:18:51.173547 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b493fa-1a17-4750-92f1-3a99c634f369 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:51.296103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b493fa-1a17-4750-92f1-3a99c634f369 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:51.329881 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1e1fe-f62e-4fe8-aa56-4c5f54010e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:51.330972 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1e1fe-f62e-4fe8-aa56-4c5f54010e24 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:51.331250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1e1fe-f62e-4fe8-aa56-4c5f54010e24 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:51.331520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1e1fe-f62e-4fe8-aa56-4c5f54010e24 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:51.332170 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1e1fe-f62e-4fe8-aa56-4c5f54010e24 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:51.333801 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1e1fe-f62e-4fe8-aa56-4c5f54010e24 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-d9e1e1fe-f62e-4fe8-aa56-4c5f54010e24 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:51.346207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:51.347223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:51.348058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:51.348058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:51.348058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:51.348058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:51.348058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:51.348058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:51.348058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:51.348058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:51.348058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:51.348058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:51.348058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:51.348058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:51.348058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 14:18:51.348058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:51.348058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 441/884] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:18:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:51.353588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021347a6-b485-4a6b-ad8b-4ebe8d9bd4bc None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:51.454326 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021347a6-b485-4a6b-ad8b-4ebe8d9bd4bc None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:51.489132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f075dc-99b2-4153-9ffb-c075a7bf2d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:51.489847 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f075dc-99b2-4153-9ffb-c075a7bf2d74 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:51.490130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f075dc-99b2-4153-9ffb-c075a7bf2d74 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:51.490431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f075dc-99b2-4153-9ffb-c075a7bf2d74 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:51.491134 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f075dc-99b2-4153-9ffb-c075a7bf2d74 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:51.491435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f075dc-99b2-4153-9ffb-c075a7bf2d74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:51.492800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f075dc-99b2-4153-9ffb-c075a7bf2d74 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:51.499245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 444/885] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:18:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:51.507112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1e1fe-f62e-4fe8-aa56-4c5f54010e24 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:51.627337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1e1fe-f62e-4fe8-aa56-4c5f54010e24 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:51.664036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa3f87-cf56-48f0-b4e1-989b9ca34bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:51.664701 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa3f87-cf56-48f0-b4e1-989b9ca34bdb None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:51.664982 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa3f87-cf56-48f0-b4e1-989b9ca34bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:51.665254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa3f87-cf56-48f0-b4e1-989b9ca34bdb None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:51.665961 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa3f87-cf56-48f0-b4e1-989b9ca34bdb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:51.666378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa3f87-cf56-48f0-b4e1-989b9ca34bdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:51.667880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa3f87-cf56-48f0-b4e1-989b9ca34bdb None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:51.673212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 442/886] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:18:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:51.678866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f075dc-99b2-4153-9ffb-c075a7bf2d74 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:51.778923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f075dc-99b2-4153-9ffb-c075a7bf2d74 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:51.812723 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ce1c2-2d0f-49bf-bdbf-4439ec6560cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:51.813379 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ce1c2-2d0f-49bf-bdbf-4439ec6560cb None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:51.813656 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ce1c2-2d0f-49bf-bdbf-4439ec6560cb None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:51.813929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ce1c2-2d0f-49bf-bdbf-4439ec6560cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:51.814745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ce1c2-2d0f-49bf-bdbf-4439ec6560cb None admin] RBAC: Adding query filter params (interface=public, service_id=c8a4c96b757e409b8e8c594cb2ab4e50, region_id=RegionOne) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:51.815053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ce1c2-2d0f-49bf-bdbf-4439ec6560cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:51.816421 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ce1c2-2d0f-49bf-bdbf-4439ec6560cb None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:51.821807 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 445/887] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 14:18:51 2022] GET /identity/v3/endpoints?service_id=c8a4c96b757e409b8e8c594cb2ab4e50&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:51.827282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa3f87-cf56-48f0-b4e1-989b9ca34bdb None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:51.927821 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa3f87-cf56-48f0-b4e1-989b9ca34bdb None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:51.966663 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c81be6-0cd3-48da-b1e9-c5198de28eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:51.967328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c81be6-0cd3-48da-b1e9-c5198de28eac None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:51.967607 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c81be6-0cd3-48da-b1e9-c5198de28eac None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:51.967876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c81be6-0cd3-48da-b1e9-c5198de28eac None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:51.968558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c81be6-0cd3-48da-b1e9-c5198de28eac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:51.969929 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c81be6-0cd3-48da-b1e9-c5198de28eac None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:51.976140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 443/888] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 14:18:51 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:18:52.122198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7f395-50b1-4724-beab-1846f664cf4f None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:52.122710 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7f395-50b1-4724-beab-1846f664cf4f None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:52.122812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7f395-50b1-4724-beab-1846f664cf4f None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:52.124353 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 446/889] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:52.130706 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bed810-2339-435f-838e-fdbed3cae0a7 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:52.130706 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bed810-2339-435f-838e-fdbed3cae0a7 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:52.130706 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bed810-2339-435f-838e-fdbed3cae0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:52.149950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-39bed810-2339-435f-838e-fdbed3cae0a7 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:52.151325 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-39bed810-2339-435f-838e-fdbed3cae0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:52.228716 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 444/890] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:18:52.253044 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7f395-50b1-4724-beab-1846f664cf4f None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:52.360124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7f395-50b1-4724-beab-1846f664cf4f None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:52.395972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d874f-6286-4159-bf6d-8fc4f5aa83e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:52.396781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d874f-6286-4159-bf6d-8fc4f5aa83e5 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:52.397060 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d874f-6286-4159-bf6d-8fc4f5aa83e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:52.397332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d874f-6286-4159-bf6d-8fc4f5aa83e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:52.408292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d874f-6286-4159-bf6d-8fc4f5aa83e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-506d874f-6286-4159-bf6d-8fc4f5aa83e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:52.416366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:52.417342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:52.418231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:52.418231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:52.418231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:52.418231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:52.418231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:52.418231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:52.418231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:52.418231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:52.418231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:52.418231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:52.418231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 14:18:52.418231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:52.418231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 447/891] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 17 14:18:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:52.425398 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bed810-2339-435f-838e-fdbed3cae0a7 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:52.525956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bed810-2339-435f-838e-fdbed3cae0a7 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:52.534709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dd68c-5d6f-4c08-b27d-5f23c32f6188 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:52.534992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dd68c-5d6f-4c08-b27d-5f23c32f6188 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:52.535276 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dd68c-5d6f-4c08-b27d-5f23c32f6188 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:52.536883 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 448/892] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:18:52.541696 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449ea1-4363-4e6d-8eee-c25b86924ba0 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:52.541979 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449ea1-4363-4e6d-8eee-c25b86924ba0 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:52.542296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449ea1-4363-4e6d-8eee-c25b86924ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:52.559751 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-28449ea1-4363-4e6d-8eee-c25b86924ba0 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:52.560918 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-28449ea1-4363-4e6d-8eee-c25b86924ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:52.562840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b17c8-3450-4b40-8d25-cb62dab47f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:52.563745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b17c8-3450-4b40-8d25-cb62dab47f4f None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:52.564246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b17c8-3450-4b40-8d25-cb62dab47f4f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:52.564753 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b17c8-3450-4b40-8d25-cb62dab47f4f None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:52.565734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b17c8-3450-4b40-8d25-cb62dab47f4f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:52.566287 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b17c8-3450-4b40-8d25-cb62dab47f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:52.567885 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b17c8-3450-4b40-8d25-cb62dab47f4f None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:52.577150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 445/893] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 17 14:18:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:52.583037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b17c8-3450-4b40-8d25-cb62dab47f4f None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:52.639416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 449/894] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:18:52.661826 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28449ea1-4363-4e6d-8eee-c25b86924ba0 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:52.710455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b17c8-3450-4b40-8d25-cb62dab47f4f None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:52.744247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c1e2e-b4a4-4117-b1f0-8bb6e58e8b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:52.746152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c1e2e-b4a4-4117-b1f0-8bb6e58e8b2f None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:52.746927 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c1e2e-b4a4-4117-b1f0-8bb6e58e8b2f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:52.747397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c1e2e-b4a4-4117-b1f0-8bb6e58e8b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:52.758399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c1e2e-b4a4-4117-b1f0-8bb6e58e8b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:52.760373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c1e2e-b4a4-4117-b1f0-8bb6e58e8b2f None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:52.778703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-704c1e2e-b4a4-4117-b1f0-8bb6e58e8b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:52.778703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:52.778703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:52.778703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:52.778703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:52.778703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:52.778703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:52.778703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:52.778703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:52.778703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:52.778703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:52.778703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:52.778703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:52.778703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:52.778703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:52.779605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:52.780490 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:52.780490 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:52.780490 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:52.780490 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:52.782752 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 446/895] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:52.790733 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c1e2e-b4a4-4117-b1f0-8bb6e58e8b2f None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:52.792402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28449ea1-4363-4e6d-8eee-c25b86924ba0 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:52.827586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ba1dd-3eaf-4680-8be7-5d1165bfbefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:52.828252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ba1dd-3eaf-4680-8be7-5d1165bfbefa None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:52.828525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ba1dd-3eaf-4680-8be7-5d1165bfbefa None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:52.828796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ba1dd-3eaf-4680-8be7-5d1165bfbefa None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:52.829524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ba1dd-3eaf-4680-8be7-5d1165bfbefa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:52.831164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ba1dd-3eaf-4680-8be7-5d1165bfbefa None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:52.846205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 450/896] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 14:18:52 2022] POST /identity/v3/services => generated 241 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:18:52.847786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9dd33-d304-4a63-9494-5ef45ed6addb None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:52.848301 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9dd33-d304-4a63-9494-5ef45ed6addb None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:52.848671 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9dd33-d304-4a63-9494-5ef45ed6addb None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:52.850293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 451/897] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:52.856255 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada2616-336c-4a7c-b0ca-98949ed9ecbb None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:52.856582 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada2616-336c-4a7c-b0ca-98949ed9ecbb None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:52.856803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada2616-336c-4a7c-b0ca-98949ed9ecbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:52.877846 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-dada2616-336c-4a7c-b0ca-98949ed9ecbb None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:52.879343 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-dada2616-336c-4a7c-b0ca-98949ed9ecbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:52.926897 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c1e2e-b4a4-4117-b1f0-8bb6e58e8b2f None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:52.969606 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 452/898] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:18:52.985489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e04222-1b87-4f3e-afff-66bd420fc72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:52.986619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e04222-1b87-4f3e-afff-66bd420fc72d None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:52.987125 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e04222-1b87-4f3e-afff-66bd420fc72d None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:52.987607 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e04222-1b87-4f3e-afff-66bd420fc72d None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:52.988784 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e04222-1b87-4f3e-afff-66bd420fc72d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:52.989400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e04222-1b87-4f3e-afff-66bd420fc72d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:52.991137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e04222-1b87-4f3e-afff-66bd420fc72d None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:52.993726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada2616-336c-4a7c-b0ca-98949ed9ecbb None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:53.007758 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 447/899] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:53.014563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e04222-1b87-4f3e-afff-66bd420fc72d None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:53.112670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada2616-336c-4a7c-b0ca-98949ed9ecbb None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:53.126224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e04222-1b87-4f3e-afff-66bd420fc72d None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:53.155926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbab59-ac8a-4430-9e8b-43020ba74f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:53.157577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbab59-ac8a-4430-9e8b-43020ba74f0b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:53.158444 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbab59-ac8a-4430-9e8b-43020ba74f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:53.158876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbab59-ac8a-4430-9e8b-43020ba74f0b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:53.160001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbab59-ac8a-4430-9e8b-43020ba74f0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:53.161688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbab59-ac8a-4430-9e8b-43020ba74f0b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:53.163911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34c92c-28c1-429d-bb54-f4f8918c63f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:53.164811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34c92c-28c1-429d-bb54-f4f8918c63f9 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:53.165195 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34c92c-28c1-429d-bb54-f4f8918c63f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:53.165836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34c92c-28c1-429d-bb54-f4f8918c63f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:53.176135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34c92c-28c1-429d-bb54-f4f8918c63f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:53.177803 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34c92c-28c1-429d-bb54-f4f8918c63f9 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-fedbab59-ac8a-4430-9e8b-43020ba74f0b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:53.178163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:53.179178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:53.179997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:53.179997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:53.179997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:53.179997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:53.179997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:53.179997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:53.179997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:53.179997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:53.179997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:53.179997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:53.179997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:53.179997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:53.179997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:53.179997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 14:18:53.179997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:53.182758 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 453/900] 10.222.0.48 () {56 vars in 1132 bytes} [Tue May 17 14:18:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:53.188831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbab59-ac8a-4430-9e8b-43020ba74f0b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-ae34c92c-28c1-429d-bb54-f4f8918c63f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:53.197073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:53.198699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:53.199637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:53.199637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:53.199637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:53.199637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:53.199637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:53.199637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:53.199637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:53.199637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:53.199637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 14:18:53.199637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:53.199637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 448/901] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 14:18:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:53.205172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34c92c-28c1-429d-bb54-f4f8918c63f9 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:53.298224 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbab59-ac8a-4430-9e8b-43020ba74f0b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:53.319194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34c92c-28c1-429d-bb54-f4f8918c63f9 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:53.337706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab454e-2f42-4052-98f7-8e2d85605003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:53.339258 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab454e-2f42-4052-98f7-8e2d85605003 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:53.339741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab454e-2f42-4052-98f7-8e2d85605003 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:53.340218 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab454e-2f42-4052-98f7-8e2d85605003 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:53.341109 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab454e-2f42-4052-98f7-8e2d85605003 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:53.341621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab454e-2f42-4052-98f7-8e2d85605003 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:53.343211 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab454e-2f42-4052-98f7-8e2d85605003 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:53.355427 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 454/902] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 14:18:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:53.358451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab454e-2f42-4052-98f7-8e2d85605003 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:53.362836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd31cb-ed0d-424e-9fa8-3c19d956e4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:53.363816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd31cb-ed0d-424e-9fa8-3c19d956e4b0 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:53.364371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd31cb-ed0d-424e-9fa8-3c19d956e4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:53.364837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd31cb-ed0d-424e-9fa8-3c19d956e4b0 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:53.365874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd31cb-ed0d-424e-9fa8-3c19d956e4b0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:53.366420 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd31cb-ed0d-424e-9fa8-3c19d956e4b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:53.368067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd31cb-ed0d-424e-9fa8-3c19d956e4b0 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:53.386996 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 449/903] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 17 14:18:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:53.392603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd31cb-ed0d-424e-9fa8-3c19d956e4b0 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:53.483893 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab454e-2f42-4052-98f7-8e2d85605003 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:53.500643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd31cb-ed0d-424e-9fa8-3c19d956e4b0 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:53.526354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3078277-1254-42f7-9dea-9b14704914d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:53.527167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3078277-1254-42f7-9dea-9b14704914d4 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:53.527451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3078277-1254-42f7-9dea-9b14704914d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:53.527728 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3078277-1254-42f7-9dea-9b14704914d4 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:53.528442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3078277-1254-42f7-9dea-9b14704914d4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:53.528748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3078277-1254-42f7-9dea-9b14704914d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:53.530131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3078277-1254-42f7-9dea-9b14704914d4 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:53.544608 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 455/904] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 14:18:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:53.545964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3078277-1254-42f7-9dea-9b14704914d4 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:53.547078 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77839f74-35b3-422c-aaa3-78fa5e49e9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:53.547982 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77839f74-35b3-422c-aaa3-78fa5e49e9bd None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:53.548650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77839f74-35b3-422c-aaa3-78fa5e49e9bd None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:53.549939 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77839f74-35b3-422c-aaa3-78fa5e49e9bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:53.638974 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77839f74-35b3-422c-aaa3-78fa5e49e9bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:53.640976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77839f74-35b3-422c-aaa3-78fa5e49e9bd None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:53.654998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3078277-1254-42f7-9dea-9b14704914d4 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:53.689711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acb251-e660-4b45-8537-b44afcb7820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:53.690513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acb251-e660-4b45-8537-b44afcb7820d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:53.690865 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acb251-e660-4b45-8537-b44afcb7820d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:53.691214 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acb251-e660-4b45-8537-b44afcb7820d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:53.692315 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acb251-e660-4b45-8537-b44afcb7820d None admin] RBAC: Adding query filter params (interface=public, service_id=62b6540bf7ab4bc3a74f34fcb84a72dd, region_id=RegionOne) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:53.692426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acb251-e660-4b45-8537-b44afcb7820d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:53.693918 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acb251-e660-4b45-8537-b44afcb7820d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:53.704095 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 456/905] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 14:18:53 2022] GET /identity/v3/endpoints?service_id=62b6540bf7ab4bc3a74f34fcb84a72dd&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:53.705165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acb251-e660-4b45-8537-b44afcb7820d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:53.765951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 450/906] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:18:53 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 14:18:53.771601 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77839f74-35b3-422c-aaa3-78fa5e49e9bd None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:53.822299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acb251-e660-4b45-8537-b44afcb7820d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:53.857185 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a21b1-207f-4f19-a378-62f569d5bfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:53.857923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a21b1-207f-4f19-a378-62f569d5bfbd None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:53.858222 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a21b1-207f-4f19-a378-62f569d5bfbd None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:53.858547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a21b1-207f-4f19-a378-62f569d5bfbd None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:53.859402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a21b1-207f-4f19-a378-62f569d5bfbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:53.861125 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a21b1-207f-4f19-a378-62f569d5bfbd None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:53.870383 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 457/907] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 14:18:53 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:18:53.883838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77839f74-35b3-422c-aaa3-78fa5e49e9bd None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:53.923359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24699d9f-60b6-460e-b7f0-94f16982b5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:53.924543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24699d9f-60b6-460e-b7f0-94f16982b5d7 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:53.925035 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24699d9f-60b6-460e-b7f0-94f16982b5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:53.925530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24699d9f-60b6-460e-b7f0-94f16982b5d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:53.937653 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24699d9f-60b6-460e-b7f0-94f16982b5d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:53.939588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24699d9f-60b6-460e-b7f0-94f16982b5d7 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:53.960092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-24699d9f-60b6-460e-b7f0-94f16982b5d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:53.960092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:53.960092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:53.960092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:53.960092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:53.960092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:53.960092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:53.960092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:53.960092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:53.960092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:53.960092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:53.960092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:53.960092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:53.960092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:53.960092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:53.961168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:53.962081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:53.962081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:53.962081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:53.962081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:53.964702 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 451/908] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:53.970812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a21b1-207f-4f19-a378-62f569d5bfbd None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:54.080172 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a21b1-207f-4f19-a378-62f569d5bfbd None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:54.116339 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94771f9e-1283-4c7b-b770-a0790616e7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:54.117411 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94771f9e-1283-4c7b-b770-a0790616e7d4 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:54.117902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94771f9e-1283-4c7b-b770-a0790616e7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:54.118416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94771f9e-1283-4c7b-b770-a0790616e7d4 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:54.120059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94771f9e-1283-4c7b-b770-a0790616e7d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:54.120614 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94771f9e-1283-4c7b-b770-a0790616e7d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:54.122299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94771f9e-1283-4c7b-b770-a0790616e7d4 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:54.136739 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 458/909] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:54.142993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24699d9f-60b6-460e-b7f0-94f16982b5d7 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:54.258677 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24699d9f-60b6-460e-b7f0-94f16982b5d7 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:54.295105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c371e-3114-4a17-8301-8370cd17b248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:54.295910 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c371e-3114-4a17-8301-8370cd17b248 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:54.296194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c371e-3114-4a17-8301-8370cd17b248 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:54.296468 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c371e-3114-4a17-8301-8370cd17b248 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:54.303598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c371e-3114-4a17-8301-8370cd17b248 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:54.305058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c371e-3114-4a17-8301-8370cd17b248 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:54.320892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f41fb1-f62f-4e88-b8d2-73d91ad63413 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:54.321388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f41fb1-f62f-4e88-b8d2-73d91ad63413 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:54.321465 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f41fb1-f62f-4e88-b8d2-73d91ad63413 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:54.323925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-b71c371e-3114-4a17-8301-8370cd17b248 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:54.323925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:54.323925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:54.323925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:54.323925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:54.323925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:54.323925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:54.323925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:54.323925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:54.323925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:54.323925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:54.323925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:54.323925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:54.323925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:54.323925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:54.324798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:54.326025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:54.326025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:54.326025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:54.326025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:54.326025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:54.326025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:54.326025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:54.326025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:54.326712 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 459/910] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:54.327686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 452/911] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:54.333006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecd069-c0cf-4f3d-8528-8f02ff69fdb6 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:54.333302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecd069-c0cf-4f3d-8528-8f02ff69fdb6 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:54.333579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecd069-c0cf-4f3d-8528-8f02ff69fdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:54.338009 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c371e-3114-4a17-8301-8370cd17b248 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:54.355742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c4ecd069-c0cf-4f3d-8528-8f02ff69fdb6 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:54.357109 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c4ecd069-c0cf-4f3d-8528-8f02ff69fdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:54.438199 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 460/912] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:18:54.454345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecd069-c0cf-4f3d-8528-8f02ff69fdb6 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:54.460288 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c371e-3114-4a17-8301-8370cd17b248 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:54.494962 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc2029-7ef1-4026-adfb-3dc4faf37de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:54.496003 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc2029-7ef1-4026-adfb-3dc4faf37de2 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:54.496493 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc2029-7ef1-4026-adfb-3dc4faf37de2 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:54.496983 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc2029-7ef1-4026-adfb-3dc4faf37de2 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:54.497986 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc2029-7ef1-4026-adfb-3dc4faf37de2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:54.498539 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc2029-7ef1-4026-adfb-3dc4faf37de2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:54.500308 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc2029-7ef1-4026-adfb-3dc4faf37de2 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:54.514616 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 453/913] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:54.521969 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc2029-7ef1-4026-adfb-3dc4faf37de2 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:54.569079 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecd069-c0cf-4f3d-8528-8f02ff69fdb6 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:54.606498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f81c0-48d3-47ba-b4ee-63301cefdbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:54.607779 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f81c0-48d3-47ba-b4ee-63301cefdbe4 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:54.608289 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f81c0-48d3-47ba-b4ee-63301cefdbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:54.608778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f81c0-48d3-47ba-b4ee-63301cefdbe4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:54.609649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f81c0-48d3-47ba-b4ee-63301cefdbe4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:54.611297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f81c0-48d3-47ba-b4ee-63301cefdbe4 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-161f81c0-48d3-47ba-b4ee-63301cefdbe4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:54.623891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:54.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:54.625761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:54.625761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:54.625761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:54.625761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:54.625761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:54.625761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:54.625761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:54.625761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:54.625761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:54.625761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:54.625761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:54.625761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:54.625761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 14:18:54.625761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:54.633307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc2029-7ef1-4026-adfb-3dc4faf37de2 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:54.633610 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 461/914] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:18:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:54.635700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f81c0-48d3-47ba-b4ee-63301cefdbe4 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:54.667746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be290d-4550-4df9-875c-69db6030fb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:54.668409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be290d-4550-4df9-875c-69db6030fb4b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:54.668696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be290d-4550-4df9-875c-69db6030fb4b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:54.668974 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be290d-4550-4df9-875c-69db6030fb4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:54.669815 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be290d-4550-4df9-875c-69db6030fb4b None admin] RBAC: Adding query filter params (role.id=a00f17971455442b93c3cd2f40b9daad, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=ba800a3364ee46f395d040f7eb8f775f) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:54.670127 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be290d-4550-4df9-875c-69db6030fb4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:54.671699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be290d-4550-4df9-875c-69db6030fb4b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:54.683918 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 454/915] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:18:54 2022] GET /identity/v3/role_assignments?user.id=ba800a3364ee46f395d040f7eb8f775f&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=a00f17971455442b93c3cd2f40b9daad => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:54.750716 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f81c0-48d3-47ba-b4ee-63301cefdbe4 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:54.788666 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5656843-1f07-427d-ad1d-e46935d6d447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:54.789341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5656843-1f07-427d-ad1d-e46935d6d447 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:54.789620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5656843-1f07-427d-ad1d-e46935d6d447 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:54.789892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5656843-1f07-427d-ad1d-e46935d6d447 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:54.790640 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5656843-1f07-427d-ad1d-e46935d6d447 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:54.790943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5656843-1f07-427d-ad1d-e46935d6d447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:54.792430 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5656843-1f07-427d-ad1d-e46935d6d447 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:54.798163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 462/916] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:18:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:54.804019 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be290d-4550-4df9-875c-69db6030fb4b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:54.914915 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be290d-4550-4df9-875c-69db6030fb4b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:54.949595 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3dfe9-598b-4815-9654-d5d99467f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:54.950297 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3dfe9-598b-4815-9654-d5d99467f94f None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:54.950651 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3dfe9-598b-4815-9654-d5d99467f94f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:54.950936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3dfe9-598b-4815-9654-d5d99467f94f None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:54.951643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3dfe9-598b-4815-9654-d5d99467f94f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:54.951950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3dfe9-598b-4815-9654-d5d99467f94f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:54.953326 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3dfe9-598b-4815-9654-d5d99467f94f None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:54.958888 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 455/917] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 17 14:18:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:54.965123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5656843-1f07-427d-ad1d-e46935d6d447 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:55.072939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5656843-1f07-427d-ad1d-e46935d6d447 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:55.109256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b77892-b654-45bc-bb4c-92dc01a2b82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:55.109909 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b77892-b654-45bc-bb4c-92dc01a2b82e None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:55.110249 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b77892-b654-45bc-bb4c-92dc01a2b82e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:55.110524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b77892-b654-45bc-bb4c-92dc01a2b82e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:55.111328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b77892-b654-45bc-bb4c-92dc01a2b82e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:55.112690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b77892-b654-45bc-bb4c-92dc01a2b82e None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:55.134632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 463/918] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 14:18:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:18:55.236468 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35cebd-72ad-4fed-bc82-16afdd5d7615 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:55.236807 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35cebd-72ad-4fed-bc82-16afdd5d7615 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:55.237032 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35cebd-72ad-4fed-bc82-16afdd5d7615 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:55.238735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 456/919] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:55.244896 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d50305-eaf6-4dea-9f85-ffd500243b9c None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:55.245197 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d50305-eaf6-4dea-9f85-ffd500243b9c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:55.245459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d50305-eaf6-4dea-9f85-ffd500243b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:55.263669 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-66d50305-eaf6-4dea-9f85-ffd500243b9c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:55.264895 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-66d50305-eaf6-4dea-9f85-ffd500243b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:55.349026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 464/920] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:18:55.372796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35cebd-72ad-4fed-bc82-16afdd5d7615 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:55.475447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35cebd-72ad-4fed-bc82-16afdd5d7615 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:55.514335 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40467f-c788-4d24-b60d-fafb8d5d578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:55.515485 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40467f-c788-4d24-b60d-fafb8d5d578f None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:55.515966 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40467f-c788-4d24-b60d-fafb8d5d578f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:55.516461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40467f-c788-4d24-b60d-fafb8d5d578f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:55.517319 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40467f-c788-4d24-b60d-fafb8d5d578f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:55.519171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40467f-c788-4d24-b60d-fafb8d5d578f None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-1d40467f-c788-4d24-b60d-fafb8d5d578f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:55.532604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:55.533665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:55.534529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:55.534529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:55.534529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:55.534529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:55.534529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:55.534529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:55.534529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:55.534529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:55.534529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:55.534529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:55.534529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:55.534529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:55.534529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 14:18:55.534529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:55.537110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 457/921] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 14:18:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:55.543274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d50305-eaf6-4dea-9f85-ffd500243b9c None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:55.655625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d50305-eaf6-4dea-9f85-ffd500243b9c None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:55.690061 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e121f-f267-4cad-b5a0-989ee77ed23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:55.690849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e121f-f267-4cad-b5a0-989ee77ed23e None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:55.691134 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e121f-f267-4cad-b5a0-989ee77ed23e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:55.691414 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e121f-f267-4cad-b5a0-989ee77ed23e None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:55.692178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e121f-f267-4cad-b5a0-989ee77ed23e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:55.692486 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e121f-f267-4cad-b5a0-989ee77ed23e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:55.693911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e121f-f267-4cad-b5a0-989ee77ed23e None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:55.699278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 465/922] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 14:18:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:55.704650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40467f-c788-4d24-b60d-fafb8d5d578f None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:55.809684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40467f-c788-4d24-b60d-fafb8d5d578f None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:55.846640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fda00-2749-4c58-b0b2-9fdfd9370870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:55.847322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fda00-2749-4c58-b0b2-9fdfd9370870 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:55.847609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fda00-2749-4c58-b0b2-9fdfd9370870 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:55.847882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fda00-2749-4c58-b0b2-9fdfd9370870 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:55.848601 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fda00-2749-4c58-b0b2-9fdfd9370870 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:55.848909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fda00-2749-4c58-b0b2-9fdfd9370870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:55.850317 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fda00-2749-4c58-b0b2-9fdfd9370870 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:55.856496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 458/923] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 14:18:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:55.863272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e121f-f267-4cad-b5a0-989ee77ed23e None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:55.964415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e121f-f267-4cad-b5a0-989ee77ed23e None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:56.001202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcc7c3-4ae3-4649-accc-5ab449d7b32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:56.001871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcc7c3-4ae3-4649-accc-5ab449d7b32f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:56.002156 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcc7c3-4ae3-4649-accc-5ab449d7b32f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:56.002467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcc7c3-4ae3-4649-accc-5ab449d7b32f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:56.003260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcc7c3-4ae3-4649-accc-5ab449d7b32f None admin] RBAC: Adding query filter params (interface=public, service_id=a13a97e7f6d44791b5ff62cbd66d1eee, region_id=RegionOne) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:56.003571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcc7c3-4ae3-4649-accc-5ab449d7b32f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:56.004948 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcc7c3-4ae3-4649-accc-5ab449d7b32f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:56.011234 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 466/924] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 14:18:55 2022] GET /identity/v3/endpoints?service_id=a13a97e7f6d44791b5ff62cbd66d1eee&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:56.019271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fda00-2749-4c58-b0b2-9fdfd9370870 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:56.126279 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fda00-2749-4c58-b0b2-9fdfd9370870 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:56.160824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b2523-1eb7-402b-9186-40381c464d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:56.161503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b2523-1eb7-402b-9186-40381c464d07 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:56.161790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b2523-1eb7-402b-9186-40381c464d07 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:56.162509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b2523-1eb7-402b-9186-40381c464d07 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:56.162781 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b2523-1eb7-402b-9186-40381c464d07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:56.164151 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b2523-1eb7-402b-9186-40381c464d07 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:56.171051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 459/925] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 14:18:56 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:18:56.253268 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243aba2-1d15-45d4-998c-8e0766c9426b None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:56.253558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243aba2-1d15-45d4-998c-8e0766c9426b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:56.253756 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243aba2-1d15-45d4-998c-8e0766c9426b None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:56.255373 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 467/926] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:56.261793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cbc14-55e0-40eb-acd5-dc794c27b3b9 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:56.262082 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cbc14-55e0-40eb-acd5-dc794c27b3b9 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:56.262391 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cbc14-55e0-40eb-acd5-dc794c27b3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:56.280132 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-253cbc14-55e0-40eb-acd5-dc794c27b3b9 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:56.281350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-253cbc14-55e0-40eb-acd5-dc794c27b3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:56.356655 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 460/927] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:18:56.379714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243aba2-1d15-45d4-998c-8e0766c9426b None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:56.486766 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243aba2-1d15-45d4-998c-8e0766c9426b None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:56.523213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79577daf-d3e0-4860-bffb-615b847a11fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:56.524437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79577daf-d3e0-4860-bffb-615b847a11fc None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:56.525008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79577daf-d3e0-4860-bffb-615b847a11fc None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:56.526358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79577daf-d3e0-4860-bffb-615b847a11fc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:56.527234 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79577daf-d3e0-4860-bffb-615b847a11fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:56.528818 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79577daf-d3e0-4860-bffb-615b847a11fc None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-79577daf-d3e0-4860-bffb-615b847a11fc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:56.541815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:56.542799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:56.543632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:56.543632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:56.543632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:56.543632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:56.543632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:56.543632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:56.543632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:56.543632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:56.543632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:56.543632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:56.543632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:56.543632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:56.543632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:56.543632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 14:18:56.543632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:56.546546 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 468/928] 10.222.0.48 () {56 vars in 1132 bytes} [Tue May 17 14:18:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:56.552824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cbc14-55e0-40eb-acd5-dc794c27b3b9 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:56.659869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cbc14-55e0-40eb-acd5-dc794c27b3b9 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:56.695769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f57c82-edce-4ba6-8885-c899ccca68e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:56.696444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f57c82-edce-4ba6-8885-c899ccca68e3 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:56.696730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f57c82-edce-4ba6-8885-c899ccca68e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:56.697007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f57c82-edce-4ba6-8885-c899ccca68e3 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:56.697777 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f57c82-edce-4ba6-8885-c899ccca68e3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:56.698261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f57c82-edce-4ba6-8885-c899ccca68e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:56.699651 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f57c82-edce-4ba6-8885-c899ccca68e3 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:56.704906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 461/929] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 14:18:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:56.710774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79577daf-d3e0-4860-bffb-615b847a11fc None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:56.811596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79577daf-d3e0-4860-bffb-615b847a11fc None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:56.850935 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ee615-34a0-4463-97d4-b8c1b5f8cebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:56.851611 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ee615-34a0-4463-97d4-b8c1b5f8cebf None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:56.851898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ee615-34a0-4463-97d4-b8c1b5f8cebf None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:56.852179 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ee615-34a0-4463-97d4-b8c1b5f8cebf None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:56.852899 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ee615-34a0-4463-97d4-b8c1b5f8cebf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:56.853202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ee615-34a0-4463-97d4-b8c1b5f8cebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:56.855575 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ee615-34a0-4463-97d4-b8c1b5f8cebf None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:56.861350 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 469/930] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 14:18:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:56.867256 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f57c82-edce-4ba6-8885-c899ccca68e3 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:56.974436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f57c82-edce-4ba6-8885-c899ccca68e3 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:57.009710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d504c-c425-4237-bf10-c1682902991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:57.012496 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872dba9-72b3-4c3c-83ef-54fc94188eca None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:57.012637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d504c-c425-4237-bf10-c1682902991b None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:57.012817 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872dba9-72b3-4c3c-83ef-54fc94188eca None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:57.012976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d504c-c425-4237-bf10-c1682902991b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:57.013097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872dba9-72b3-4c3c-83ef-54fc94188eca None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:57.013466 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d504c-c425-4237-bf10-c1682902991b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:57.014812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 470/931] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:57.014926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d504c-c425-4237-bf10-c1682902991b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:57.017327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d504c-c425-4237-bf10-c1682902991b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:57.020901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0024836-7afa-4000-a7c4-1016697d25d4 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:57.021186 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0024836-7afa-4000-a7c4-1016697d25d4 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:57.021460 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0024836-7afa-4000-a7c4-1016697d25d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:57.039400 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-f0024836-7afa-4000-a7c4-1016697d25d4 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:57.040616 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f0024836-7afa-4000-a7c4-1016697d25d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:57.042132 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 462/932] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 14:18:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:18:57.130154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 471/933] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:18:57.153293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d504c-c425-4237-bf10-c1682902991b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:57.263593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d504c-c425-4237-bf10-c1682902991b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:57.299202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ffc06-457c-493d-b51e-f69e7765d4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:57.300403 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ffc06-457c-493d-b51e-f69e7765d4bd None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:57.300686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ffc06-457c-493d-b51e-f69e7765d4bd None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:57.300959 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ffc06-457c-493d-b51e-f69e7765d4bd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:57.311528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ffc06-457c-493d-b51e-f69e7765d4bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-a37ffc06-457c-493d-b51e-f69e7765d4bd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:18:57.319736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:57.320644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:57.321474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:57.321474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:57.321474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:57.321474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:57.321474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:18:57.321474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:18:57.321474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:18:57.321474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:18:57.321474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:18:57.321474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:18:57.321474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 14:18:57.321474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:57.326282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 463/934] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 17 14:18:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:57.328092 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0024836-7afa-4000-a7c4-1016697d25d4 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:57.436740 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0024836-7afa-4000-a7c4-1016697d25d4 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:57.474398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd849d0-d34b-4a5d-bcad-8587c154f1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:57.475419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd849d0-d34b-4a5d-bcad-8587c154f1db None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:57.475898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd849d0-d34b-4a5d-bcad-8587c154f1db None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:57.476368 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd849d0-d34b-4a5d-bcad-8587c154f1db None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:57.477295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd849d0-d34b-4a5d-bcad-8587c154f1db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:57.477795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd849d0-d34b-4a5d-bcad-8587c154f1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:57.480011 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd849d0-d34b-4a5d-bcad-8587c154f1db None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:57.492679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 472/935] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 17 14:18:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:57.494904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ffc06-457c-493d-b51e-f69e7765d4bd None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:57.558932 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8085670-91ac-4614-a6c2-cd856cde6678 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:57.559558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8085670-91ac-4614-a6c2-cd856cde6678 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:57.560064 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8085670-91ac-4614-a6c2-cd856cde6678 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:57.561930 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 473/936] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:18:57.567533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5e55a-0e4c-440b-b026-fb50c84a0690 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:57.568100 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5e55a-0e4c-440b-b026-fb50c84a0690 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:57.568576 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5e55a-0e4c-440b-b026-fb50c84a0690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:57.586493 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-84b5e55a-0e4c-440b-b026-fb50c84a0690 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:57.588126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-84b5e55a-0e4c-440b-b026-fb50c84a0690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:57.599905 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ffc06-457c-493d-b51e-f69e7765d4bd None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:57.635136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75fafa-0ed7-4ed0-ab7d-e59244d9177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:57.636084 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75fafa-0ed7-4ed0-ab7d-e59244d9177c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:57.636371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75fafa-0ed7-4ed0-ab7d-e59244d9177c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:57.636650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75fafa-0ed7-4ed0-ab7d-e59244d9177c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:57.648685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75fafa-0ed7-4ed0-ab7d-e59244d9177c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:57.650203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75fafa-0ed7-4ed0-ab7d-e59244d9177c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:57.666818 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 474/937] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:18:57.668445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-5b75fafa-0ed7-4ed0-ab7d-e59244d9177c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:57.668445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:57.668445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:57.668445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:57.668445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:57.668445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:57.668445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:57.668445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:57.668445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:57.668445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:57.668445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:57.668445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:57.668445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:57.668445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:57.668445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:57.669291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:57.670654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:57.670654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:57.670654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:57.670654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:57.670654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 464/938] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:57.675453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5e55a-0e4c-440b-b026-fb50c84a0690 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:57.692408 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75fafa-0ed7-4ed0-ab7d-e59244d9177c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:57.791660 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5e55a-0e4c-440b-b026-fb50c84a0690 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:57.815327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75fafa-0ed7-4ed0-ab7d-e59244d9177c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:57.835039 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8144ab8-fe06-4cbd-80cb-8da8398a6e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:57.836271 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8144ab8-fe06-4cbd-80cb-8da8398a6e4a None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:57.836741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8144ab8-fe06-4cbd-80cb-8da8398a6e4a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:57.837196 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8144ab8-fe06-4cbd-80cb-8da8398a6e4a None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:57.839504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8144ab8-fe06-4cbd-80cb-8da8398a6e4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:57.840004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8144ab8-fe06-4cbd-80cb-8da8398a6e4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:57.842005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8144ab8-fe06-4cbd-80cb-8da8398a6e4a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:57.855085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef1a30-eba5-4333-9a68-28a98a2b8f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:57.855843 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef1a30-eba5-4333-9a68-28a98a2b8f07 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:57.856200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef1a30-eba5-4333-9a68-28a98a2b8f07 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:57.856547 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef1a30-eba5-4333-9a68-28a98a2b8f07 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:57.857426 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef1a30-eba5-4333-9a68-28a98a2b8f07 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:57.861930 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef1a30-eba5-4333-9a68-28a98a2b8f07 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:57.861930 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: WARNING keystone.server.flask.common [None req-66ef1a30-eba5-4333-9a68-28a98a2b8f07 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 17 14:18:57.862621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 475/939] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:57.863957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8144ab8-fe06-4cbd-80cb-8da8398a6e4a None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:57.881645 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.sql.core [None req-66ef1a30-eba5-4333-9a68-28a98a2b8f07 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 14:18:57.881645 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 17 14:18:57.881645 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [parameters: {'id': '77acf605a2cc4ba4855f3c9af916d010', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 17 14:18:57.881645 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79878) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 14:18:57.905143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-66ef1a30-eba5-4333-9a68-28a98a2b8f07 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 77acf605a2cc4ba4855f3c9af916d010.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 77acf605a2cc4ba4855f3c9af916d010. May 17 14:18:57.905143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:57.905143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 14:18:57.905143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 14:18:57.905143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 14:18:57.905143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 14:18:57.905143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 14:18:57.905143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application result = self._query(query) May 17 14:18:57.905143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 14:18:57.905143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application conn.query(q) May 17 14:18:57.905143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 14:18:57.905143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 14:18:57.905143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application result.read() May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 17 14:18:57.906062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return project_ref.to_dict() May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application next(self.gen) May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application yield resource May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application next(self.gen) May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self.session.rollback() May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self.force_reraise() May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise self.value May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application session.commit() May 17 14:18:57.907102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._prepare_impl() May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self.session.flush() May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._flush(objects) May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application compat.raise_( May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application flush_context.execute() May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 14:18:57.908022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rec.execute(self) May 17 14:18:57.908950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 14:18:57.908950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 14:18:57.908950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 14:18:57.908950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 14:18:57.908950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 17 14:18:57.908950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application c = connection._execute_20( May 17 14:18:57.908950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 14:18:57.908950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 14:18:57.908950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 14:18:57.908950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 14:18:57.908950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 14:18:57.908950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 14:18:57.908950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 14:18:57.908950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 14:18:57.908950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application result = self._query(query) May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application conn.query(q) May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application result.read() May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 14:18:57.909769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 14:18:57.911746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 14:18:57.911746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 14:18:57.911746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 14:18:57.911746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 14:18:57.911746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 14:18:57.911746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 14:18:57.911746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 14:18:57.911746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 17 14:18:57.911746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [parameters: {'id': '77acf605a2cc4ba4855f3c9af916d010', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 17 14:18:57.911746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 14:18:57.911746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:57.911746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:57.911746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:57.911746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:57.911746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:57.913360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:57.915285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:57.915285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 17 14:18:57.915285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 17 14:18:57.915285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:57.915285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:57.915285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 17 14:18:57.915285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.Conflict( May 17 14:18:57.915285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 77acf605a2cc4ba4855f3c9af916d010. May 17 14:18:57.915285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:57.915285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 465/940] 10.222.0.48 () {60 vars in 1140 bytes} [Tue May 17 14:18:57 2022] POST /identity/v3/projects => generated 262 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:57.915285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef1a30-eba5-4333-9a68-28a98a2b8f07 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:57.989081 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8144ab8-fe06-4cbd-80cb-8da8398a6e4a None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:58.023889 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791cb0a-bd20-4868-8fd7-f124e28374b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:58.024850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791cb0a-bd20-4868-8fd7-f124e28374b3 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:58.025225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791cb0a-bd20-4868-8fd7-f124e28374b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:58.026120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791cb0a-bd20-4868-8fd7-f124e28374b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:58.031054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef1a30-eba5-4333-9a68-28a98a2b8f07 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:58.037753 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791cb0a-bd20-4868-8fd7-f124e28374b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:58.039320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791cb0a-bd20-4868-8fd7-f124e28374b3 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-8791cb0a-bd20-4868-8fd7-f124e28374b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:18:58.054570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:58.055588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:58.057076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:58.057076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:58.057076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:18:58.057076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:18:58.057076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:18:58.057076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:18:58.057076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:18:58.057076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:18:58.057076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 14:18:58.057076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:58.057076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 476/941] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 14:18:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:58.062477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791cb0a-bd20-4868-8fd7-f124e28374b3 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:58.073386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47c963-7009-45fd-a706-acc827b3c98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:58.074534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47c963-7009-45fd-a706-acc827b3c98d None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:58.075029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47c963-7009-45fd-a706-acc827b3c98d None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:58.075476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47c963-7009-45fd-a706-acc827b3c98d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:58.083083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47c963-7009-45fd-a706-acc827b3c98d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:58.085054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47c963-7009-45fd-a706-acc827b3c98d None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:58.101373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-7f47c963-7009-45fd-a706-acc827b3c98d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:58.101373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:58.101373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:58.101373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:58.101373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:58.101373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:58.101373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:58.101373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:58.101373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:58.101373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:58.101373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:58.101373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:58.101373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:58.101373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:58.101373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:58.102351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:58.103345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:58.103345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:58.103345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:58.103345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:58.103345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:58.103345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:58.103345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:58.103345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:58.105907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 466/942] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:58.111677 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47c963-7009-45fd-a706-acc827b3c98d None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:58.170018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791cb0a-bd20-4868-8fd7-f124e28374b3 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:58.209199 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf16f83-06d2-4a64-a700-2e558377c7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:58.210120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf16f83-06d2-4a64-a700-2e558377c7f3 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:58.210607 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf16f83-06d2-4a64-a700-2e558377c7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:58.211114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf16f83-06d2-4a64-a700-2e558377c7f3 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:58.212217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf16f83-06d2-4a64-a700-2e558377c7f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:58.212728 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf16f83-06d2-4a64-a700-2e558377c7f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:58.214467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf16f83-06d2-4a64-a700-2e558377c7f3 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:58.237764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47c963-7009-45fd-a706-acc827b3c98d None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:58.238152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 477/943] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 17 14:18:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:58.239764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf16f83-06d2-4a64-a700-2e558377c7f3 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:58.283345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde5529-85c2-4762-9ed8-ba1b123c0605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:58.284078 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde5529-85c2-4762-9ed8-ba1b123c0605 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:58.284368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde5529-85c2-4762-9ed8-ba1b123c0605 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:58.284656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde5529-85c2-4762-9ed8-ba1b123c0605 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:58.285832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde5529-85c2-4762-9ed8-ba1b123c0605 None admin] RBAC: Adding query filter params (name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:58.286220 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde5529-85c2-4762-9ed8-ba1b123c0605 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:58.288158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde5529-85c2-4762-9ed8-ba1b123c0605 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:58.322727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 467/944] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 14:18:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:18:58.355493 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf16f83-06d2-4a64-a700-2e558377c7f3 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:58.393311 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb4af2-37ad-495a-b090-21910e188523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:58.394123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb4af2-37ad-495a-b090-21910e188523 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:58.394434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb4af2-37ad-495a-b090-21910e188523 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:58.394706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb4af2-37ad-495a-b090-21910e188523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:58.406414 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb4af2-37ad-495a-b090-21910e188523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:58.407909 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb4af2-37ad-495a-b090-21910e188523 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:58.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-d9cb4af2-37ad-495a-b090-21910e188523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:58.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:58.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:58.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:58.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:58.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:58.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:58.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:58.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:58.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:58.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:58.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:58.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:18:58.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:18:58.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:58.429303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:58.430675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:18:58.430675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:18:58.430675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:18:58.430675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:58.430675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 478/945] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:58.436743 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde5529-85c2-4762-9ed8-ba1b123c0605 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:58.543156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde5529-85c2-4762-9ed8-ba1b123c0605 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:58.579391 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32029c39-1bc2-41a3-9fdd-b3fee337bbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:58.580319 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32029c39-1bc2-41a3-9fdd-b3fee337bbb4 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:58.581008 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32029c39-1bc2-41a3-9fdd-b3fee337bbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:58.581434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32029c39-1bc2-41a3-9fdd-b3fee337bbb4 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:58.582373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32029c39-1bc2-41a3-9fdd-b3fee337bbb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:58.582829 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32029c39-1bc2-41a3-9fdd-b3fee337bbb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:58.584367 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32029c39-1bc2-41a3-9fdd-b3fee337bbb4 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:58.598974 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 468/946] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:58.604855 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb4af2-37ad-495a-b090-21910e188523 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:58.616629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c293f-c9ed-409d-920e-fcf45b2e04b9 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:58.617118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c293f-c9ed-409d-920e-fcf45b2e04b9 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:58.617211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c293f-c9ed-409d-920e-fcf45b2e04b9 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:58.618771 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 469/947] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:18:58.624365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feb019-a0b2-4d66-bf7e-1cdd0af0b8f6 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:58.624647 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feb019-a0b2-4d66-bf7e-1cdd0af0b8f6 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:58.624921 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feb019-a0b2-4d66-bf7e-1cdd0af0b8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:58.643629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-f4feb019-a0b2-4d66-bf7e-1cdd0af0b8f6 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:58.645273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f4feb019-a0b2-4d66-bf7e-1cdd0af0b8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:58.718027 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 470/948] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:18:58.734863 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb4af2-37ad-495a-b090-21910e188523 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:58.744365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4feb019-a0b2-4d66-bf7e-1cdd0af0b8f6 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:58.777479 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa95f1-e066-480e-8944-55827b4fff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:58.778842 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa95f1-e066-480e-8944-55827b4fff8d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:58.780078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa95f1-e066-480e-8944-55827b4fff8d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:58.780557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa95f1-e066-480e-8944-55827b4fff8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:58.789314 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa95f1-e066-480e-8944-55827b4fff8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:58.791741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa95f1-e066-480e-8944-55827b4fff8d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:58.810123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-38aa95f1-e066-480e-8944-55827b4fff8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:58.810123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:58.810123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:58.810123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:58.810123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:58.810123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:58.810123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:58.810123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:58.810123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:58.810123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:58.810123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:58.810123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:58.810123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:18:58.810123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:18:58.810123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:58.811040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:58.811920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:18:58.811920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:18:58.811920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:18:58.811920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:18:58.811920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:18:58.811920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:18:58.811920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:18:58.811920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:58.814773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 479/949] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:58.823150 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa95f1-e066-480e-8944-55827b4fff8d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:58.848672 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4feb019-a0b2-4d66-bf7e-1cdd0af0b8f6 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:58.884763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6e17a-c5b9-4f4a-8fed-eed1b0a647db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:58.886565 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6e17a-c5b9-4f4a-8fed-eed1b0a647db None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:58.887078 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6e17a-c5b9-4f4a-8fed-eed1b0a647db None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:58.887564 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6e17a-c5b9-4f4a-8fed-eed1b0a647db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:58.888419 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6e17a-c5b9-4f4a-8fed-eed1b0a647db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:58.889995 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6e17a-c5b9-4f4a-8fed-eed1b0a647db None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-e8d6e17a-c5b9-4f4a-8fed-eed1b0a647db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:58.902880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:58.903925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:58.904755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:58.904755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:18:58.904755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:58.904755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:58.904755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:58.904755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:58.904755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:58.904755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:58.904755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:58.904755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:58.904755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:58.904755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:58.904755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 14:18:58.904755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:18:58.907611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 471/950] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 14:18:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:18:58.914212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6e17a-c5b9-4f4a-8fed-eed1b0a647db None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:58.924727 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa95f1-e066-480e-8944-55827b4fff8d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:58.959698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a0e4e-7d0d-46db-9c1f-542d976ea2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:58.960706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a0e4e-7d0d-46db-9c1f-542d976ea2d9 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:58.961204 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a0e4e-7d0d-46db-9c1f-542d976ea2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:58.961698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a0e4e-7d0d-46db-9c1f-542d976ea2d9 None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:58.962708 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a0e4e-7d0d-46db-9c1f-542d976ea2d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:58.963263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a0e4e-7d0d-46db-9c1f-542d976ea2d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:58.964894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a0e4e-7d0d-46db-9c1f-542d976ea2d9 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:58.977609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 480/951] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:18:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:58.984290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a0e4e-7d0d-46db-9c1f-542d976ea2d9 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:59.029150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6e17a-c5b9-4f4a-8fed-eed1b0a647db None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:59.071532 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acb91b-b5da-43b5-a47f-c2fec9bfb99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:59.073207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acb91b-b5da-43b5-a47f-c2fec9bfb99c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:59.074118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acb91b-b5da-43b5-a47f-c2fec9bfb99c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:59.074649 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acb91b-b5da-43b5-a47f-c2fec9bfb99c None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:59.075803 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acb91b-b5da-43b5-a47f-c2fec9bfb99c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:59.076465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acb91b-b5da-43b5-a47f-c2fec9bfb99c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:59.078682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acb91b-b5da-43b5-a47f-c2fec9bfb99c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:59.085561 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a0e4e-7d0d-46db-9c1f-542d976ea2d9 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:59.090715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 472/952] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 14:18:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:59.092639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acb91b-b5da-43b5-a47f-c2fec9bfb99c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:59.124577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610400a-c0f1-4bfb-9a10-61662d0ff22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:59.125295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610400a-c0f1-4bfb-9a10-61662d0ff22b None admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:59.125584 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610400a-c0f1-4bfb-9a10-61662d0ff22b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:59.125863 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610400a-c0f1-4bfb-9a10-61662d0ff22b None admin] PATH_INFO: `/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/ba800a3364ee46f395d040f7eb8f775f/roles/a00f17971455442b93c3cd2f40b9daad` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:59.128304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610400a-c0f1-4bfb-9a10-61662d0ff22b None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac7d1119033458393ad6f78fc0df7a3, user_id=ba800a3364ee46f395d040f7eb8f775f, role_id=a00f17971455442b93c3cd2f40b9daad)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:59.129835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610400a-c0f1-4bfb-9a10-61662d0ff22b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:59.150262 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 481/953] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:18:58 2022] PUT /identity/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/ba800a3364ee46f395d040f7eb8f775f/roles/a00f17971455442b93c3cd2f40b9daad => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:18:59.225250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acb91b-b5da-43b5-a47f-c2fec9bfb99c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:59.274142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb457a-4d78-4b4e-baa9-0989a247b174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:59.275428 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb457a-4d78-4b4e-baa9-0989a247b174 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:59.275932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb457a-4d78-4b4e-baa9-0989a247b174 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:59.276478 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb457a-4d78-4b4e-baa9-0989a247b174 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:59.277443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb457a-4d78-4b4e-baa9-0989a247b174 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:59.277953 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb457a-4d78-4b4e-baa9-0989a247b174 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:59.279596 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb457a-4d78-4b4e-baa9-0989a247b174 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:59.285880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 473/954] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 14:18:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:59.292261 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610400a-c0f1-4bfb-9a10-61662d0ff22b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:59.397591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610400a-c0f1-4bfb-9a10-61662d0ff22b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:59.433153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426487f-107d-4588-97c4-14c1975bcbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:59.434053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426487f-107d-4588-97c4-14c1975bcbad None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:59.434508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426487f-107d-4588-97c4-14c1975bcbad None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:59.435010 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426487f-107d-4588-97c4-14c1975bcbad None admin] PATH_INFO: `/v3/endpoints` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:59.435938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426487f-107d-4588-97c4-14c1975bcbad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:59.437434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426487f-107d-4588-97c4-14c1975bcbad None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:59.444809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6576ca-e400-4e30-8c2c-7d4491aebba9 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:59.445104 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6576ca-e400-4e30-8c2c-7d4491aebba9 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:59.445391 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6576ca-e400-4e30-8c2c-7d4491aebba9 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:59.446927 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 474/955] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:18:59.453519 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8e4b0-b746-4a94-88cb-0edc1bba494b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:59.453809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8e4b0-b746-4a94-88cb-0edc1bba494b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:59.454138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8e4b0-b746-4a94-88cb-0edc1bba494b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:59.459234 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 482/956] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 14:18:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:18:59.473874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-6df8e4b0-b746-4a94-88cb-0edc1bba494b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:18:59.478572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6df8e4b0-b746-4a94-88cb-0edc1bba494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:18:59.563777 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 475/957] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:18:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:18:59.586758 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426487f-107d-4588-97c4-14c1975bcbad None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:59.703423 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426487f-107d-4588-97c4-14c1975bcbad None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:59.740615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e99c5-5ab6-4d31-a5f7-38549d08c862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:59.741823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e99c5-5ab6-4d31-a5f7-38549d08c862 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:59.742345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e99c5-5ab6-4d31-a5f7-38549d08c862 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:59.742838 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e99c5-5ab6-4d31-a5f7-38549d08c862 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:59.743703 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e99c5-5ab6-4d31-a5f7-38549d08c862 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:59.746558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e99c5-5ab6-4d31-a5f7-38549d08c862 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-3c5e99c5-5ab6-4d31-a5f7-38549d08c862 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:18:59.758784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:18:59.759773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:18:59.761132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:18:59.761132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:18:59.761132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:18:59.761132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:18:59.761132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:18:59.761132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:18:59.761132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:18:59.761132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:18:59.761132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:18:59.761132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:18:59.761132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:18:59.761132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:18:59.761132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 14:18:59.761132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:18:59.763965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 483/958] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:18:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:18:59.770130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8e4b0-b746-4a94-88cb-0edc1bba494b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:18:59.873867 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8e4b0-b746-4a94-88cb-0edc1bba494b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:18:59.910089 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a918dc2-19e2-462a-98e7-5d6e83e348e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:18:59.911157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a918dc2-19e2-462a-98e7-5d6e83e348e9 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:18:59.911663 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a918dc2-19e2-462a-98e7-5d6e83e348e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:18:59.912138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a918dc2-19e2-462a-98e7-5d6e83e348e9 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:18:59.913050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a918dc2-19e2-462a-98e7-5d6e83e348e9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:18:59.913555 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a918dc2-19e2-462a-98e7-5d6e83e348e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:18:59.915158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a918dc2-19e2-462a-98e7-5d6e83e348e9 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:18:59.921301 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 476/959] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 14:18:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:18:59.927159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e99c5-5ab6-4d31-a5f7-38549d08c862 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:00.033136 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e99c5-5ab6-4d31-a5f7-38549d08c862 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:00.068642 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3218c-3cd6-4985-8798-9741abacdff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:00.069681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3218c-3cd6-4985-8798-9741abacdff7 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:00.070214 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3218c-3cd6-4985-8798-9741abacdff7 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:00.070711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3218c-3cd6-4985-8798-9741abacdff7 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:00.071632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3218c-3cd6-4985-8798-9741abacdff7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:00.072209 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3218c-3cd6-4985-8798-9741abacdff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:00.074478 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3218c-3cd6-4985-8798-9741abacdff7 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:00.079868 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 484/960] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 14:18:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:00.736384 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46696348-6aa1-48f1-bb9d-b32c0845c749 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:00.737087 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46696348-6aa1-48f1-bb9d-b32c0845c749 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:00.737594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46696348-6aa1-48f1-bb9d-b32c0845c749 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:00.739480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 477/961] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:00.745986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f827c-3a74-4c7e-886c-84c651fb3b8d None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:00.746879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f827c-3a74-4c7e-886c-84c651fb3b8d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:00.747383 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f827c-3a74-4c7e-886c-84c651fb3b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:00.765426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-657f827c-3a74-4c7e-886c-84c651fb3b8d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:00.766965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-657f827c-3a74-4c7e-886c-84c651fb3b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:00.838563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 485/962] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:00.863996 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46696348-6aa1-48f1-bb9d-b32c0845c749 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:00.972504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46696348-6aa1-48f1-bb9d-b32c0845c749 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:01.008936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8ef0f-8814-429e-8428-2d5be029e876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:01.010857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8ef0f-8814-429e-8428-2d5be029e876 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:01.011348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8ef0f-8814-429e-8428-2d5be029e876 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:01.011840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8ef0f-8814-429e-8428-2d5be029e876 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:01.012770 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8ef0f-8814-429e-8428-2d5be029e876 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:01.014416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8ef0f-8814-429e-8428-2d5be029e876 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:01.028855 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.sql.core [None req-fec8ef0f-8814-429e-8428-2d5be029e876 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 14:19:01.028855 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 17 14:19:01.028855 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [parameters: {'user_id': '3c4cc4c9f123497191066e309f60ff87', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 17 14:19:01.028855 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79878) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 14:19:01.037051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-fec8ef0f-8814-429e-8428-2d5be029e876 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 17 14:19:01.037051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:01.037051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 14:19:01.037051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 14:19:01.037051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 14:19:01.037051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 14:19:01.037051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 14:19:01.037051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application result = self._query(query) May 17 14:19:01.037051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 14:19:01.037051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application conn.query(q) May 17 14:19:01.037051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 14:19:01.037051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 14:19:01.037051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 14:19:01.037051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application result.read() May 17 14:19:01.037051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 14:19:01.037909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application next(self.gen) May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application yield resource May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application next(self.gen) May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self.session.rollback() May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self.force_reraise() May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise self.value May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application session.commit() May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 14:19:01.038876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._prepare_impl() May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self.session.flush() May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._flush(objects) May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application compat.raise_( May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application flush_context.execute() May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rec.execute(self) May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 14:19:01.039780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application result = connection._execute_20( May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 14:19:01.040671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application result = self._query(query) May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application conn.query(q) May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application result.read() May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 14:19:01.042951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 14:19:01.043796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 14:19:01.043796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 14:19:01.043796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 14:19:01.043796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 14:19:01.043796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 14:19:01.043796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 17 14:19:01.043796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [parameters: {'user_id': '3c4cc4c9f123497191066e309f60ff87', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 17 14:19:01.043796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 14:19:01.043796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:01.043796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:19:01.043796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:01.043796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:01.043796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:01.043796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:01.043796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 17 14:19:01.044598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 17 14:19:01.046605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 17 14:19:01.046605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 17 14:19:01.046605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 14:19:01.046605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 14:19:01.046605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 17 14:19:01.046605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:01.049019 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 478/963] 10.222.0.48 () {60 vars in 1131 bytes} [Tue May 17 14:19:00 2022] POST /identity/v3/users => generated 160 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:01.054951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f827c-3a74-4c7e-886c-84c651fb3b8d None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:01.161060 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f827c-3a74-4c7e-886c-84c651fb3b8d None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:01.204524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba243ab9-7abd-4f5c-8aa6-abd1f6dc3e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:01.205883 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243ab9-7abd-4f5c-8aa6-abd1f6dc3e6e None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:01.206431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243ab9-7abd-4f5c-8aa6-abd1f6dc3e6e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:01.206929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243ab9-7abd-4f5c-8aa6-abd1f6dc3e6e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:01.216145 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba243ab9-7abd-4f5c-8aa6-abd1f6dc3e6e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:01.217851 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba243ab9-7abd-4f5c-8aa6-abd1f6dc3e6e None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-ba243ab9-7abd-4f5c-8aa6-abd1f6dc3e6e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:19:01.232814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:01.233776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:01.234767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:01.234767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:01.234767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:19:01.234767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:19:01.234767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:19:01.234767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:19:01.234767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:19:01.234767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:19:01.234767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 14:19:01.234767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:01.237355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 486/964] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:19:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:01.243497 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8ef0f-8814-429e-8428-2d5be029e876 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:01.355973 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8ef0f-8814-429e-8428-2d5be029e876 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:01.390922 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c537685-edb7-4683-be49-2b3770a05c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:01.391979 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c537685-edb7-4683-be49-2b3770a05c34 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:01.392490 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c537685-edb7-4683-be49-2b3770a05c34 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:01.392991 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c537685-edb7-4683-be49-2b3770a05c34 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:01.394000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c537685-edb7-4683-be49-2b3770a05c34 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:01.394536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c537685-edb7-4683-be49-2b3770a05c34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:01.396438 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c537685-edb7-4683-be49-2b3770a05c34 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:01.436089 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 479/965] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 17 14:19:01 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:01.479202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3186204-bb74-4c28-83e4-85318d88d2c7 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:01.479761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3186204-bb74-4c28-83e4-85318d88d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:01.480098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3186204-bb74-4c28-83e4-85318d88d2c7 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:01.481846 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 487/966] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:01.487684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df25b-94ad-40cc-98e9-1da09308c031 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:01.488272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df25b-94ad-40cc-98e9-1da09308c031 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:01.488771 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df25b-94ad-40cc-98e9-1da09308c031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:01.507551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-627df25b-94ad-40cc-98e9-1da09308c031 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:01.509496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-627df25b-94ad-40cc-98e9-1da09308c031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:01.587439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 480/967] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:19:01.611935 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3186204-bb74-4c28-83e4-85318d88d2c7 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:01.722830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3186204-bb74-4c28-83e4-85318d88d2c7 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:01.758603 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614eb027-cfaa-4e85-92a1-c6c6aab2434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:01.759478 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614eb027-cfaa-4e85-92a1-c6c6aab2434e None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:01.760348 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614eb027-cfaa-4e85-92a1-c6c6aab2434e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:01.760628 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614eb027-cfaa-4e85-92a1-c6c6aab2434e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:01.771616 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614eb027-cfaa-4e85-92a1-c6c6aab2434e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-614eb027-cfaa-4e85-92a1-c6c6aab2434e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:19:01.780320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:01.781245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:01.782263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:01.782263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:01.782263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:01.782263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:01.782263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:19:01.782263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:19:01.782263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:19:01.782263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:19:01.782263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:19:01.782263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:19:01.782263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 14:19:01.782263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:01.782263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 488/968] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 17 14:19:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:01.789428 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627df25b-94ad-40cc-98e9-1da09308c031 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:01.800806 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d40ebd-14e2-4776-97e9-284b687eef44 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:01.801090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d40ebd-14e2-4776-97e9-284b687eef44 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:01.801369 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d40ebd-14e2-4776-97e9-284b687eef44 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:01.803010 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 489/969] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:19:01.808606 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283b54d-fa30-4846-830a-a2157903fc46 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:01.808896 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283b54d-fa30-4846-830a-a2157903fc46 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:01.809179 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283b54d-fa30-4846-830a-a2157903fc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:01.826873 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-4283b54d-fa30-4846-830a-a2157903fc46 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:01.828054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-4283b54d-fa30-4846-830a-a2157903fc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:01.894367 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 490/970] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:01.894826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627df25b-94ad-40cc-98e9-1da09308c031 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:01.917281 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283b54d-fa30-4846-830a-a2157903fc46 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:01.928383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537971a-cff1-45cb-a035-c5c278cd6e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:01.929060 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537971a-cff1-45cb-a035-c5c278cd6e3d None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:01.929348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537971a-cff1-45cb-a035-c5c278cd6e3d None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:01.929626 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537971a-cff1-45cb-a035-c5c278cd6e3d None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:01.930405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537971a-cff1-45cb-a035-c5c278cd6e3d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:01.930713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537971a-cff1-45cb-a035-c5c278cd6e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:01.932427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537971a-cff1-45cb-a035-c5c278cd6e3d None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:01.940643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 481/971] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 17 14:19:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:01.946473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537971a-cff1-45cb-a035-c5c278cd6e3d None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:02.021036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283b54d-fa30-4846-830a-a2157903fc46 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:02.061936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537971a-cff1-45cb-a035-c5c278cd6e3d None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:02.064711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd702e63-7937-4f1d-8ebd-8c7ee749c11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:02.065584 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd702e63-7937-4f1d-8ebd-8c7ee749c11e None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:02.065865 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd702e63-7937-4f1d-8ebd-8c7ee749c11e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:02.066134 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd702e63-7937-4f1d-8ebd-8c7ee749c11e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:02.066816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd702e63-7937-4f1d-8ebd-8c7ee749c11e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:02.068492 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd702e63-7937-4f1d-8ebd-8c7ee749c11e None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-fd702e63-7937-4f1d-8ebd-8c7ee749c11e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:02.080789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:02.081929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:02.082927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:02.082927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:02.082927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:02.082927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:02.082927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:02.082927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:02.082927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:02.082927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:02.082927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:02.082927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:02.082927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:19:02.082927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:19:02.082927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 14:19:02.082927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:02.082927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 491/972] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 14:19:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:02.087825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd702e63-7937-4f1d-8ebd-8c7ee749c11e None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:02.102260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67d397-7674-4914-b391-9a4f192d6678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:02.103775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67d397-7674-4914-b391-9a4f192d6678 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:02.104296 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67d397-7674-4914-b391-9a4f192d6678 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:02.104572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67d397-7674-4914-b391-9a4f192d6678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:02.114792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67d397-7674-4914-b391-9a4f192d6678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:02.116290 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67d397-7674-4914-b391-9a4f192d6678 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:02.133448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-1c67d397-7674-4914-b391-9a4f192d6678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:02.133448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:02.133448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:02.133448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:02.133448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:02.133448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:02.133448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:02.133448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:02.133448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:02.133448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:02.133448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:02.133448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:02.133448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:19:02.133448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:19:02.133448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:02.134418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:02.135482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:19:02.135482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:19:02.135482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:02.135482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:02.135482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 482/973] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:02.140103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67d397-7674-4914-b391-9a4f192d6678 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:02.204043 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd702e63-7937-4f1d-8ebd-8c7ee749c11e None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:02.243972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7da6cb-e065-4277-bd28-f12f5d6963aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:02.245568 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7da6cb-e065-4277-bd28-f12f5d6963aa None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:02.246045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7da6cb-e065-4277-bd28-f12f5d6963aa None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:02.246611 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7da6cb-e065-4277-bd28-f12f5d6963aa None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:02.247844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7da6cb-e065-4277-bd28-f12f5d6963aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:02.248360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7da6cb-e065-4277-bd28-f12f5d6963aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:02.250294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7da6cb-e065-4277-bd28-f12f5d6963aa None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:02.255728 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 492/974] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 14:19:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:02.262062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7da6cb-e065-4277-bd28-f12f5d6963aa None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:02.270908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67d397-7674-4914-b391-9a4f192d6678 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:02.321942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4e299-c6ad-4d57-90ba-78465eb5fa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:02.322912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4e299-c6ad-4d57-90ba-78465eb5fa26 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:02.323281 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4e299-c6ad-4d57-90ba-78465eb5fa26 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:02.323546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4e299-c6ad-4d57-90ba-78465eb5fa26 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:02.324198 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4e299-c6ad-4d57-90ba-78465eb5fa26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:02.324551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4e299-c6ad-4d57-90ba-78465eb5fa26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:02.325906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4e299-c6ad-4d57-90ba-78465eb5fa26 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:02.339613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 483/975] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:02.345263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4e299-c6ad-4d57-90ba-78465eb5fa26 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:02.378480 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7da6cb-e065-4277-bd28-f12f5d6963aa None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:02.414077 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7172591-c82c-47b3-a158-65431ca47126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:02.414784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7172591-c82c-47b3-a158-65431ca47126 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:02.415060 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7172591-c82c-47b3-a158-65431ca47126 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:02.415334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7172591-c82c-47b3-a158-65431ca47126 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:02.416671 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7172591-c82c-47b3-a158-65431ca47126 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:02.417056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7172591-c82c-47b3-a158-65431ca47126 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:02.418646 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7172591-c82c-47b3-a158-65431ca47126 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:02.423334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 493/976] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 14:19:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:02.424584 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631f6b7-6922-46cf-adbc-688622284f32 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:02.424872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631f6b7-6922-46cf-adbc-688622284f32 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:02.425146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631f6b7-6922-46cf-adbc-688622284f32 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:02.430364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 494/977] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:02.431643 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631f6b7-6922-46cf-adbc-688622284f32 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:02.460093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4e299-c6ad-4d57-90ba-78465eb5fa26 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:02.499864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b455c-c1c2-41b1-b85f-c9acccc3ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:02.500676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b455c-c1c2-41b1-b85f-c9acccc3ad06 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:02.500960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b455c-c1c2-41b1-b85f-c9acccc3ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:02.501235 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b455c-c1c2-41b1-b85f-c9acccc3ad06 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:02.510719 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b455c-c1c2-41b1-b85f-c9acccc3ad06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:02.512185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b455c-c1c2-41b1-b85f-c9acccc3ad06 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-155b455c-c1c2-41b1-b85f-c9acccc3ad06 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:19:02.529348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:02.530634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:02.531764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:02.531764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:02.531764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:19:02.531764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:19:02.531764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:19:02.531764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:19:02.531764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:19:02.531764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:19:02.531764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 14:19:02.531764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:02.531764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 484/978] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 14:19:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:02.531764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dbaec-10c9-485d-81a1-e15f8fedc3c4 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:02.532447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dbaec-10c9-485d-81a1-e15f8fedc3c4 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:02.532447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dbaec-10c9-485d-81a1-e15f8fedc3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:02.542147 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631f6b7-6922-46cf-adbc-688622284f32 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:02.548981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7a4dbaec-10c9-485d-81a1-e15f8fedc3c4 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:02.550459 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7a4dbaec-10c9-485d-81a1-e15f8fedc3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:02.576814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b883f1-c36e-4c62-a226-e67f5cc9faa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:02.577473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b883f1-c36e-4c62-a226-e67f5cc9faa6 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:02.577753 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b883f1-c36e-4c62-a226-e67f5cc9faa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:02.578029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b883f1-c36e-4c62-a226-e67f5cc9faa6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:02.578861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b883f1-c36e-4c62-a226-e67f5cc9faa6 None admin] RBAC: Adding query filter params (interface=admin, service_id=a13a97e7f6d44791b5ff62cbd66d1eee, region_id=RegionOne) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:02.579174 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b883f1-c36e-4c62-a226-e67f5cc9faa6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:02.580830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b883f1-c36e-4c62-a226-e67f5cc9faa6 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:02.585945 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 495/979] 10.222.0.48 () {56 vars in 1249 bytes} [Tue May 17 14:19:02 2022] GET /identity/v3/endpoints?service_id=a13a97e7f6d44791b5ff62cbd66d1eee&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:02.586770 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b883f1-c36e-4c62-a226-e67f5cc9faa6 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:02.623138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 485/980] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:02.623995 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dbaec-10c9-485d-81a1-e15f8fedc3c4 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:02.690127 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b883f1-c36e-4c62-a226-e67f5cc9faa6 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:02.725944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e355349-a559-41ad-b97d-a8e9cc3ccb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:02.726552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e355349-a559-41ad-b97d-a8e9cc3ccb72 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:02.726833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e355349-a559-41ad-b97d-a8e9cc3ccb72 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:02.727142 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e355349-a559-41ad-b97d-a8e9cc3ccb72 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:02.727973 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e355349-a559-41ad-b97d-a8e9cc3ccb72 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:02.728474 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e355349-a559-41ad-b97d-a8e9cc3ccb72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:02.730164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e355349-a559-41ad-b97d-a8e9cc3ccb72 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:02.735319 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dbaec-10c9-485d-81a1-e15f8fedc3c4 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:02.750954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 496/981] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 17 14:19:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:02.751781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e355349-a559-41ad-b97d-a8e9cc3ccb72 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:02.777089 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d6238-5cbf-448e-9972-dbfa8caf6467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:02.777752 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d6238-5cbf-448e-9972-dbfa8caf6467 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:02.778031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d6238-5cbf-448e-9972-dbfa8caf6467 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:02.778333 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d6238-5cbf-448e-9972-dbfa8caf6467 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:02.779022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d6238-5cbf-448e-9972-dbfa8caf6467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:02.780430 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d6238-5cbf-448e-9972-dbfa8caf6467 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:02.786649 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 486/982] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 14:19:02 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:19:02.787435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d6238-5cbf-448e-9972-dbfa8caf6467 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:02.862710 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e355349-a559-41ad-b97d-a8e9cc3ccb72 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:02.898261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d6238-5cbf-448e-9972-dbfa8caf6467 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:02.903405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa9192-3557-42aa-9e06-feedf3e7f5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:02.904096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa9192-3557-42aa-9e06-feedf3e7f5f9 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:02.904378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa9192-3557-42aa-9e06-feedf3e7f5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:02.904649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa9192-3557-42aa-9e06-feedf3e7f5f9 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:02.905384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa9192-3557-42aa-9e06-feedf3e7f5f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:02.906799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa9192-3557-42aa-9e06-feedf3e7f5f9 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:02.922095 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 497/983] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 14:19:02 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:19:02.946775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd03f5c-bead-408e-a702-d9798e0df4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:02.948823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd03f5c-bead-408e-a702-d9798e0df4e3 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:02.949349 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd03f5c-bead-408e-a702-d9798e0df4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:02.949855 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd03f5c-bead-408e-a702-d9798e0df4e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:03.034579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd03f5c-bead-408e-a702-d9798e0df4e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:03.036422 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd03f5c-bead-408e-a702-d9798e0df4e3 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:03.145027 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 487/984] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:19:02 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:19:03.151414 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa9192-3557-42aa-9e06-feedf3e7f5f9 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:03.255790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa9192-3557-42aa-9e06-feedf3e7f5f9 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:03.288642 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d6602-de36-4373-ad3c-78ddcd55284d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:03.289359 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d6602-de36-4373-ad3c-78ddcd55284d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:03.289643 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d6602-de36-4373-ad3c-78ddcd55284d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:03.289919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d6602-de36-4373-ad3c-78ddcd55284d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:03.300320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d6602-de36-4373-ad3c-78ddcd55284d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:03.301774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d6602-de36-4373-ad3c-78ddcd55284d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:03.318796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-f65d6602-de36-4373-ad3c-78ddcd55284d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:03.318796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:03.318796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:03.318796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:03.318796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:03.318796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:03.318796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:03.318796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:03.318796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:03.318796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:03.318796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:03.318796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:03.318796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:19:03.318796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:19:03.318796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:03.319731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:03.320631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:19:03.320631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:19:03.320631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:03.320631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:03.320631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 498/985] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:03.325866 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd03f5c-bead-408e-a702-d9798e0df4e3 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:03.424660 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd03f5c-bead-408e-a702-d9798e0df4e3 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:03.457555 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffd47b-f020-405a-b1c1-6803b9a8fa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:03.458312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffd47b-f020-405a-b1c1-6803b9a8fa96 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:03.458609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffd47b-f020-405a-b1c1-6803b9a8fa96 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:03.458864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffd47b-f020-405a-b1c1-6803b9a8fa96 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:03.459584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffd47b-f020-405a-b1c1-6803b9a8fa96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:03.459886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffd47b-f020-405a-b1c1-6803b9a8fa96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:03.461255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffd47b-f020-405a-b1c1-6803b9a8fa96 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:03.477589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 488/986] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:03.479902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d6602-de36-4373-ad3c-78ddcd55284d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:03.578712 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d6602-de36-4373-ad3c-78ddcd55284d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:03.611015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f65899-8200-4bfe-96fe-39627d407a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:03.611799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f65899-8200-4bfe-96fe-39627d407a67 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:03.612074 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f65899-8200-4bfe-96fe-39627d407a67 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:03.612345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f65899-8200-4bfe-96fe-39627d407a67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:03.618813 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f65899-8200-4bfe-96fe-39627d407a67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:03.620524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f65899-8200-4bfe-96fe-39627d407a67 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:03.634245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-58f65899-8200-4bfe-96fe-39627d407a67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:19:03.634245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:03.634245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:03.634245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:03.634245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:03.634245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:03.634245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:03.634245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:03.634245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:03.634245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:03.634245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:03.634245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:03.634245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:19:03.634245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:19:03.634245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:03.636040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:03.638041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:19:03.638041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:19:03.638041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:19:03.638041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:19:03.638041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:19:03.638041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:19:03.638041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:19:03.638041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:03.638041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 499/987] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:19:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:03.641657 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffd47b-f020-405a-b1c1-6803b9a8fa96 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:03.746949 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffd47b-f020-405a-b1c1-6803b9a8fa96 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:03.779954 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde3e1b-9102-47a5-81ee-dab2624e825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:03.780625 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde3e1b-9102-47a5-81ee-dab2624e825f None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:03.780907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde3e1b-9102-47a5-81ee-dab2624e825f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:03.781186 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde3e1b-9102-47a5-81ee-dab2624e825f None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:03.781978 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde3e1b-9102-47a5-81ee-dab2624e825f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:03.782322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde3e1b-9102-47a5-81ee-dab2624e825f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:03.783766 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde3e1b-9102-47a5-81ee-dab2624e825f None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:03.796445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 489/988] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:19:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:03.802093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f65899-8200-4bfe-96fe-39627d407a67 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:03.899385 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f65899-8200-4bfe-96fe-39627d407a67 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:03.931972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32302c9-6e1d-4a74-8f50-bf50b7fcba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:03.932622 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32302c9-6e1d-4a74-8f50-bf50b7fcba3a None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:03.932904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32302c9-6e1d-4a74-8f50-bf50b7fcba3a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:03.933179 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32302c9-6e1d-4a74-8f50-bf50b7fcba3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:03.934005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32302c9-6e1d-4a74-8f50-bf50b7fcba3a None admin] RBAC: Adding query filter params (role.id=a00f17971455442b93c3cd2f40b9daad, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=ba800a3364ee46f395d040f7eb8f775f) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:03.934346 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32302c9-6e1d-4a74-8f50-bf50b7fcba3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:03.935781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32302c9-6e1d-4a74-8f50-bf50b7fcba3a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:03.950256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 500/989] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:19:03 2022] GET /identity/v3/role_assignments?user.id=ba800a3364ee46f395d040f7eb8f775f&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=a00f17971455442b93c3cd2f40b9daad => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:05.155314 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d0f68-f351-480f-bb66-8dfa19a06998 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:05.155826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d0f68-f351-480f-bb66-8dfa19a06998 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:05.156144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d0f68-f351-480f-bb66-8dfa19a06998 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:05.158414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 490/990] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:05.163979 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17f146-e97f-4397-8f2a-37f92c3a4f33 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:05.164412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17f146-e97f-4397-8f2a-37f92c3a4f33 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:05.164609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17f146-e97f-4397-8f2a-37f92c3a4f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:05.182276 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-1e17f146-e97f-4397-8f2a-37f92c3a4f33 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:05.183469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-1e17f146-e97f-4397-8f2a-37f92c3a4f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:05.233527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dc37c-d1ec-4456-a43b-a14aebf91e88 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:05.233840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dc37c-d1ec-4456-a43b-a14aebf91e88 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:05.234080 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dc37c-d1ec-4456-a43b-a14aebf91e88 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:05.238224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 491/991] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:19:05.240592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc41836-afa7-46b5-9736-9e57d42c5a2a None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:05.240880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc41836-afa7-46b5-9736-9e57d42c5a2a None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:05.241153 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc41836-afa7-46b5-9736-9e57d42c5a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:05.252801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 501/992] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:05.257598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-bfc41836-afa7-46b5-9736-9e57d42c5a2a None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:05.258896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bfc41836-afa7-46b5-9736-9e57d42c5a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:05.275871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17f146-e97f-4397-8f2a-37f92c3a4f33 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:05.326791 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 492/993] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:19:05.350076 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc41836-afa7-46b5-9736-9e57d42c5a2a None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:05.371745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17f146-e97f-4397-8f2a-37f92c3a4f33 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:05.405780 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dace754-c1f3-43cf-ac8d-d825b8577734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:05.406651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dace754-c1f3-43cf-ac8d-d825b8577734 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:05.406938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dace754-c1f3-43cf-ac8d-d825b8577734 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:05.407213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dace754-c1f3-43cf-ac8d-d825b8577734 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:05.407867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dace754-c1f3-43cf-ac8d-d825b8577734 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:05.409243 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dace754-c1f3-43cf-ac8d-d825b8577734 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-1dace754-c1f3-43cf-ac8d-d825b8577734 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:05.421549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:05.422552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:05.428745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:05.428745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:05.428745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:05.428745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:05.428745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:05.428745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:05.428745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:05.428745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:05.428745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:05.428745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:05.428745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:19:05.428745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:19:05.428745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 14:19:05.428745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:05.428745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 502/994] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 17 14:19:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:05.430149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dace754-c1f3-43cf-ac8d-d825b8577734 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:05.453386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc41836-afa7-46b5-9736-9e57d42c5a2a None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:05.487185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e8d46-18ea-406c-9564-74bcd05db2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:05.487992 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e8d46-18ea-406c-9564-74bcd05db2bc None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:05.488276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e8d46-18ea-406c-9564-74bcd05db2bc None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:05.488729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e8d46-18ea-406c-9564-74bcd05db2bc None admin] PATH_INFO: `/v3/services/compute` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:05.489389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e8d46-18ea-406c-9564-74bcd05db2bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:05.490801 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e8d46-18ea-406c-9564-74bcd05db2bc None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-971e8d46-18ea-406c-9564-74bcd05db2bc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:05.503683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:05.505041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:05.506165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:05.506165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:05.506165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:05.506165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:05.506165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:05.506165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:05.506165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:05.506165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:05.506165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:05.506165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:05.506165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:19:05.506165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:19:05.506165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 14:19:05.506165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:05.510511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 493/995] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:19:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:05.512756 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e8d46-18ea-406c-9564-74bcd05db2bc None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:05.534121 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dace754-c1f3-43cf-ac8d-d825b8577734 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:05.567769 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f27fb-f64e-480a-a1f8-15f8b37e498a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:05.568797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f27fb-f64e-480a-a1f8-15f8b37e498a None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:05.569296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f27fb-f64e-480a-a1f8-15f8b37e498a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:05.569669 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f27fb-f64e-480a-a1f8-15f8b37e498a None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:05.570416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f27fb-f64e-480a-a1f8-15f8b37e498a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:05.570724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f27fb-f64e-480a-a1f8-15f8b37e498a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:05.572590 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f27fb-f64e-480a-a1f8-15f8b37e498a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:05.582119 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 503/996] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 14:19:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:05.583498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f27fb-f64e-480a-a1f8-15f8b37e498a None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:05.612633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e8d46-18ea-406c-9564-74bcd05db2bc None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:05.647394 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b332a4e-0d2a-482a-a8da-40c528cf869a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:05.648065 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b332a4e-0d2a-482a-a8da-40c528cf869a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:05.648351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b332a4e-0d2a-482a-a8da-40c528cf869a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:05.648629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b332a4e-0d2a-482a-a8da-40c528cf869a None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:05.649340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b332a4e-0d2a-482a-a8da-40c528cf869a None admin] RBAC: Adding query filter params (name=compute) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:05.649647 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b332a4e-0d2a-482a-a8da-40c528cf869a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:05.651262 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b332a4e-0d2a-482a-a8da-40c528cf869a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:05.657527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 494/997] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 14:19:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:05.662852 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b332a4e-0d2a-482a-a8da-40c528cf869a None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:05.686694 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f27fb-f64e-480a-a1f8-15f8b37e498a None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:05.721027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744eb9a4-4a12-417a-9a83-8e914f62e8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:05.721941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744eb9a4-4a12-417a-9a83-8e914f62e8ea None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:05.722260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744eb9a4-4a12-417a-9a83-8e914f62e8ea None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:05.722533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744eb9a4-4a12-417a-9a83-8e914f62e8ea None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:05.723493 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744eb9a4-4a12-417a-9a83-8e914f62e8ea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:05.723795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744eb9a4-4a12-417a-9a83-8e914f62e8ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:05.725157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744eb9a4-4a12-417a-9a83-8e914f62e8ea None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:05.731172 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 504/998] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 17 14:19:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:05.736775 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744eb9a4-4a12-417a-9a83-8e914f62e8ea None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:05.764936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b332a4e-0d2a-482a-a8da-40c528cf869a None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:05.798951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33cfd0-697d-4b86-8cbf-fa0813eedb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:05.799617 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33cfd0-697d-4b86-8cbf-fa0813eedb80 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:05.799897 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33cfd0-697d-4b86-8cbf-fa0813eedb80 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:05.800167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33cfd0-697d-4b86-8cbf-fa0813eedb80 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:05.801023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33cfd0-697d-4b86-8cbf-fa0813eedb80 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:05.801329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33cfd0-697d-4b86-8cbf-fa0813eedb80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:05.802721 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33cfd0-697d-4b86-8cbf-fa0813eedb80 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:05.812158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 495/999] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 14:19:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:05.813141 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33cfd0-697d-4b86-8cbf-fa0813eedb80 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:05.839047 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744eb9a4-4a12-417a-9a83-8e914f62e8ea None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:05.873259 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143d2e4-bb6a-4615-8600-35f0cc29045b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:05.874198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d2e4-bb6a-4615-8600-35f0cc29045b None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:05.874507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d2e4-bb6a-4615-8600-35f0cc29045b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:05.874786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d2e4-bb6a-4615-8600-35f0cc29045b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:05.875529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143d2e4-bb6a-4615-8600-35f0cc29045b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:05.876904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143d2e4-bb6a-4615-8600-35f0cc29045b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:05.892089 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 505/1000] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 14:19:05 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:19:05.914121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33cfd0-697d-4b86-8cbf-fa0813eedb80 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:05.957527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de12f11-07d4-479d-95ce-89f22e55857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:05.958245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de12f11-07d4-479d-95ce-89f22e55857b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:05.958541 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de12f11-07d4-479d-95ce-89f22e55857b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:05.958819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de12f11-07d4-479d-95ce-89f22e55857b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:05.959632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de12f11-07d4-479d-95ce-89f22e55857b None admin] RBAC: Adding query filter params (interface=public, service_id=bddddf0cf2734962a05da21cf46f051c, region_id=RegionOne) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:05.959946 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de12f11-07d4-479d-95ce-89f22e55857b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:05.961385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de12f11-07d4-479d-95ce-89f22e55857b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:05.967535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 496/1001] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 14:19:05 2022] GET /identity/v3/endpoints?service_id=bddddf0cf2734962a05da21cf46f051c&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:05.973205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143d2e4-bb6a-4615-8600-35f0cc29045b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:06.086351 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143d2e4-bb6a-4615-8600-35f0cc29045b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:06.121977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc50f9-c6d0-4f47-95d5-400f0422cc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:06.122685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc50f9-c6d0-4f47-95d5-400f0422cc73 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:06.122974 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc50f9-c6d0-4f47-95d5-400f0422cc73 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:06.123254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc50f9-c6d0-4f47-95d5-400f0422cc73 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:06.123941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc50f9-c6d0-4f47-95d5-400f0422cc73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:06.125323 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc50f9-c6d0-4f47-95d5-400f0422cc73 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:06.131944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 506/1002] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 14:19:05 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:19:06.244641 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71bcd6-8f44-4d48-841d-bd296a3614c3 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:06.245174 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71bcd6-8f44-4d48-841d-bd296a3614c3 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:06.245174 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71bcd6-8f44-4d48-841d-bd296a3614c3 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:06.246799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 497/1003] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:06.253611 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad224a-4879-4779-a958-58f8ae87b297 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:06.254109 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad224a-4879-4779-a958-58f8ae87b297 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:06.254363 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad224a-4879-4779-a958-58f8ae87b297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:06.272428 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-48ad224a-4879-4779-a958-58f8ae87b297 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:06.273648 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-48ad224a-4879-4779-a958-58f8ae87b297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:06.344561 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 507/1004] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:06.366650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71bcd6-8f44-4d48-841d-bd296a3614c3 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:06.468297 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71bcd6-8f44-4d48-841d-bd296a3614c3 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:06.501855 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf697ab-24f3-4ee3-822c-b18a0d4999bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:06.502697 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf697ab-24f3-4ee3-822c-b18a0d4999bc None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:06.502984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf697ab-24f3-4ee3-822c-b18a0d4999bc None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:06.503259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf697ab-24f3-4ee3-822c-b18a0d4999bc None admin] PATH_INFO: `/v3/services/image` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:06.503913 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf697ab-24f3-4ee3-822c-b18a0d4999bc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:06.505286 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf697ab-24f3-4ee3-822c-b18a0d4999bc None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-faf697ab-24f3-4ee3-822c-b18a0d4999bc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:06.516886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:06.517924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:06.524190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:06.524190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:06.524190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:06.524190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:06.524190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:06.524190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:06.524190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:06.524190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:06.524190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:06.524190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:06.524190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:19:06.524190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:19:06.524190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 14:19:06.524190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:06.524190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 498/1005] 10.222.0.48 () {56 vars in 1105 bytes} [Tue May 17 14:19:06 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:06.525035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad224a-4879-4779-a958-58f8ae87b297 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:06.620748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad224a-4879-4779-a958-58f8ae87b297 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:06.653613 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64267497-fcc6-46cc-8a52-5b9f5846a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:06.654314 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64267497-fcc6-46cc-8a52-5b9f5846a346 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:06.654601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64267497-fcc6-46cc-8a52-5b9f5846a346 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:06.654881 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64267497-fcc6-46cc-8a52-5b9f5846a346 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:06.655590 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64267497-fcc6-46cc-8a52-5b9f5846a346 None admin] RBAC: Adding query filter params (name=image) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:06.655900 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64267497-fcc6-46cc-8a52-5b9f5846a346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:06.657286 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64267497-fcc6-46cc-8a52-5b9f5846a346 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:06.662429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 508/1006] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:06.668554 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf697ab-24f3-4ee3-822c-b18a0d4999bc None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:06.769219 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf697ab-24f3-4ee3-822c-b18a0d4999bc None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:06.802734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c3969-4b51-4aae-b267-bd76e8907369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:06.803405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c3969-4b51-4aae-b267-bd76e8907369 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:06.803690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c3969-4b51-4aae-b267-bd76e8907369 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:06.803968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c3969-4b51-4aae-b267-bd76e8907369 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:06.804681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c3969-4b51-4aae-b267-bd76e8907369 None admin] RBAC: Adding query filter params (type=image) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:06.804992 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c3969-4b51-4aae-b267-bd76e8907369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:06.806941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c3969-4b51-4aae-b267-bd76e8907369 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:06.811338 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 499/1007] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:08.236379 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46ccd3-1cd2-4b98-a62e-9e84fe9330e4 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:08.236899 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46ccd3-1cd2-4b98-a62e-9e84fe9330e4 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:08.236899 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46ccd3-1cd2-4b98-a62e-9e84fe9330e4 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:08.238537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 509/1008] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:08.244439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc40dfa-d7ff-4e0e-8c51-c07350513ea4 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:08.244943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc40dfa-d7ff-4e0e-8c51-c07350513ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:08.245193 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc40dfa-d7ff-4e0e-8c51-c07350513ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:08.265677 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-efc40dfa-d7ff-4e0e-8c51-c07350513ea4 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:08.266913 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-efc40dfa-d7ff-4e0e-8c51-c07350513ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:08.331056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 500/1009] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:08.354523 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46ccd3-1cd2-4b98-a62e-9e84fe9330e4 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:08.432823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd8d44-8f24-4790-a9f4-dd24d68c5963 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:08.433149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd8d44-8f24-4790-a9f4-dd24d68c5963 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:08.433396 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd8d44-8f24-4790-a9f4-dd24d68c5963 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:08.434930 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 501/1010] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:19:08.439858 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ebfdc-17d5-45d3-92ee-f0e852d8cc02 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:08.440148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ebfdc-17d5-45d3-92ee-f0e852d8cc02 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:08.440427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ebfdc-17d5-45d3-92ee-f0e852d8cc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:08.452351 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46ccd3-1cd2-4b98-a62e-9e84fe9330e4 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:08.457527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-a38ebfdc-17d5-45d3-92ee-f0e852d8cc02 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:08.458734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a38ebfdc-17d5-45d3-92ee-f0e852d8cc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:08.485880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad3f8a-05c1-4890-8987-300e715c9b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:08.486715 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad3f8a-05c1-4890-8987-300e715c9b8a None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:08.486999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad3f8a-05c1-4890-8987-300e715c9b8a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:08.487275 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad3f8a-05c1-4890-8987-300e715c9b8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:08.488457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad3f8a-05c1-4890-8987-300e715c9b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:08.489968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad3f8a-05c1-4890-8987-300e715c9b8a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:08.491909 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 510/1011] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:08.498060 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad3f8a-05c1-4890-8987-300e715c9b8a None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:08.530834 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 502/1012] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:19:08.553419 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ebfdc-17d5-45d3-92ee-f0e852d8cc02 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:08.596974 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad3f8a-05c1-4890-8987-300e715c9b8a None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:08.631351 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5837be-017a-4e1c-9573-c24257f3747f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:08.632008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5837be-017a-4e1c-9573-c24257f3747f None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:08.632284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5837be-017a-4e1c-9573-c24257f3747f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:08.632560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5837be-017a-4e1c-9573-c24257f3747f None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:08.633254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5837be-017a-4e1c-9573-c24257f3747f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:08.635352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5837be-017a-4e1c-9573-c24257f3747f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:08.652882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ebfdc-17d5-45d3-92ee-f0e852d8cc02 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:08.660362 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 511/1013] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 14:19:08 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:19:08.691439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b7f1c-e66b-4b13-92cc-f2f64835e553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:08.692279 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b7f1c-e66b-4b13-92cc-f2f64835e553 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:08.692561 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b7f1c-e66b-4b13-92cc-f2f64835e553 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:08.692839 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b7f1c-e66b-4b13-92cc-f2f64835e553 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:08.693515 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b7f1c-e66b-4b13-92cc-f2f64835e553 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:08.694992 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b7f1c-e66b-4b13-92cc-f2f64835e553 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-282b7f1c-e66b-4b13-92cc-f2f64835e553 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:08.708714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:08.709861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:08.710763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:08.710763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:08.710763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:08.710763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:08.710763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:08.710763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:08.710763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:08.710763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:08.710763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:08.710763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:08.710763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:19:08.710763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:19:08.710763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 14:19:08.710763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:08.714540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 503/1014] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:19:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:08.716168 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5837be-017a-4e1c-9573-c24257f3747f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:08.822500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5837be-017a-4e1c-9573-c24257f3747f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:08.858777 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b715661-1869-4e5c-9bfd-fd7acd48d4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:08.859471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b715661-1869-4e5c-9bfd-fd7acd48d4e4 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:08.859751 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b715661-1869-4e5c-9bfd-fd7acd48d4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:08.860021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b715661-1869-4e5c-9bfd-fd7acd48d4e4 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:08.860736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b715661-1869-4e5c-9bfd-fd7acd48d4e4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:08.861046 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b715661-1869-4e5c-9bfd-fd7acd48d4e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:08.862533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b715661-1869-4e5c-9bfd-fd7acd48d4e4 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:08.868294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 512/1015] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 14:19:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:08.874664 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b7f1c-e66b-4b13-92cc-f2f64835e553 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:08.977569 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b7f1c-e66b-4b13-92cc-f2f64835e553 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:09.011447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c09bda-9ba1-424f-8fd3-d12f884d1479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:09.012214 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c09bda-9ba1-424f-8fd3-d12f884d1479 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:09.012506 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c09bda-9ba1-424f-8fd3-d12f884d1479 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:09.012785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c09bda-9ba1-424f-8fd3-d12f884d1479 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:09.013496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c09bda-9ba1-424f-8fd3-d12f884d1479 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:09.013807 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c09bda-9ba1-424f-8fd3-d12f884d1479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:09.015226 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c09bda-9ba1-424f-8fd3-d12f884d1479 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:09.020257 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 504/1016] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 17 14:19:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:09.026151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b715661-1869-4e5c-9bfd-fd7acd48d4e4 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:09.054812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82234fa-6741-4704-af74-724cbce6c173 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:09.055098 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82234fa-6741-4704-af74-724cbce6c173 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:09.055376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82234fa-6741-4704-af74-724cbce6c173 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:09.057423 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 505/1017] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:19:09.063861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2789ae9-894b-43c5-9c68-cac2d0b3ebaa None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:09.064175 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2789ae9-894b-43c5-9c68-cac2d0b3ebaa None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:09.064435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2789ae9-894b-43c5-9c68-cac2d0b3ebaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:09.081443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-f2789ae9-894b-43c5-9c68-cac2d0b3ebaa None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:09.082673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f2789ae9-894b-43c5-9c68-cac2d0b3ebaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:09.127078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b715661-1869-4e5c-9bfd-fd7acd48d4e4 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:09.148603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 506/1018] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:19:09.164354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e21d3e-2e94-4a61-85e7-7ede537cf511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:09.165017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e21d3e-2e94-4a61-85e7-7ede537cf511 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:09.165302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e21d3e-2e94-4a61-85e7-7ede537cf511 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:09.165839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e21d3e-2e94-4a61-85e7-7ede537cf511 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:09.166626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e21d3e-2e94-4a61-85e7-7ede537cf511 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:09.168006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e21d3e-2e94-4a61-85e7-7ede537cf511 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:09.170994 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2789ae9-894b-43c5-9c68-cac2d0b3ebaa None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:09.186910 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 513/1019] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 14:19:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:19:09.281286 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2789ae9-894b-43c5-9c68-cac2d0b3ebaa None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:09.325417 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f5a08-f016-4cd8-8088-1ee71aedeee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:09.326431 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f5a08-f016-4cd8-8088-1ee71aedeee6 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:09.326709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f5a08-f016-4cd8-8088-1ee71aedeee6 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:09.326976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f5a08-f016-4cd8-8088-1ee71aedeee6 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:09.327716 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f5a08-f016-4cd8-8088-1ee71aedeee6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:09.329115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f5a08-f016-4cd8-8088-1ee71aedeee6 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:09.354527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 507/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 14:19:09 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:19:10.949376 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d4337-07a2-44e2-bb6d-32bd2790588a None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:10.949937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d4337-07a2-44e2-bb6d-32bd2790588a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:10.949937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d4337-07a2-44e2-bb6d-32bd2790588a None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:10.951463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 514/1021] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:10.957109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2988eed-82ce-4f5f-8f47-69573cf92d33 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:10.957528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2988eed-82ce-4f5f-8f47-69573cf92d33 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:10.957700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2988eed-82ce-4f5f-8f47-69573cf92d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:10.974829 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-a2988eed-82ce-4f5f-8f47-69573cf92d33 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:10.975993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a2988eed-82ce-4f5f-8f47-69573cf92d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:11.046113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 508/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:11.070441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d4337-07a2-44e2-bb6d-32bd2790588a None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:11.169978 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d4337-07a2-44e2-bb6d-32bd2790588a None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:11.202977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fef815-d1ba-46ca-8219-c4207a6fc68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:11.203714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fef815-d1ba-46ca-8219-c4207a6fc68c None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:11.203992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fef815-d1ba-46ca-8219-c4207a6fc68c None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:11.204261 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fef815-d1ba-46ca-8219-c4207a6fc68c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:11.205671 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fef815-d1ba-46ca-8219-c4207a6fc68c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:11.207143 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fef815-d1ba-46ca-8219-c4207a6fc68c None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:11.208885 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 515/1023] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:11.215190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2988eed-82ce-4f5f-8f47-69573cf92d33 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:11.311191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2988eed-82ce-4f5f-8f47-69573cf92d33 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:11.344043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ec8ab-377f-4d98-ae34-4117e03181c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:11.344710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ec8ab-377f-4d98-ae34-4117e03181c4 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:11.345047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ec8ab-377f-4d98-ae34-4117e03181c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:11.345265 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ec8ab-377f-4d98-ae34-4117e03181c4 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:11.345959 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ec8ab-377f-4d98-ae34-4117e03181c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:11.347416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ec8ab-377f-4d98-ae34-4117e03181c4 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:11.370259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 509/1024] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:19:11 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:19:11.624841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b72f9c-56e7-4bb7-8801-f46b79c1a552 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:11.625205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b72f9c-56e7-4bb7-8801-f46b79c1a552 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:11.625407 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b72f9c-56e7-4bb7-8801-f46b79c1a552 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:11.627152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 516/1025] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:11.628690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80bad0-ff9d-4a8e-9424-62904ccb36a5 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:11.628990 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80bad0-ff9d-4a8e-9424-62904ccb36a5 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:11.629274 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80bad0-ff9d-4a8e-9424-62904ccb36a5 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:11.630680 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 510/1026] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:11.632530 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b587ed9-2b94-452b-a5d7-a687165b7690 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:11.632815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b587ed9-2b94-452b-a5d7-a687165b7690 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:11.633091 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b587ed9-2b94-452b-a5d7-a687165b7690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:11.635895 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c551918-d917-444a-a666-5e50006f633e None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:11.636187 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c551918-d917-444a-a666-5e50006f633e None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:11.636474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c551918-d917-444a-a666-5e50006f633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:11.652279 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-5b587ed9-2b94-452b-a5d7-a687165b7690 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:11.652636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-0c551918-d917-444a-a666-5e50006f633e None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:11.653476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5b587ed9-2b94-452b-a5d7-a687165b7690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:11.653772 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0c551918-d917-444a-a666-5e50006f633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:11.721237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 511/1027] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:11.726360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 517/1028] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:19:11.745749 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c551918-d917-444a-a666-5e50006f633e None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:11.746786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b587ed9-2b94-452b-a5d7-a687165b7690 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:11.844443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c551918-d917-444a-a666-5e50006f633e None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:11.848361 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b587ed9-2b94-452b-a5d7-a687165b7690 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:11.878003 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01711686-1c07-464a-8d2b-c7e69f043093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:11.878875 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01711686-1c07-464a-8d2b-c7e69f043093 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:11.879153 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01711686-1c07-464a-8d2b-c7e69f043093 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:11.879486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01711686-1c07-464a-8d2b-c7e69f043093 None admin] PATH_INFO: `/v3/services/image` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:11.880074 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01711686-1c07-464a-8d2b-c7e69f043093 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:11.881441 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01711686-1c07-464a-8d2b-c7e69f043093 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:11.882387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e527f8-22fd-4045-95ca-054dc336e173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:11.883186 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e527f8-22fd-4045-95ca-054dc336e173 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:11.883465 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e527f8-22fd-4045-95ca-054dc336e173 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:11.883741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e527f8-22fd-4045-95ca-054dc336e173 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:11.893998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e527f8-22fd-4045-95ca-054dc336e173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-01711686-1c07-464a-8d2b-c7e69f043093 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:11.894133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:11.895253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:11.896100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:11.896100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:11.896100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:11.896100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:11.896100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:11.896100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:11.896100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:11.896100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:11.896100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:11.896100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:11.896100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:19:11.896100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:19:11.896100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 14:19:11.896100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:11.901105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 512/1029] 10.222.0.48 () {56 vars in 1105 bytes} [Tue May 17 14:19:11 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:11.901774 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01711686-1c07-464a-8d2b-c7e69f043093 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-69e527f8-22fd-4045-95ca-054dc336e173 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:19:11.902578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:11.903540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:11.907139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:11.907139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:11.907139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:11.907139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:11.907139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:19:11.907139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:19:11.907139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:19:11.907139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:19:11.907139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:19:11.907139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:19:11.907139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 14:19:11.907139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:11.907139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 518/1030] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 17 14:19:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:11.909350 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e527f8-22fd-4045-95ca-054dc336e173 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:12.000812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01711686-1c07-464a-8d2b-c7e69f043093 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:12.005915 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e527f8-22fd-4045-95ca-054dc336e173 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:12.034187 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ac3a5-8aa5-4dd2-9986-d973a220a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:12.035010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ac3a5-8aa5-4dd2-9986-d973a220a862 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:12.035290 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ac3a5-8aa5-4dd2-9986-d973a220a862 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:12.035564 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ac3a5-8aa5-4dd2-9986-d973a220a862 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:12.036261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ac3a5-8aa5-4dd2-9986-d973a220a862 None admin] RBAC: Adding query filter params (name=image) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:12.036632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ac3a5-8aa5-4dd2-9986-d973a220a862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:12.037943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ac3a5-8aa5-4dd2-9986-d973a220a862 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:12.039898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728f064-4e43-40a4-870c-b64cfe8ddb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:12.040584 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728f064-4e43-40a4-870c-b64cfe8ddb24 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:12.040865 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728f064-4e43-40a4-870c-b64cfe8ddb24 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:12.041140 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728f064-4e43-40a4-870c-b64cfe8ddb24 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:12.041875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728f064-4e43-40a4-870c-b64cfe8ddb24 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:12.042219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728f064-4e43-40a4-870c-b64cfe8ddb24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:12.047594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 513/1031] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:12.047746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728f064-4e43-40a4-870c-b64cfe8ddb24 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:12.048444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ac3a5-8aa5-4dd2-9986-d973a220a862 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:12.052557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 519/1032] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 17 14:19:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:12.057744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728f064-4e43-40a4-870c-b64cfe8ddb24 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:12.151304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ac3a5-8aa5-4dd2-9986-d973a220a862 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:12.154888 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728f064-4e43-40a4-870c-b64cfe8ddb24 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:12.185325 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1ca3e-fe29-4f40-a770-63c112b07bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:12.186088 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1ca3e-fe29-4f40-a770-63c112b07bd3 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:12.186479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1ca3e-fe29-4f40-a770-63c112b07bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:12.186769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1ca3e-fe29-4f40-a770-63c112b07bd3 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:12.187455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1ca3e-fe29-4f40-a770-63c112b07bd3 None admin] RBAC: Adding query filter params (type=image) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:12.187857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1ca3e-fe29-4f40-a770-63c112b07bd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:12.188235 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d45480-045b-47d5-8557-e33cc1cf6d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:12.189020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d45480-045b-47d5-8557-e33cc1cf6d77 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:12.189234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1ca3e-fe29-4f40-a770-63c112b07bd3 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:12.189338 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d45480-045b-47d5-8557-e33cc1cf6d77 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:12.189560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d45480-045b-47d5-8557-e33cc1cf6d77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:12.198926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 514/1033] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:12.200926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1ca3e-fe29-4f40-a770-63c112b07bd3 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:12.202306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d45480-045b-47d5-8557-e33cc1cf6d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:12.203774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d45480-045b-47d5-8557-e33cc1cf6d77 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:12.222958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-92d45480-045b-47d5-8557-e33cc1cf6d77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:12.222958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:12.222958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:12.222958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:12.222958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:12.222958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:12.222958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:12.222958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:12.222958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:12.222958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:12.222958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:12.222958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:12.222958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:19:12.222958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:19:12.222958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:12.223901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:12.224795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:19:12.224795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:19:12.224795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:12.224795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:12.226678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 520/1034] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:12.230344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d45480-045b-47d5-8557-e33cc1cf6d77 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:12.300440 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1ca3e-fe29-4f40-a770-63c112b07bd3 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:12.332791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d45480-045b-47d5-8557-e33cc1cf6d77 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:12.334901 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadd5dc-7aef-4f70-8a36-aac76056b173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:12.335550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadd5dc-7aef-4f70-8a36-aac76056b173 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:12.335831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadd5dc-7aef-4f70-8a36-aac76056b173 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:12.336103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadd5dc-7aef-4f70-8a36-aac76056b173 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:12.336880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadd5dc-7aef-4f70-8a36-aac76056b173 None admin] RBAC: Adding query filter params (interface=public, service_id=414a4fc21efb402a81cd4460a941f743, region_id=RegionOne) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:12.337183 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadd5dc-7aef-4f70-8a36-aac76056b173 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:12.338878 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadd5dc-7aef-4f70-8a36-aac76056b173 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:12.344895 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 515/1035] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 14:19:12 2022] GET /identity/v3/endpoints?service_id=414a4fc21efb402a81cd4460a941f743&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:12.350109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadd5dc-7aef-4f70-8a36-aac76056b173 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:12.366775 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a634923-8f90-4a27-8055-1c7408c6bfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:12.367435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a634923-8f90-4a27-8055-1c7408c6bfa6 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:12.367717 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a634923-8f90-4a27-8055-1c7408c6bfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:12.367987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a634923-8f90-4a27-8055-1c7408c6bfa6 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:12.369473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a634923-8f90-4a27-8055-1c7408c6bfa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:12.369594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a634923-8f90-4a27-8055-1c7408c6bfa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:12.370892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a634923-8f90-4a27-8055-1c7408c6bfa6 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:12.383305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 521/1036] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:12.388566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a634923-8f90-4a27-8055-1c7408c6bfa6 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:12.459453 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadd5dc-7aef-4f70-8a36-aac76056b173 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:12.484195 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a634923-8f90-4a27-8055-1c7408c6bfa6 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:12.492537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcc818-5bfd-4e8c-8df0-8b5490e2332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:12.493207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcc818-5bfd-4e8c-8df0-8b5490e2332f None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:12.493501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcc818-5bfd-4e8c-8df0-8b5490e2332f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:12.494349 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcc818-5bfd-4e8c-8df0-8b5490e2332f None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:12.495114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcc818-5bfd-4e8c-8df0-8b5490e2332f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:12.496480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcc818-5bfd-4e8c-8df0-8b5490e2332f None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:12.502978 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 516/1037] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 14:19:12 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:19:12.517945 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54ca29-78f8-43af-8349-43780f1d33fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:12.518806 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54ca29-78f8-43af-8349-43780f1d33fa None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:12.519094 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54ca29-78f8-43af-8349-43780f1d33fa None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:12.519371 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54ca29-78f8-43af-8349-43780f1d33fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:12.528060 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54ca29-78f8-43af-8349-43780f1d33fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:12.529558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54ca29-78f8-43af-8349-43780f1d33fa None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-5e54ca29-78f8-43af-8349-43780f1d33fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:19:12.545986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:12.547026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:12.548034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:12.548034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:12.548034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:19:12.548034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:19:12.548034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:19:12.548034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:19:12.548034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:19:12.548034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:19:12.548034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 14:19:12.548034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:12.548034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 522/1038] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 14:19:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:12.553131 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcc818-5bfd-4e8c-8df0-8b5490e2332f None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:12.666677 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcc818-5bfd-4e8c-8df0-8b5490e2332f None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:12.704337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0f71d-e28a-408c-9b01-f6820a9e03ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:12.706015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0f71d-e28a-408c-9b01-f6820a9e03ec None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:12.706512 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0f71d-e28a-408c-9b01-f6820a9e03ec None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:12.706968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0f71d-e28a-408c-9b01-f6820a9e03ec None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:12.708417 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0f71d-e28a-408c-9b01-f6820a9e03ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:12.708910 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0f71d-e28a-408c-9b01-f6820a9e03ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:12.711373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0f71d-e28a-408c-9b01-f6820a9e03ec None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:12.730247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 517/1039] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 14:19:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:12.736035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54ca29-78f8-43af-8349-43780f1d33fa None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:12.876201 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54ca29-78f8-43af-8349-43780f1d33fa None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:12.929990 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727701d-898a-472a-9b07-cebfcd04a749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:12.931695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727701d-898a-472a-9b07-cebfcd04a749 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:12.932409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727701d-898a-472a-9b07-cebfcd04a749 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:12.932899 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727701d-898a-472a-9b07-cebfcd04a749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:13.037714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727701d-898a-472a-9b07-cebfcd04a749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:13.039142 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727701d-898a-472a-9b07-cebfcd04a749 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:13.134785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 523/1040] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:19:12 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:19:13.140701 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0f71d-e28a-408c-9b01-f6820a9e03ec None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:13.238093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0f71d-e28a-408c-9b01-f6820a9e03ec None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:13.271838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d1ab7-abbe-4326-82ad-9e95ef491d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:13.272640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1ab7-abbe-4326-82ad-9e95ef491d30 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:13.272919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1ab7-abbe-4326-82ad-9e95ef491d30 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:13.273192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1ab7-abbe-4326-82ad-9e95ef491d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:13.284280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d1ab7-abbe-4326-82ad-9e95ef491d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:13.285740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d1ab7-abbe-4326-82ad-9e95ef491d30 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:13.303254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-834d1ab7-abbe-4326-82ad-9e95ef491d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:13.303254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:13.303254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:13.303254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:13.303254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:13.303254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:13.303254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:13.303254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:13.303254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:13.303254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:13.303254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:13.303254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:13.303254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:19:13.303254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:19:13.303254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:13.304166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:13.305058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:19:13.305058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:19:13.305058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:13.305058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:13.305840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 518/1041] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:13.310560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727701d-898a-472a-9b07-cebfcd04a749 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:13.406799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727701d-898a-472a-9b07-cebfcd04a749 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:13.439006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e751f2a-3209-4b55-9415-fe180122d607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:13.439665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e751f2a-3209-4b55-9415-fe180122d607 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:13.439945 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e751f2a-3209-4b55-9415-fe180122d607 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:13.440219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e751f2a-3209-4b55-9415-fe180122d607 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:13.440934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e751f2a-3209-4b55-9415-fe180122d607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:13.441252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e751f2a-3209-4b55-9415-fe180122d607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:13.442639 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e751f2a-3209-4b55-9415-fe180122d607 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:13.458449 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 524/1042] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:13.460387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d1ab7-abbe-4326-82ad-9e95ef491d30 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:13.558154 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d1ab7-abbe-4326-82ad-9e95ef491d30 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:13.591333 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf9e44-c678-4a69-88fa-2ca9f5c5bcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:13.592126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf9e44-c678-4a69-88fa-2ca9f5c5bcf4 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:13.592406 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf9e44-c678-4a69-88fa-2ca9f5c5bcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:13.592678 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf9e44-c678-4a69-88fa-2ca9f5c5bcf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:13.599238 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf9e44-c678-4a69-88fa-2ca9f5c5bcf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:13.600704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf9e44-c678-4a69-88fa-2ca9f5c5bcf4 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:13.614579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-e1cf9e44-c678-4a69-88fa-2ca9f5c5bcf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:19:13.614579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:13.614579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:13.614579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:13.614579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:13.614579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:13.614579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:13.614579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:13.614579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:13.614579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:13.614579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:13.614579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:13.614579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:19:13.614579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:19:13.614579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:13.615475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:13.621630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:19:13.621630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:19:13.621630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:19:13.621630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:19:13.621630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:19:13.621630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:19:13.621630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:19:13.621630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:13.621630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 519/1043] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:19:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:13.623687 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e751f2a-3209-4b55-9415-fe180122d607 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:13.726823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e751f2a-3209-4b55-9415-fe180122d607 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:13.759651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe0b5c-c36c-4465-afd0-fc7782d86679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:13.760315 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe0b5c-c36c-4465-afd0-fc7782d86679 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:13.760594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe0b5c-c36c-4465-afd0-fc7782d86679 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:13.760863 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe0b5c-c36c-4465-afd0-fc7782d86679 None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:13.761635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe0b5c-c36c-4465-afd0-fc7782d86679 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:13.761935 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe0b5c-c36c-4465-afd0-fc7782d86679 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:13.763380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe0b5c-c36c-4465-afd0-fc7782d86679 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:13.775876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 525/1044] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:19:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:13.781750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf9e44-c678-4a69-88fa-2ca9f5c5bcf4 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:13.824239 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effb0d6-c3df-4c51-94d2-0abc64aa1c82 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:13.824527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effb0d6-c3df-4c51-94d2-0abc64aa1c82 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:13.824718 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effb0d6-c3df-4c51-94d2-0abc64aa1c82 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:13.826236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 526/1045] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:19:13.831423 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12bda6-f1ed-4041-9e61-416e24786bb7 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:13.831714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12bda6-f1ed-4041-9e61-416e24786bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:13.831992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12bda6-f1ed-4041-9e61-416e24786bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:13.850682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-8d12bda6-f1ed-4041-9e61-416e24786bb7 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:13.851753 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-8d12bda6-f1ed-4041-9e61-416e24786bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:13.906833 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf9e44-c678-4a69-88fa-2ca9f5c5bcf4 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:13.917880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 527/1046] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:19:13.941098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12bda6-f1ed-4041-9e61-416e24786bb7 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:13.941754 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11056c-cd20-4ea0-bc01-5f420e2c5ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:13.942436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11056c-cd20-4ea0-bc01-5f420e2c5ac9 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:13.942718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11056c-cd20-4ea0-bc01-5f420e2c5ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:13.943174 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11056c-cd20-4ea0-bc01-5f420e2c5ac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:13.944818 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11056c-cd20-4ea0-bc01-5f420e2c5ac9 None admin] RBAC: Adding query filter params (role.id=a00f17971455442b93c3cd2f40b9daad, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=1f443d2ca1534249bb2c4096300ddffd) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:13.945136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11056c-cd20-4ea0-bc01-5f420e2c5ac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:13.946631 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11056c-cd20-4ea0-bc01-5f420e2c5ac9 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:13.962582 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 520/1047] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:19:13 2022] GET /identity/v3/role_assignments?user.id=1f443d2ca1534249bb2c4096300ddffd&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=a00f17971455442b93c3cd2f40b9daad => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:14.044075 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12bda6-f1ed-4041-9e61-416e24786bb7 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:14.080220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760bd60-b82c-4204-9122-7cb2d33620f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:14.081265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760bd60-b82c-4204-9122-7cb2d33620f2 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:14.081557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760bd60-b82c-4204-9122-7cb2d33620f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:14.081834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760bd60-b82c-4204-9122-7cb2d33620f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:14.095148 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760bd60-b82c-4204-9122-7cb2d33620f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-3760bd60-b82c-4204-9122-7cb2d33620f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:19:14.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:14.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:14.105540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:14.105540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:14.105540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:14.105540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:14.105540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:19:14.105540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:19:14.105540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:19:14.105540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:19:14.105540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:19:14.105540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:19:14.105540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:19:14.105540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:14.111742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 528/1048] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:19:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:14.111918 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11056c-cd20-4ea0-bc01-5f420e2c5ac9 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:14.218642 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11056c-cd20-4ea0-bc01-5f420e2c5ac9 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:14.256500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31fca8-0e33-49fd-bc81-4a143aa17fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:14.257172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31fca8-0e33-49fd-bc81-4a143aa17fb7 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:14.257450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31fca8-0e33-49fd-bc81-4a143aa17fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:14.257718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31fca8-0e33-49fd-bc81-4a143aa17fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:14.258495 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31fca8-0e33-49fd-bc81-4a143aa17fb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:14.258798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31fca8-0e33-49fd-bc81-4a143aa17fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:14.260212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31fca8-0e33-49fd-bc81-4a143aa17fb7 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:14.268718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 521/1049] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:19:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:14.274145 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760bd60-b82c-4204-9122-7cb2d33620f2 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:14.372884 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760bd60-b82c-4204-9122-7cb2d33620f2 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:14.404980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f9bc1-e263-4e15-a2ac-743734831e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:14.405849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f9bc1-e263-4e15-a2ac-743734831e28 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:14.406128 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f9bc1-e263-4e15-a2ac-743734831e28 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:14.406425 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f9bc1-e263-4e15-a2ac-743734831e28 None admin] PATH_INFO: `/v3/users/c49be8bb56054976ad52ac655f6d30d2` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:14.419829 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f9bc1-e263-4e15-a2ac-743734831e28 None admin] RBAC: Authorizing `identity:get_user(user_id=c49be8bb56054976ad52ac655f6d30d2)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:14.421291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f9bc1-e263-4e15-a2ac-743734831e28 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:14.423905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 529/1050] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:19:14 2022] GET /identity/v3/users/c49be8bb56054976ad52ac655f6d30d2 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:14.429405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31fca8-0e33-49fd-bc81-4a143aa17fb7 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:14.527907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31fca8-0e33-49fd-bc81-4a143aa17fb7 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:14.559691 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e7e7f-a351-4aba-8841-8131f3017a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:14.560338 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e7e7f-a351-4aba-8841-8131f3017a8c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:14.560616 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e7e7f-a351-4aba-8841-8131f3017a8c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:14.560886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e7e7f-a351-4aba-8841-8131f3017a8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:14.630263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e7e7f-a351-4aba-8841-8131f3017a8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:14.631630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e7e7f-a351-4aba-8841-8131f3017a8c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:14.729341 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 522/1051] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:19:14 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:19:14.734938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f9bc1-e263-4e15-a2ac-743734831e28 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:14.777871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11a28-9ec6-49c0-85f4-abacbcd1e901 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:14.778212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11a28-9ec6-49c0-85f4-abacbcd1e901 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:14.778496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11a28-9ec6-49c0-85f4-abacbcd1e901 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:14.780035 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 523/1052] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:19:14.785246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd041746-237a-4652-aa4f-0a98b3cae7d5 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:14.785538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd041746-237a-4652-aa4f-0a98b3cae7d5 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:14.785822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd041746-237a-4652-aa4f-0a98b3cae7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:14.802689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-bd041746-237a-4652-aa4f-0a98b3cae7d5 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:14.803875 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bd041746-237a-4652-aa4f-0a98b3cae7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:14.833321 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f9bc1-e263-4e15-a2ac-743734831e28 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:14.866665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf485a7-25d8-41b0-bbe8-36902abc2ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:14.867575 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf485a7-25d8-41b0-bbe8-36902abc2ea5 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:14.867883 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf485a7-25d8-41b0-bbe8-36902abc2ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:14.868162 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf485a7-25d8-41b0-bbe8-36902abc2ea5 None admin] PATH_INFO: `/v3/projects/071be74b98534602bc99a903506b5393` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:14.870223 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf485a7-25d8-41b0-bbe8-36902abc2ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=071be74b98534602bc99a903506b5393)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:14.870349 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 524/1053] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:19:14.871046 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf485a7-25d8-41b0-bbe8-36902abc2ea5 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:14.877510 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 530/1054] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:19:14 2022] GET /identity/v3/projects/071be74b98534602bc99a903506b5393 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:14.878661 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd041746-237a-4652-aa4f-0a98b3cae7d5 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:14.892985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf485a7-25d8-41b0-bbe8-36902abc2ea5 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:14.976712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd041746-237a-4652-aa4f-0a98b3cae7d5 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:14.992607 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf485a7-25d8-41b0-bbe8-36902abc2ea5 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:15.011736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6a29e-fbe7-4157-951d-f13bb80ad98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:15.012393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6a29e-fbe7-4157-951d-f13bb80ad98a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:15.012677 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6a29e-fbe7-4157-951d-f13bb80ad98a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:15.012953 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6a29e-fbe7-4157-951d-f13bb80ad98a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:15.014137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6a29e-fbe7-4157-951d-f13bb80ad98a None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=071be74b98534602bc99a903506b5393, user.id=c49be8bb56054976ad52ac655f6d30d2) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:15.014137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6a29e-fbe7-4157-951d-f13bb80ad98a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:15.015540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6a29e-fbe7-4157-951d-f13bb80ad98a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:15.021266 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 525/1055] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:19:14 2022] GET /identity/v3/role_assignments?user.id=c49be8bb56054976ad52ac655f6d30d2&scope.project.id=071be74b98534602bc99a903506b5393&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:15.028192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc7547-8f2f-497f-9c59-0eb9957a1b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:15.029337 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc7547-8f2f-497f-9c59-0eb9957a1b3d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:15.029817 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc7547-8f2f-497f-9c59-0eb9957a1b3d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:15.030356 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc7547-8f2f-497f-9c59-0eb9957a1b3d None admin] PATH_INFO: `/v3/services/image` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:15.031245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc7547-8f2f-497f-9c59-0eb9957a1b3d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:15.032858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc7547-8f2f-497f-9c59-0eb9957a1b3d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-0ccc7547-8f2f-497f-9c59-0eb9957a1b3d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:15.045731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:15.047292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:15.048149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:15.048149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:15.048149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:15.048149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:15.048149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:15.048149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:15.048149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:15.048149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:15.048149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:15.048149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:15.048149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:19:15.048149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:19:15.048149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 14:19:15.048149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:15.050434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 531/1056] 10.222.0.48 () {56 vars in 1105 bytes} [Tue May 17 14:19:14 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:15.055617 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6a29e-fbe7-4157-951d-f13bb80ad98a None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:15.162002 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6a29e-fbe7-4157-951d-f13bb80ad98a None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:15.200125 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1a696-1b58-4cde-969e-f91664bbef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:15.200808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1a696-1b58-4cde-969e-f91664bbef11 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:15.201156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1a696-1b58-4cde-969e-f91664bbef11 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:15.201433 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1a696-1b58-4cde-969e-f91664bbef11 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:15.202197 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1a696-1b58-4cde-969e-f91664bbef11 None admin] RBAC: Adding query filter params (name=image) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:15.202525 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1a696-1b58-4cde-969e-f91664bbef11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:15.203912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1a696-1b58-4cde-969e-f91664bbef11 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:15.214029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 526/1057] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:15.215607 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc7547-8f2f-497f-9c59-0eb9957a1b3d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:15.317935 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc7547-8f2f-497f-9c59-0eb9957a1b3d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:15.350213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee629bc-154a-426f-89c3-52b57eec6356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:15.350875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee629bc-154a-426f-89c3-52b57eec6356 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:15.351151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee629bc-154a-426f-89c3-52b57eec6356 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:15.351418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee629bc-154a-426f-89c3-52b57eec6356 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:15.352115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee629bc-154a-426f-89c3-52b57eec6356 None admin] RBAC: Adding query filter params (type=image) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:15.352417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee629bc-154a-426f-89c3-52b57eec6356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:15.353932 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee629bc-154a-426f-89c3-52b57eec6356 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:15.358813 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 532/1058] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:15.364164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1a696-1b58-4cde-969e-f91664bbef11 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:15.461382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1a696-1b58-4cde-969e-f91664bbef11 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:15.494448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35761866-7523-425b-8651-92e3a61e7ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:15.495185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35761866-7523-425b-8651-92e3a61e7ea2 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:15.495471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35761866-7523-425b-8651-92e3a61e7ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:15.495742 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35761866-7523-425b-8651-92e3a61e7ea2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:15.496476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35761866-7523-425b-8651-92e3a61e7ea2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:15.497826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35761866-7523-425b-8651-92e3a61e7ea2 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:15.517448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 527/1059] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 14:19:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:19:16.201592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83a0cb-98a0-4fba-81a4-11658b9039f6 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:16.202048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83a0cb-98a0-4fba-81a4-11658b9039f6 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:16.202142 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83a0cb-98a0-4fba-81a4-11658b9039f6 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:16.203697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 533/1060] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:16.209034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c0095-abe1-4d44-99ac-770a368bf799 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:16.209325 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c0095-abe1-4d44-99ac-770a368bf799 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:16.209600 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c0095-abe1-4d44-99ac-770a368bf799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:16.226827 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b08c0095-abe1-4d44-99ac-770a368bf799 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:16.228113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b08c0095-abe1-4d44-99ac-770a368bf799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:16.302530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 528/1061] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:16.327165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83a0cb-98a0-4fba-81a4-11658b9039f6 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:16.428503 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83a0cb-98a0-4fba-81a4-11658b9039f6 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:16.464152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a8cd5-9511-48ec-b062-120e9595e6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:16.464881 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a8cd5-9511-48ec-b062-120e9595e6f1 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:16.465159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a8cd5-9511-48ec-b062-120e9595e6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:16.465430 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a8cd5-9511-48ec-b062-120e9595e6f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:16.475107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a8cd5-9511-48ec-b062-120e9595e6f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-a96a8cd5-9511-48ec-b062-120e9595e6f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:19:16.484200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:16.485154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:16.486016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:16.486016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:16.486016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:16.486016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:16.486016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:19:16.486016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:19:16.486016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:19:16.486016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:19:16.486016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:19:16.486016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:19:16.486016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 14:19:16.486016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:16.487309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 534/1062] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 17 14:19:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:16.491333 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c0095-abe1-4d44-99ac-770a368bf799 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:16.589512 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c0095-abe1-4d44-99ac-770a368bf799 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:16.623122 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d62f86-da9f-47f5-b7f9-5e17f41d26a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:16.623794 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d62f86-da9f-47f5-b7f9-5e17f41d26a8 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:16.624078 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d62f86-da9f-47f5-b7f9-5e17f41d26a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:16.624351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d62f86-da9f-47f5-b7f9-5e17f41d26a8 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:16.625099 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d62f86-da9f-47f5-b7f9-5e17f41d26a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:16.625408 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d62f86-da9f-47f5-b7f9-5e17f41d26a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:16.626804 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d62f86-da9f-47f5-b7f9-5e17f41d26a8 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:16.639425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 529/1063] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 17 14:19:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:16.640616 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a8cd5-9511-48ec-b062-120e9595e6f1 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:16.742108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a8cd5-9511-48ec-b062-120e9595e6f1 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:16.777556 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c1f74-c41a-4fdb-9cb0-fe59a32c3694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:16.778496 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c1f74-c41a-4fdb-9cb0-fe59a32c3694 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:16.778783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c1f74-c41a-4fdb-9cb0-fe59a32c3694 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:16.779058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c1f74-c41a-4fdb-9cb0-fe59a32c3694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:16.789441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c1f74-c41a-4fdb-9cb0-fe59a32c3694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:16.792185 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c1f74-c41a-4fdb-9cb0-fe59a32c3694 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:16.809971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-630c1f74-c41a-4fdb-9cb0-fe59a32c3694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:16.809971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:16.809971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:16.809971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:16.809971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:16.809971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:16.809971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:16.809971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:16.809971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:16.809971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:16.809971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:16.809971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:16.809971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:19:16.809971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:19:16.809971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:16.811130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:16.812038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:19:16.812038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:19:16.812038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:16.812038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:16.814255 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 535/1064] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:16.816892 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d62f86-da9f-47f5-b7f9-5e17f41d26a8 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:16.916094 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d62f86-da9f-47f5-b7f9-5e17f41d26a8 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:16.949618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f543b3-ba8b-4175-9aaf-ffe588aec3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:16.950307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f543b3-ba8b-4175-9aaf-ffe588aec3b0 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:16.950593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f543b3-ba8b-4175-9aaf-ffe588aec3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:16.950893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f543b3-ba8b-4175-9aaf-ffe588aec3b0 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:16.951581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f543b3-ba8b-4175-9aaf-ffe588aec3b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:16.951887 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f543b3-ba8b-4175-9aaf-ffe588aec3b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:16.953249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f543b3-ba8b-4175-9aaf-ffe588aec3b0 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:16.965701 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 530/1065] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:16.971013 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c1f74-c41a-4fdb-9cb0-fe59a32c3694 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:17.068776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c1f74-c41a-4fdb-9cb0-fe59a32c3694 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:17.107758 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b9030-e10e-4ed1-97a2-3203c137b625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:17.108578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b9030-e10e-4ed1-97a2-3203c137b625 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:17.108860 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b9030-e10e-4ed1-97a2-3203c137b625 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:17.109137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b9030-e10e-4ed1-97a2-3203c137b625 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:17.121963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b9030-e10e-4ed1-97a2-3203c137b625 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:17.123492 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b9030-e10e-4ed1-97a2-3203c137b625 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-a95b9030-e10e-4ed1-97a2-3203c137b625 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:19:17.139654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:17.140688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:17.141644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:17.141644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:17.141644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:19:17.141644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:19:17.141644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:19:17.141644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:19:17.141644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:19:17.141644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:19:17.141644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 14:19:17.141644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:17.145638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 536/1066] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 14:19:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:17.146648 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f543b3-ba8b-4175-9aaf-ffe588aec3b0 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:17.253796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f543b3-ba8b-4175-9aaf-ffe588aec3b0 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:17.288724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba1a60-a5d6-48fa-8a9e-15a3891223fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:17.289851 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba1a60-a5d6-48fa-8a9e-15a3891223fe None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:17.290368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba1a60-a5d6-48fa-8a9e-15a3891223fe None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:17.290864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba1a60-a5d6-48fa-8a9e-15a3891223fe None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:17.291989 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba1a60-a5d6-48fa-8a9e-15a3891223fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:17.292505 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba1a60-a5d6-48fa-8a9e-15a3891223fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:17.292939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46726c64-fa02-4fd0-ac79-f9e845b32509 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:17.293396 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46726c64-fa02-4fd0-ac79-f9e845b32509 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:17.293474 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46726c64-fa02-4fd0-ac79-f9e845b32509 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:17.294324 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba1a60-a5d6-48fa-8a9e-15a3891223fe None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:17.294987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 537/1067] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:19:17.299735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b987c0-b3de-45d9-bacf-3708478f8831 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:17.300023 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b987c0-b3de-45d9-bacf-3708478f8831 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:17.300303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b987c0-b3de-45d9-bacf-3708478f8831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:17.317571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 531/1068] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 14:19:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:17.318761 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba1a60-a5d6-48fa-8a9e-15a3891223fe None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:17.319247 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-03b987c0-b3de-45d9-bacf-3708478f8831 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:17.320376 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-03b987c0-b3de-45d9-bacf-3708478f8831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:17.388176 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 538/1069] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:19:17.411328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b987c0-b3de-45d9-bacf-3708478f8831 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:17.419844 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba1a60-a5d6-48fa-8a9e-15a3891223fe None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:17.454871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb37099-46b7-43d4-9672-f421294be065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:17.455929 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb37099-46b7-43d4-9672-f421294be065 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:17.456214 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb37099-46b7-43d4-9672-f421294be065 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:17.456489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb37099-46b7-43d4-9672-f421294be065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:17.466601 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb37099-46b7-43d4-9672-f421294be065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:17.468054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb37099-46b7-43d4-9672-f421294be065 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:17.485932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-6fb37099-46b7-43d4-9672-f421294be065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:17.485932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:17.485932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:17.485932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:17.485932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:17.485932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:17.485932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:17.485932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:17.485932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:17.485932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:17.485932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:17.485932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:17.485932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:19:17.485932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:19:17.485932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:17.487101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:17.488023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:19:17.488023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:19:17.488023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:17.488023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:17.488023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 532/1070] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:17.492938 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb37099-46b7-43d4-9672-f421294be065 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:17.509484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b987c0-b3de-45d9-bacf-3708478f8831 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:17.543558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab544fd0-8ced-4d1a-a502-40a4178eb296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:17.544353 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544fd0-8ced-4d1a-a502-40a4178eb296 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:17.544635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544fd0-8ced-4d1a-a502-40a4178eb296 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:17.544906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544fd0-8ced-4d1a-a502-40a4178eb296 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:17.554809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab544fd0-8ced-4d1a-a502-40a4178eb296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-ab544fd0-8ced-4d1a-a502-40a4178eb296 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:19:17.562921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:17.563907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:17.565435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:17.565435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:17.565435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:17.565435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:17.565435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:19:17.565435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:19:17.565435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:19:17.565435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:19:17.565435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:19:17.565435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:19:17.565435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:19:17.565435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:17.565435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 539/1071] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:19:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:17.570348 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab544fd0-8ced-4d1a-a502-40a4178eb296 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:17.597486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb37099-46b7-43d4-9672-f421294be065 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:17.632106 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb60931-b6c9-41f8-9845-53b6ad03b7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:17.632769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb60931-b6c9-41f8-9845-53b6ad03b7cd None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:17.633052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb60931-b6c9-41f8-9845-53b6ad03b7cd None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:17.633328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb60931-b6c9-41f8-9845-53b6ad03b7cd None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:17.634104 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb60931-b6c9-41f8-9845-53b6ad03b7cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:17.634445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb60931-b6c9-41f8-9845-53b6ad03b7cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:17.635949 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb60931-b6c9-41f8-9845-53b6ad03b7cd None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:17.647545 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 533/1072] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:17.653126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb60931-b6c9-41f8-9845-53b6ad03b7cd None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:17.671314 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab544fd0-8ced-4d1a-a502-40a4178eb296 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:17.704326 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd83db4-d3ee-4217-ad1f-6010f9003b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:17.704991 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd83db4-d3ee-4217-ad1f-6010f9003b4a None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:17.705273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd83db4-d3ee-4217-ad1f-6010f9003b4a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:17.705803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd83db4-d3ee-4217-ad1f-6010f9003b4a None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:17.706694 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd83db4-d3ee-4217-ad1f-6010f9003b4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:17.706902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd83db4-d3ee-4217-ad1f-6010f9003b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:17.708275 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd83db4-d3ee-4217-ad1f-6010f9003b4a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:17.720003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 540/1073] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:19:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:17.725409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd83db4-d3ee-4217-ad1f-6010f9003b4a None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:17.757590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb60931-b6c9-41f8-9845-53b6ad03b7cd None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:17.792175 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd88c4a-ca57-4aa7-bcc5-ab3d738b7eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:17.792966 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd88c4a-ca57-4aa7-bcc5-ab3d738b7eec None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:17.793243 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd88c4a-ca57-4aa7-bcc5-ab3d738b7eec None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:17.793516 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd88c4a-ca57-4aa7-bcc5-ab3d738b7eec None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:17.800069 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd88c4a-ca57-4aa7-bcc5-ab3d738b7eec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:17.801503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd88c4a-ca57-4aa7-bcc5-ab3d738b7eec None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:17.815191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-fdd88c4a-ca57-4aa7-bcc5-ab3d738b7eec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:19:17.815191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:17.815191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:17.815191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:17.815191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:17.815191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:17.815191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:17.815191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:17.815191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:17.815191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:17.815191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:17.815191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:17.815191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:19:17.815191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:19:17.815191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:17.816322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:17.817206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:19:17.817206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:19:17.817206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:19:17.817206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:19:17.817206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:19:17.817206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:19:17.817206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:19:17.817206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:17.817206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 534/1074] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:19:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:17.817718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60648dd1-b11c-4c50-91ac-56e86a48df3b None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:17.817838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60648dd1-b11c-4c50-91ac-56e86a48df3b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:17.818110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60648dd1-b11c-4c50-91ac-56e86a48df3b None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:17.819365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 535/1075] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:17.822702 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60648dd1-b11c-4c50-91ac-56e86a48df3b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:17.829131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd83db4-d3ee-4217-ad1f-6010f9003b4a None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:17.862871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a270b2-cf04-4877-839f-f8c7f60afce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:17.863752 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a270b2-cf04-4877-839f-f8c7f60afce3 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:17.864031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a270b2-cf04-4877-839f-f8c7f60afce3 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:17.864306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a270b2-cf04-4877-839f-f8c7f60afce3 None admin] PATH_INFO: `/v3/users/c49be8bb56054976ad52ac655f6d30d2` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:17.865520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a270b2-cf04-4877-839f-f8c7f60afce3 None admin] RBAC: Authorizing `identity:get_user(user_id=c49be8bb56054976ad52ac655f6d30d2)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:17.867002 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a270b2-cf04-4877-839f-f8c7f60afce3 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:17.868659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 541/1076] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:19:17 2022] GET /identity/v3/users/c49be8bb56054976ad52ac655f6d30d2 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:17.871024 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77596e07-a0a4-4e95-83ec-2104d3b924d1 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:17.871327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77596e07-a0a4-4e95-83ec-2104d3b924d1 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:17.871601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77596e07-a0a4-4e95-83ec-2104d3b924d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:17.888417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-77596e07-a0a4-4e95-83ec-2104d3b924d1 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:17.889606 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-77596e07-a0a4-4e95-83ec-2104d3b924d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:17.926889 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60648dd1-b11c-4c50-91ac-56e86a48df3b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:17.952746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 542/1077] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:17.953644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77596e07-a0a4-4e95-83ec-2104d3b924d1 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:17.960409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3330ae-6ef9-403a-9d3f-6ba111c6a843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:17.961055 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3330ae-6ef9-403a-9d3f-6ba111c6a843 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:17.961331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3330ae-6ef9-403a-9d3f-6ba111c6a843 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:17.961599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3330ae-6ef9-403a-9d3f-6ba111c6a843 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:17.963115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3330ae-6ef9-403a-9d3f-6ba111c6a843 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:17.963420 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3330ae-6ef9-403a-9d3f-6ba111c6a843 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:17.964835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3330ae-6ef9-403a-9d3f-6ba111c6a843 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:17.976158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 536/1078] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:19:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:17.976967 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3330ae-6ef9-403a-9d3f-6ba111c6a843 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:18.058592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77596e07-a0a4-4e95-83ec-2104d3b924d1 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:18.070195 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3330ae-6ef9-403a-9d3f-6ba111c6a843 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:18.091609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad29072-30d9-4cca-97d1-8a73065bdbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:18.092398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad29072-30d9-4cca-97d1-8a73065bdbe5 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:18.092679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad29072-30d9-4cca-97d1-8a73065bdbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:18.092945 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad29072-30d9-4cca-97d1-8a73065bdbe5 None admin] PATH_INFO: `/v3/projects/071be74b98534602bc99a903506b5393` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:18.094754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad29072-30d9-4cca-97d1-8a73065bdbe5 None admin] RBAC: Authorizing `identity:get_project(project_id=071be74b98534602bc99a903506b5393)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:18.096193 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad29072-30d9-4cca-97d1-8a73065bdbe5 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:18.097849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 543/1079] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:19:17 2022] GET /identity/v3/projects/071be74b98534602bc99a903506b5393 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:18.098602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad29072-30d9-4cca-97d1-8a73065bdbe5 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:18.109235 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba13bc-ae88-4cb0-8b33-f4812a798d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:18.109897 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba13bc-ae88-4cb0-8b33-f4812a798d51 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:18.110200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba13bc-ae88-4cb0-8b33-f4812a798d51 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:18.110484 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba13bc-ae88-4cb0-8b33-f4812a798d51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:18.177086 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba13bc-ae88-4cb0-8b33-f4812a798d51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:18.178559 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba13bc-ae88-4cb0-8b33-f4812a798d51 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:18.204649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad29072-30d9-4cca-97d1-8a73065bdbe5 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:18.238382 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acf433-1947-4665-adbc-5b43d48d9f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:18.239256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acf433-1947-4665-adbc-5b43d48d9f24 None admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:18.239539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acf433-1947-4665-adbc-5b43d48d9f24 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:18.239816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acf433-1947-4665-adbc-5b43d48d9f24 None admin] PATH_INFO: `/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/1f443d2ca1534249bb2c4096300ddffd/roles/a00f17971455442b93c3cd2f40b9daad` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:18.242035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acf433-1947-4665-adbc-5b43d48d9f24 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac7d1119033458393ad6f78fc0df7a3, user_id=1f443d2ca1534249bb2c4096300ddffd, role_id=a00f17971455442b93c3cd2f40b9daad)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:18.243600 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acf433-1947-4665-adbc-5b43d48d9f24 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:18.259338 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 544/1080] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:19:18 2022] PUT /identity/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/1f443d2ca1534249bb2c4096300ddffd/roles/a00f17971455442b93c3cd2f40b9daad => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:19:18.260037 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acf433-1947-4665-adbc-5b43d48d9f24 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:18.282290 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 537/1081] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:19:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:19:18.283888 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba13bc-ae88-4cb0-8b33-f4812a798d51 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:18.367458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acf433-1947-4665-adbc-5b43d48d9f24 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:18.393480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba13bc-ae88-4cb0-8b33-f4812a798d51 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:18.402901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4158edf-42dc-46fc-9ff5-60d1c759d05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:18.403815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4158edf-42dc-46fc-9ff5-60d1c759d05b None admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:18.404099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4158edf-42dc-46fc-9ff5-60d1c759d05b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:18.404378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4158edf-42dc-46fc-9ff5-60d1c759d05b None admin] PATH_INFO: `/v3/projects/071be74b98534602bc99a903506b5393/users/c49be8bb56054976ad52ac655f6d30d2/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:18.406483 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4158edf-42dc-46fc-9ff5-60d1c759d05b None admin] RBAC: Authorizing `identity:create_grant(project_id=071be74b98534602bc99a903506b5393, user_id=c49be8bb56054976ad52ac655f6d30d2, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:18.407965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4158edf-42dc-46fc-9ff5-60d1c759d05b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:18.424106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 545/1082] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:19:18 2022] PUT /identity/v3/projects/071be74b98534602bc99a903506b5393/users/c49be8bb56054976ad52ac655f6d30d2/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:19:18.433962 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5661f1-c8f1-4214-9339-0c65206fe8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:18.434837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5661f1-c8f1-4214-9339-0c65206fe8b5 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:18.435123 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5661f1-c8f1-4214-9339-0c65206fe8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:18.435401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5661f1-c8f1-4214-9339-0c65206fe8b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:18.448883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5661f1-c8f1-4214-9339-0c65206fe8b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:18.449822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5661f1-c8f1-4214-9339-0c65206fe8b5 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:18.470063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-ad5661f1-c8f1-4214-9339-0c65206fe8b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:18.470063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:18.470063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:18.470063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:18.470063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:18.470063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:18.470063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:18.470063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:18.470063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:18.470063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:18.470063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:18.470063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:18.470063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:19:18.470063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:19:18.470063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:18.471291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:18.472503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:19:18.472503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:19:18.472503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:18.472503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:18.472503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 538/1083] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:18.479647 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4158edf-42dc-46fc-9ff5-60d1c759d05b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:18.590236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4158edf-42dc-46fc-9ff5-60d1c759d05b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:18.627751 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a536f-a710-4250-8d8a-199c94f6702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:18.628343 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a536f-a710-4250-8d8a-199c94f6702e None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:18.628627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a536f-a710-4250-8d8a-199c94f6702e None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:18.628896 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a536f-a710-4250-8d8a-199c94f6702e None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:18.629622 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a536f-a710-4250-8d8a-199c94f6702e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:18.629924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a536f-a710-4250-8d8a-199c94f6702e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:18.631332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a536f-a710-4250-8d8a-199c94f6702e None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:18.643324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 546/1084] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:20.508108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce2488-7a92-46b7-b167-90ef625fb46b None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:20.508686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce2488-7a92-46b7-b167-90ef625fb46b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:20.508686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce2488-7a92-46b7-b167-90ef625fb46b None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:20.510309 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 539/1085] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:20.516075 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36144e2b-8eb9-4384-95ab-b15a390cbf92 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:20.516623 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36144e2b-8eb9-4384-95ab-b15a390cbf92 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:20.516892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36144e2b-8eb9-4384-95ab-b15a390cbf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:20.537508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-36144e2b-8eb9-4384-95ab-b15a390cbf92 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:20.538761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-36144e2b-8eb9-4384-95ab-b15a390cbf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:20.604684 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 547/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:20.627763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce2488-7a92-46b7-b167-90ef625fb46b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:20.706828 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caa760-98bc-4341-bb5c-aa056e802b18 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:20.707113 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caa760-98bc-4341-bb5c-aa056e802b18 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:20.707387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caa760-98bc-4341-bb5c-aa056e802b18 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:20.708722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 548/1087] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:19:20.715944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77259834-6285-42ab-9359-69e9ffa5fa52 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:20.716226 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77259834-6285-42ab-9359-69e9ffa5fa52 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:20.716500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77259834-6285-42ab-9359-69e9ffa5fa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:20.727160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce2488-7a92-46b7-b167-90ef625fb46b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:20.732584 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-77259834-6285-42ab-9359-69e9ffa5fa52 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:20.733741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-77259834-6285-42ab-9359-69e9ffa5fa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:20.760847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a14e2-73d2-4348-aaf3-2a8d1bcf329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:20.761601 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a14e2-73d2-4348-aaf3-2a8d1bcf329d None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:20.761882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a14e2-73d2-4348-aaf3-2a8d1bcf329d None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:20.762156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a14e2-73d2-4348-aaf3-2a8d1bcf329d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:20.771901 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a14e2-73d2-4348-aaf3-2a8d1bcf329d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-1a1a14e2-73d2-4348-aaf3-2a8d1bcf329d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:19:20.780636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:20.781637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:20.782580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:20.782580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:20.782580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:20.782580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:20.782580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:19:20.782580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:19:20.782580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:19:20.782580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:19:20.782580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:19:20.782580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:19:20.782580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 14:19:20.782580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:20.782580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 540/1088] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 17 14:19:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:20.787625 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a14e2-73d2-4348-aaf3-2a8d1bcf329d None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:20.798643 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 549/1089] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:19:20.822237 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77259834-6285-42ab-9359-69e9ffa5fa52 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:20.883390 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a14e2-73d2-4348-aaf3-2a8d1bcf329d None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:20.916291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e1408-46cd-435a-8235-14ee263b2a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:20.916960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e1408-46cd-435a-8235-14ee263b2a21 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:20.917247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e1408-46cd-435a-8235-14ee263b2a21 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:20.917525 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e1408-46cd-435a-8235-14ee263b2a21 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:20.918299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e1408-46cd-435a-8235-14ee263b2a21 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:20.918609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e1408-46cd-435a-8235-14ee263b2a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:20.919984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e1408-46cd-435a-8235-14ee263b2a21 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:20.927700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 541/1090] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 17 14:19:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:20.933021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77259834-6285-42ab-9359-69e9ffa5fa52 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:20.933315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e1408-46cd-435a-8235-14ee263b2a21 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:20.969312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc26ef-780b-4e5b-83e5-6fc50c9c5acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:20.970097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc26ef-780b-4e5b-83e5-6fc50c9c5acc None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:20.970408 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc26ef-780b-4e5b-83e5-6fc50c9c5acc None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:20.970683 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc26ef-780b-4e5b-83e5-6fc50c9c5acc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:20.980647 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc26ef-780b-4e5b-83e5-6fc50c9c5acc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-1dcc26ef-780b-4e5b-83e5-6fc50c9c5acc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:19:20.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:20.989184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:20.990027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:20.990027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:20.990027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:20.990027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:20.990027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:19:20.990027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:19:20.990027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:19:20.990027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:19:20.990027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:19:20.990027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:19:20.990027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:19:20.990027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:20.990027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 550/1091] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:19:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:20.995480 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc26ef-780b-4e5b-83e5-6fc50c9c5acc None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:21.029639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e1408-46cd-435a-8235-14ee263b2a21 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:21.061269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c0440-15df-42c8-b5a5-d5ffaec673d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:21.062048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c0440-15df-42c8-b5a5-d5ffaec673d2 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:21.062361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c0440-15df-42c8-b5a5-d5ffaec673d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:21.062632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c0440-15df-42c8-b5a5-d5ffaec673d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:21.072979 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c0440-15df-42c8-b5a5-d5ffaec673d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:21.074435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c0440-15df-42c8-b5a5-d5ffaec673d2 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:21.091057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc26ef-780b-4e5b-83e5-6fc50c9c5acc None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:21.091538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-ab6c0440-15df-42c8-b5a5-d5ffaec673d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:21.091538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:21.091538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:21.091538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:21.091538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:21.091538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:21.091538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:21.091538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:21.091538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:21.091538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:21.091538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:21.091538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:21.091538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:19:21.091538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:19:21.091538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:21.092542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:21.093441 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:19:21.093441 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:19:21.093441 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:21.093441 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:21.093441 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 542/1092] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:21.098263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c0440-15df-42c8-b5a5-d5ffaec673d2 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:21.127477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a18be7-a467-4775-a6e8-3e2bc61b2e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:21.128131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a18be7-a467-4775-a6e8-3e2bc61b2e61 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:21.128411 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a18be7-a467-4775-a6e8-3e2bc61b2e61 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:21.128681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a18be7-a467-4775-a6e8-3e2bc61b2e61 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:21.129418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a18be7-a467-4775-a6e8-3e2bc61b2e61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:21.129718 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a18be7-a467-4775-a6e8-3e2bc61b2e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:21.131102 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a18be7-a467-4775-a6e8-3e2bc61b2e61 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:21.138977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 551/1093] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:19:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:21.144507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a18be7-a467-4775-a6e8-3e2bc61b2e61 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:21.193913 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c0440-15df-42c8-b5a5-d5ffaec673d2 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:21.226891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6b892-8e58-4ac6-bd56-d8cea6f6d417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:21.227600 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6b892-8e58-4ac6-bd56-d8cea6f6d417 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:21.228048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6b892-8e58-4ac6-bd56-d8cea6f6d417 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:21.228337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6b892-8e58-4ac6-bd56-d8cea6f6d417 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:21.229063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6b892-8e58-4ac6-bd56-d8cea6f6d417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:21.229372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6b892-8e58-4ac6-bd56-d8cea6f6d417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:21.230777 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6b892-8e58-4ac6-bd56-d8cea6f6d417 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:21.239154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a18be7-a467-4775-a6e8-3e2bc61b2e61 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:21.242535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 543/1094] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:21.248922 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6b892-8e58-4ac6-bd56-d8cea6f6d417 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:21.274426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daddb5-a25d-40a0-b186-5a5c5504bf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:21.275285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daddb5-a25d-40a0-b186-5a5c5504bf12 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:21.275587 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daddb5-a25d-40a0-b186-5a5c5504bf12 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:21.275859 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19daddb5-a25d-40a0-b186-5a5c5504bf12 None admin] PATH_INFO: `/v3/users/c49be8bb56054976ad52ac655f6d30d2` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:21.277051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19daddb5-a25d-40a0-b186-5a5c5504bf12 None admin] RBAC: Authorizing `identity:get_user(user_id=c49be8bb56054976ad52ac655f6d30d2)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:21.278516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19daddb5-a25d-40a0-b186-5a5c5504bf12 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:21.284779 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 552/1095] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:19:21 2022] GET /identity/v3/users/c49be8bb56054976ad52ac655f6d30d2 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:21.285774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daddb5-a25d-40a0-b186-5a5c5504bf12 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:21.348663 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6b892-8e58-4ac6-bd56-d8cea6f6d417 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:21.380179 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19daddb5-a25d-40a0-b186-5a5c5504bf12 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:21.381955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910ab0d-91cd-4520-a9b7-92bfe4209731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:21.382768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910ab0d-91cd-4520-a9b7-92bfe4209731 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:21.383054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910ab0d-91cd-4520-a9b7-92bfe4209731 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:21.383328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910ab0d-91cd-4520-a9b7-92bfe4209731 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:21.391919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910ab0d-91cd-4520-a9b7-92bfe4209731 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:21.393364 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910ab0d-91cd-4520-a9b7-92bfe4209731 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-b910ab0d-91cd-4520-a9b7-92bfe4209731 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:19:21.408007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:21.409039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:21.410037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:21.410037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:21.410037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:19:21.410037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:19:21.410037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:19:21.410037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:19:21.410037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:19:21.410037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:19:21.410037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 14:19:21.410037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:21.410037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 544/1096] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 17 14:19:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:21.417154 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910ab0d-91cd-4520-a9b7-92bfe4209731 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:21.417986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68668dd1-32ed-448e-a07d-b1e7459df3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:21.418707 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68668dd1-32ed-448e-a07d-b1e7459df3c0 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:21.418986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68668dd1-32ed-448e-a07d-b1e7459df3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:21.419255 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68668dd1-32ed-448e-a07d-b1e7459df3c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:21.484831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68668dd1-32ed-448e-a07d-b1e7459df3c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:21.486297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68668dd1-32ed-448e-a07d-b1e7459df3c0 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:21.511244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910ab0d-91cd-4520-a9b7-92bfe4209731 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:21.545506 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa6158-0600-47ef-91c8-9fe0aa48ad56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:21.546096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa6158-0600-47ef-91c8-9fe0aa48ad56 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:21.546411 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa6158-0600-47ef-91c8-9fe0aa48ad56 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:21.546691 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa6158-0600-47ef-91c8-9fe0aa48ad56 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:21.547528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa6158-0600-47ef-91c8-9fe0aa48ad56 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:21.547841 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa6158-0600-47ef-91c8-9fe0aa48ad56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:21.549292 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa6158-0600-47ef-91c8-9fe0aa48ad56 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:21.567374 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 545/1097] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 17 14:19:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:21.573384 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa6158-0600-47ef-91c8-9fe0aa48ad56 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:21.581412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 553/1098] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:19:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:19:21.587177 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68668dd1-32ed-448e-a07d-b1e7459df3c0 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:21.669418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa6158-0600-47ef-91c8-9fe0aa48ad56 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:21.682327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68668dd1-32ed-448e-a07d-b1e7459df3c0 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:21.702590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f24153-7b5a-47e3-84eb-12bca1a9fac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:21.703284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f24153-7b5a-47e3-84eb-12bca1a9fac2 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:21.703569 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f24153-7b5a-47e3-84eb-12bca1a9fac2 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:21.703844 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f24153-7b5a-47e3-84eb-12bca1a9fac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:21.714543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7d532-f0d5-43bf-a36e-0161d5780bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:21.715391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7d532-f0d5-43bf-a36e-0161d5780bc0 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:21.715675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7d532-f0d5-43bf-a36e-0161d5780bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:21.715949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7d532-f0d5-43bf-a36e-0161d5780bc0 None admin] PATH_INFO: `/v3/projects/071be74b98534602bc99a903506b5393` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:21.717136 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7d532-f0d5-43bf-a36e-0161d5780bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=071be74b98534602bc99a903506b5393)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:21.718614 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7d532-f0d5-43bf-a36e-0161d5780bc0 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:21.720302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 554/1099] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:19:21 2022] GET /identity/v3/projects/071be74b98534602bc99a903506b5393 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:21.726228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7d532-f0d5-43bf-a36e-0161d5780bc0 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:21.770660 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f24153-7b5a-47e3-84eb-12bca1a9fac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:21.772128 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f24153-7b5a-47e3-84eb-12bca1a9fac2 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:21.820635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7d532-f0d5-43bf-a36e-0161d5780bc0 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:21.854012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c2403-761d-4ad5-a92c-41ac62e672ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:21.854682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c2403-761d-4ad5-a92c-41ac62e672ff None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:21.854968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c2403-761d-4ad5-a92c-41ac62e672ff None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:21.855243 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c2403-761d-4ad5-a92c-41ac62e672ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:21.856064 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c2403-761d-4ad5-a92c-41ac62e672ff None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=071be74b98534602bc99a903506b5393, user.id=c49be8bb56054976ad52ac655f6d30d2) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:21.856376 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c2403-761d-4ad5-a92c-41ac62e672ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:21.857799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c2403-761d-4ad5-a92c-41ac62e672ff None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:21.863461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 555/1100] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:19:21 2022] GET /identity/v3/role_assignments?user.id=c49be8bb56054976ad52ac655f6d30d2&scope.project.id=071be74b98534602bc99a903506b5393&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:21.867142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 546/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:19:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:19:21.873427 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c2403-761d-4ad5-a92c-41ac62e672ff None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:21.980893 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c2403-761d-4ad5-a92c-41ac62e672ff None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:22.017530 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328038a2-f9b7-4413-8bdf-d8973c81825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:22.018366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328038a2-f9b7-4413-8bdf-d8973c81825d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:22.018647 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328038a2-f9b7-4413-8bdf-d8973c81825d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:22.018942 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328038a2-f9b7-4413-8bdf-d8973c81825d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:22.030309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328038a2-f9b7-4413-8bdf-d8973c81825d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:22.031785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328038a2-f9b7-4413-8bdf-d8973c81825d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:22.050008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-328038a2-f9b7-4413-8bdf-d8973c81825d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:22.050008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:22.050008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:22.050008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:22.050008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:22.050008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:22.050008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:22.050008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:22.050008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:22.050008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:22.050008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:22.050008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:22.050008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:19:22.050008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:19:22.050008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:22.051027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:22.051956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:19:22.051956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:19:22.051956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:19:22.051956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:22.051956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 556/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:22.058025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f24153-7b5a-47e3-84eb-12bca1a9fac2 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:22.158803 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f24153-7b5a-47e3-84eb-12bca1a9fac2 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:22.192827 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490f5a7-6463-4946-8fe4-c0d45145452f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:22.193494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490f5a7-6463-4946-8fe4-c0d45145452f None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:22.193776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490f5a7-6463-4946-8fe4-c0d45145452f None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:22.194051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490f5a7-6463-4946-8fe4-c0d45145452f None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:22.194810 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490f5a7-6463-4946-8fe4-c0d45145452f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:22.195117 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490f5a7-6463-4946-8fe4-c0d45145452f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:22.197039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490f5a7-6463-4946-8fe4-c0d45145452f None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:22.208674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 547/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:22.214240 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328038a2-f9b7-4413-8bdf-d8973c81825d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:22.310762 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328038a2-f9b7-4413-8bdf-d8973c81825d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:22.342761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86856e-18f5-4f1e-9846-8ceb2f2fbd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:22.343533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86856e-18f5-4f1e-9846-8ceb2f2fbd9b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:22.343809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86856e-18f5-4f1e-9846-8ceb2f2fbd9b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:22.344075 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86856e-18f5-4f1e-9846-8ceb2f2fbd9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:22.350431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86856e-18f5-4f1e-9846-8ceb2f2fbd9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:22.351868 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86856e-18f5-4f1e-9846-8ceb2f2fbd9b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:22.365934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-2c86856e-18f5-4f1e-9846-8ceb2f2fbd9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:19:22.365934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:22.365934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:22.365934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:22.365934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:22.365934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:22.365934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:22.365934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:22.365934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:22.365934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:22.365934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:22.365934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:22.365934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:19:22.365934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:19:22.365934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:22.366902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:22.367966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:19:22.367966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:19:22.367966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:19:22.367966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:19:22.367966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:19:22.367966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:19:22.367966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:19:22.367966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:22.367966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 557/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:19:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:19:22.372900 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490f5a7-6463-4946-8fe4-c0d45145452f None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:22.468673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490f5a7-6463-4946-8fe4-c0d45145452f None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:22.501228 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21e9ba-85cd-4180-b2e8-2102b491696a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:22.501884 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21e9ba-85cd-4180-b2e8-2102b491696a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:22.502162 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21e9ba-85cd-4180-b2e8-2102b491696a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:22.502457 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21e9ba-85cd-4180-b2e8-2102b491696a None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:22.503239 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21e9ba-85cd-4180-b2e8-2102b491696a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:22.503543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21e9ba-85cd-4180-b2e8-2102b491696a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:22.504958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21e9ba-85cd-4180-b2e8-2102b491696a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:22.516690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 548/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:19:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:22.522643 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86856e-18f5-4f1e-9846-8ceb2f2fbd9b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:22.617796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86856e-18f5-4f1e-9846-8ceb2f2fbd9b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:22.648930 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbc6b0-7e67-4b78-afd4-e70f655b0ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:22.650116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbc6b0-7e67-4b78-afd4-e70f655b0ded None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:22.650526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbc6b0-7e67-4b78-afd4-e70f655b0ded None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:22.651019 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbc6b0-7e67-4b78-afd4-e70f655b0ded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:22.651864 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbc6b0-7e67-4b78-afd4-e70f655b0ded None admin] RBAC: Adding query filter params (role.id=a00f17971455442b93c3cd2f40b9daad, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=1f443d2ca1534249bb2c4096300ddffd) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:22.652170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbc6b0-7e67-4b78-afd4-e70f655b0ded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:22.653596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbc6b0-7e67-4b78-afd4-e70f655b0ded None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:22.659422 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 558/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:19:22 2022] GET /identity/v3/role_assignments?user.id=1f443d2ca1534249bb2c4096300ddffd&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=a00f17971455442b93c3cd2f40b9daad => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:24.125293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a61b-792b-444f-a438-6b3caf6595e7 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:24.125824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a61b-792b-444f-a438-6b3caf6595e7 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:24.125824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a61b-792b-444f-a438-6b3caf6595e7 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:24.127226 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 549/1107] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:24.132520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758479f-f64f-4617-95a8-dba0817aed39 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:24.132904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758479f-f64f-4617-95a8-dba0817aed39 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:24.133076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758479f-f64f-4617-95a8-dba0817aed39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:24.150586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-a758479f-f64f-4617-95a8-dba0817aed39 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:24.151760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a758479f-f64f-4617-95a8-dba0817aed39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:24.216615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 559/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:24.240840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1a61b-792b-444f-a438-6b3caf6595e7 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:24.343292 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1a61b-792b-444f-a438-6b3caf6595e7 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:24.376990 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4809a-9180-41ec-8db0-8a78f17176a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:24.377709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4809a-9180-41ec-8db0-8a78f17176a7 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:24.377993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4809a-9180-41ec-8db0-8a78f17176a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:24.378304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4809a-9180-41ec-8db0-8a78f17176a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:24.379470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4809a-9180-41ec-8db0-8a78f17176a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:24.380921 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4809a-9180-41ec-8db0-8a78f17176a7 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:24.382566 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 550/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:24.388891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758479f-f64f-4617-95a8-dba0817aed39 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:24.481989 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758479f-f64f-4617-95a8-dba0817aed39 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:24.514681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdef19-c8ba-4206-bfa6-003fb5530951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:24.515344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdef19-c8ba-4206-bfa6-003fb5530951 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:24.515624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdef19-c8ba-4206-bfa6-003fb5530951 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:24.515898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdef19-c8ba-4206-bfa6-003fb5530951 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:24.516602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdef19-c8ba-4206-bfa6-003fb5530951 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:24.518026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdef19-c8ba-4206-bfa6-003fb5530951 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:24.537359 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 560/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:19:24 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:19:26.801035 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bd549-f7de-4c8f-a39f-171e0b4ee83b None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:26.801592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bd549-f7de-4c8f-a39f-171e0b4ee83b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:26.801592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bd549-f7de-4c8f-a39f-171e0b4ee83b None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:26.803089 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 551/1111] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:26.808994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3de75-18fd-4918-a9a5-3091b604563b None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:26.809417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3de75-18fd-4918-a9a5-3091b604563b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:26.809557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3de75-18fd-4918-a9a5-3091b604563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:26.826453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-ccd3de75-18fd-4918-a9a5-3091b604563b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:26.827631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ccd3de75-18fd-4918-a9a5-3091b604563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:26.891109 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 561/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:26.914269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bd549-f7de-4c8f-a39f-171e0b4ee83b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:27.013888 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bd549-f7de-4c8f-a39f-171e0b4ee83b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:27.047289 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd59861-3256-4051-9da6-b72d0f13c477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:27.048127 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd59861-3256-4051-9da6-b72d0f13c477 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:27.048408 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd59861-3256-4051-9da6-b72d0f13c477 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:27.048681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd59861-3256-4051-9da6-b72d0f13c477 None admin] PATH_INFO: `/v3/roles/c010c38ef8f54067ad2da8aef99dbdcd` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:27.050133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd59861-3256-4051-9da6-b72d0f13c477 None admin] RBAC: Authorizing `identity:get_role(role_id=c010c38ef8f54067ad2da8aef99dbdcd)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:27.051637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd59861-3256-4051-9da6-b72d0f13c477 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:27.052933 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 552/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:19:26 2022] GET /identity/v3/roles/c010c38ef8f54067ad2da8aef99dbdcd => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:27.059382 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3de75-18fd-4918-a9a5-3091b604563b None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:27.152877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3de75-18fd-4918-a9a5-3091b604563b None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:27.185014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a56249-8eed-4bee-8947-4ebbb4d24781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:27.185875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56249-8eed-4bee-8947-4ebbb4d24781 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:27.186159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56249-8eed-4bee-8947-4ebbb4d24781 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:27.186470 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56249-8eed-4bee-8947-4ebbb4d24781 None admin] PATH_INFO: `/v3/users/6611fab8d0834551813672c87b24eac2` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:27.199175 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a56249-8eed-4bee-8947-4ebbb4d24781 None admin] RBAC: Authorizing `identity:get_user(user_id=6611fab8d0834551813672c87b24eac2)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:27.200641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a56249-8eed-4bee-8947-4ebbb4d24781 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:27.202331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 562/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:19:27 2022] GET /identity/v3/users/6611fab8d0834551813672c87b24eac2 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:27.208430 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd59861-3256-4051-9da6-b72d0f13c477 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:27.302540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd59861-3256-4051-9da6-b72d0f13c477 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:27.334804 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116b75a-b226-4e46-97d7-c35755d778c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:27.335466 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116b75a-b226-4e46-97d7-c35755d778c1 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:27.335769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116b75a-b226-4e46-97d7-c35755d778c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:27.336047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116b75a-b226-4e46-97d7-c35755d778c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:27.400441 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116b75a-b226-4e46-97d7-c35755d778c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:27.401875 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116b75a-b226-4e46-97d7-c35755d778c1 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:27.495027 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 553/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:19:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 14:19:27.501098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a56249-8eed-4bee-8947-4ebbb4d24781 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:27.597260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a56249-8eed-4bee-8947-4ebbb4d24781 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:27.628526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0d58b-af11-4540-9b66-93cc9ecceca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:27.629367 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0d58b-af11-4540-9b66-93cc9ecceca5 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:27.629651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0d58b-af11-4540-9b66-93cc9ecceca5 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:27.629929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0d58b-af11-4540-9b66-93cc9ecceca5 None admin] PATH_INFO: `/v3/projects/071be74b98534602bc99a903506b5393` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:27.631125 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0d58b-af11-4540-9b66-93cc9ecceca5 None admin] RBAC: Authorizing `identity:get_project(project_id=071be74b98534602bc99a903506b5393)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:27.632564 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0d58b-af11-4540-9b66-93cc9ecceca5 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:27.634804 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 563/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:19:27 2022] GET /identity/v3/projects/071be74b98534602bc99a903506b5393 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:27.640863 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116b75a-b226-4e46-97d7-c35755d778c1 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:27.733529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116b75a-b226-4e46-97d7-c35755d778c1 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:27.765628 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99f29a-d219-424b-a3f7-fca9c9135711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:27.766285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99f29a-d219-424b-a3f7-fca9c9135711 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:27.766566 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99f29a-d219-424b-a3f7-fca9c9135711 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:27.766838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99f29a-d219-424b-a3f7-fca9c9135711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:27.767652 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99f29a-d219-424b-a3f7-fca9c9135711 None admin] RBAC: Adding query filter params (role.id=c010c38ef8f54067ad2da8aef99dbdcd, scope.project.id=071be74b98534602bc99a903506b5393, user.id=6611fab8d0834551813672c87b24eac2) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:27.767958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99f29a-d219-424b-a3f7-fca9c9135711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:27.769371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99f29a-d219-424b-a3f7-fca9c9135711 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:27.775167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 554/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:19:27 2022] GET /identity/v3/role_assignments?user.id=6611fab8d0834551813672c87b24eac2&scope.project.id=071be74b98534602bc99a903506b5393&role.id=c010c38ef8f54067ad2da8aef99dbdcd => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:29.965869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2c478-5ab1-423a-98f3-d2010d19172d None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:29.966427 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2c478-5ab1-423a-98f3-d2010d19172d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:29.966526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2c478-5ab1-423a-98f3-d2010d19172d None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:29.967793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 564/1118] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:29.972818 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220769cb-2e54-45a2-83f9-86f107619479 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:29.973192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220769cb-2e54-45a2-83f9-86f107619479 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:29.973371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220769cb-2e54-45a2-83f9-86f107619479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:29.989977 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-220769cb-2e54-45a2-83f9-86f107619479 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:29.991181 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-220769cb-2e54-45a2-83f9-86f107619479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:30.060676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 555/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:30.082964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2c478-5ab1-423a-98f3-d2010d19172d None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:30.178035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2c478-5ab1-423a-98f3-d2010d19172d None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:30.210704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d170475-c2e9-4fc5-ac1f-c56472a149b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:30.211572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d170475-c2e9-4fc5-ac1f-c56472a149b5 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:30.211987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d170475-c2e9-4fc5-ac1f-c56472a149b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:30.212260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d170475-c2e9-4fc5-ac1f-c56472a149b5 None admin] PATH_INFO: `/v3/roles/c010c38ef8f54067ad2da8aef99dbdcd` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:30.213731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d170475-c2e9-4fc5-ac1f-c56472a149b5 None admin] RBAC: Authorizing `identity:get_role(role_id=c010c38ef8f54067ad2da8aef99dbdcd)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:30.215129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d170475-c2e9-4fc5-ac1f-c56472a149b5 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:30.216528 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 565/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:19:30 2022] GET /identity/v3/roles/c010c38ef8f54067ad2da8aef99dbdcd => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:30.222201 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220769cb-2e54-45a2-83f9-86f107619479 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:30.317328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220769cb-2e54-45a2-83f9-86f107619479 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:30.349822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fb72c-2119-49fa-ad57-bc076df1b980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:30.350706 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fb72c-2119-49fa-ad57-bc076df1b980 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:30.350987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fb72c-2119-49fa-ad57-bc076df1b980 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:30.351258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fb72c-2119-49fa-ad57-bc076df1b980 None admin] PATH_INFO: `/v3/users/6611fab8d0834551813672c87b24eac2` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:30.352632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fb72c-2119-49fa-ad57-bc076df1b980 None admin] RBAC: Authorizing `identity:get_user(user_id=6611fab8d0834551813672c87b24eac2)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:30.354130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fb72c-2119-49fa-ad57-bc076df1b980 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:30.355929 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 556/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:19:30 2022] GET /identity/v3/users/6611fab8d0834551813672c87b24eac2 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:30.361616 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d170475-c2e9-4fc5-ac1f-c56472a149b5 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:30.456727 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d170475-c2e9-4fc5-ac1f-c56472a149b5 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:30.489837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620418a8-e1ad-453a-b780-3b01616daafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:30.490650 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620418a8-e1ad-453a-b780-3b01616daafb None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:30.490935 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620418a8-e1ad-453a-b780-3b01616daafb None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:30.491213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620418a8-e1ad-453a-b780-3b01616daafb None admin] PATH_INFO: `/v3/projects/071be74b98534602bc99a903506b5393` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:30.492383 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620418a8-e1ad-453a-b780-3b01616daafb None admin] RBAC: Authorizing `identity:get_project(project_id=071be74b98534602bc99a903506b5393)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:30.494426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620418a8-e1ad-453a-b780-3b01616daafb None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:30.496086 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 566/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:19:30 2022] GET /identity/v3/projects/071be74b98534602bc99a903506b5393 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:30.501943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fb72c-2119-49fa-ad57-bc076df1b980 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:30.596123 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fb72c-2119-49fa-ad57-bc076df1b980 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:30.627335 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e7c3e-83bf-449b-b729-74c1b446e993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:30.628211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e7c3e-83bf-449b-b729-74c1b446e993 None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:30.628486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e7c3e-83bf-449b-b729-74c1b446e993 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:30.628754 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e7c3e-83bf-449b-b729-74c1b446e993 None admin] PATH_INFO: `/v3/projects/071be74b98534602bc99a903506b5393/users/6611fab8d0834551813672c87b24eac2/roles/c010c38ef8f54067ad2da8aef99dbdcd` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:30.630911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e7c3e-83bf-449b-b729-74c1b446e993 None admin] RBAC: Authorizing `identity:create_grant(project_id=071be74b98534602bc99a903506b5393, user_id=6611fab8d0834551813672c87b24eac2, role_id=c010c38ef8f54067ad2da8aef99dbdcd)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:30.632330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e7c3e-83bf-449b-b729-74c1b446e993 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:30.645323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 557/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:19:30 2022] PUT /identity/v3/projects/071be74b98534602bc99a903506b5393/users/6611fab8d0834551813672c87b24eac2/roles/c010c38ef8f54067ad2da8aef99dbdcd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:19:32.819902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65384972-cb4b-4e22-adf8-25c29f8d715c None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:32.820435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65384972-cb4b-4e22-adf8-25c29f8d715c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:32.820435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65384972-cb4b-4e22-adf8-25c29f8d715c None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:32.821826 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 567/1124] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:32.827052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013aa7e-3a77-4a4c-befc-f55302d99ad0 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:32.827429 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013aa7e-3a77-4a4c-befc-f55302d99ad0 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:32.827604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013aa7e-3a77-4a4c-befc-f55302d99ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:32.843915 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-4013aa7e-3a77-4a4c-befc-f55302d99ad0 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:32.845064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-4013aa7e-3a77-4a4c-befc-f55302d99ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:32.907671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 558/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:32.931718 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65384972-cb4b-4e22-adf8-25c29f8d715c None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:33.027168 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65384972-cb4b-4e22-adf8-25c29f8d715c None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:33.059852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a32dd-ebbf-4a41-913e-24c2496081f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:33.060692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a32dd-ebbf-4a41-913e-24c2496081f6 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:33.060974 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a32dd-ebbf-4a41-913e-24c2496081f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:33.061248 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a32dd-ebbf-4a41-913e-24c2496081f6 None admin] PATH_INFO: `/v3/roles/c010c38ef8f54067ad2da8aef99dbdcd` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:33.062756 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a32dd-ebbf-4a41-913e-24c2496081f6 None admin] RBAC: Authorizing `identity:get_role(role_id=c010c38ef8f54067ad2da8aef99dbdcd)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:33.064134 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a32dd-ebbf-4a41-913e-24c2496081f6 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:33.065465 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 568/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:19:32 2022] GET /identity/v3/roles/c010c38ef8f54067ad2da8aef99dbdcd => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:33.071503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013aa7e-3a77-4a4c-befc-f55302d99ad0 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:33.165311 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013aa7e-3a77-4a4c-befc-f55302d99ad0 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:33.197427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4304d98-fe4f-4586-93ee-57ca1147f55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:33.198329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4304d98-fe4f-4586-93ee-57ca1147f55c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:33.198616 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4304d98-fe4f-4586-93ee-57ca1147f55c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:33.198891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4304d98-fe4f-4586-93ee-57ca1147f55c None admin] PATH_INFO: `/v3/users/6611fab8d0834551813672c87b24eac2` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:33.200073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4304d98-fe4f-4586-93ee-57ca1147f55c None admin] RBAC: Authorizing `identity:get_user(user_id=6611fab8d0834551813672c87b24eac2)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:33.201514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4304d98-fe4f-4586-93ee-57ca1147f55c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:33.203166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 559/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:19:33 2022] GET /identity/v3/users/6611fab8d0834551813672c87b24eac2 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:33.209054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a32dd-ebbf-4a41-913e-24c2496081f6 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:33.303739 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a32dd-ebbf-4a41-913e-24c2496081f6 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:33.346305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03332d00-7921-48c4-8705-d540c32cc7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:33.346880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03332d00-7921-48c4-8705-d540c32cc7e1 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:33.347157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03332d00-7921-48c4-8705-d540c32cc7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:33.347434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03332d00-7921-48c4-8705-d540c32cc7e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:33.411358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03332d00-7921-48c4-8705-d540c32cc7e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:33.412805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03332d00-7921-48c4-8705-d540c32cc7e1 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:33.506109 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 569/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:19:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:19:33.512048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4304d98-fe4f-4586-93ee-57ca1147f55c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:33.607444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4304d98-fe4f-4586-93ee-57ca1147f55c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:33.641022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9eaac-38cf-46e6-bd26-db1b9819bfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:33.642320 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9eaac-38cf-46e6-bd26-db1b9819bfb6 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:33.643141 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9eaac-38cf-46e6-bd26-db1b9819bfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:33.643556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9eaac-38cf-46e6-bd26-db1b9819bfb6 None admin] PATH_INFO: `/v3/projects/071be74b98534602bc99a903506b5393` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:33.645324 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9eaac-38cf-46e6-bd26-db1b9819bfb6 None admin] RBAC: Authorizing `identity:get_project(project_id=071be74b98534602bc99a903506b5393)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:33.647601 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9eaac-38cf-46e6-bd26-db1b9819bfb6 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:33.650961 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 560/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:19:33 2022] GET /identity/v3/projects/071be74b98534602bc99a903506b5393 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:33.656829 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03332d00-7921-48c4-8705-d540c32cc7e1 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:33.760142 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03332d00-7921-48c4-8705-d540c32cc7e1 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:33.792265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b521953-b0c5-49ac-8be6-f6d88434d4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:33.792905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521953-b0c5-49ac-8be6-f6d88434d4bd None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:33.793188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521953-b0c5-49ac-8be6-f6d88434d4bd None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:33.793461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521953-b0c5-49ac-8be6-f6d88434d4bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:33.794316 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521953-b0c5-49ac-8be6-f6d88434d4bd None admin] RBAC: Adding query filter params (role.id=c010c38ef8f54067ad2da8aef99dbdcd, scope.project.id=071be74b98534602bc99a903506b5393, user.id=6611fab8d0834551813672c87b24eac2) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:33.794630 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521953-b0c5-49ac-8be6-f6d88434d4bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:33.796058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521953-b0c5-49ac-8be6-f6d88434d4bd None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:33.801731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 570/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:19:33 2022] GET /identity/v3/role_assignments?user.id=6611fab8d0834551813672c87b24eac2&scope.project.id=071be74b98534602bc99a903506b5393&role.id=c010c38ef8f54067ad2da8aef99dbdcd => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:36.018083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115167b-78ff-4c5d-bf47-c3387335ae74 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:36.018643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115167b-78ff-4c5d-bf47-c3387335ae74 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:36.018643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115167b-78ff-4c5d-bf47-c3387335ae74 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:36.020124 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 561/1131] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:36.026027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a98bff-2bfc-4488-ba0f-6321b89d7841 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:36.026475 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a98bff-2bfc-4488-ba0f-6321b89d7841 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:36.026612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a98bff-2bfc-4488-ba0f-6321b89d7841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:36.042679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c3a98bff-2bfc-4488-ba0f-6321b89d7841 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:36.043849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c3a98bff-2bfc-4488-ba0f-6321b89d7841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:36.106521 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 571/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:36.136768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115167b-78ff-4c5d-bf47-c3387335ae74 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:36.234337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115167b-78ff-4c5d-bf47-c3387335ae74 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:36.267101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4543c-6494-4ff7-9cbe-37b45a1f84f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:36.268081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4543c-6494-4ff7-9cbe-37b45a1f84f8 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:36.268253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4543c-6494-4ff7-9cbe-37b45a1f84f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:36.268419 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4543c-6494-4ff7-9cbe-37b45a1f84f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:36.269586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4543c-6494-4ff7-9cbe-37b45a1f84f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:36.271061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4543c-6494-4ff7-9cbe-37b45a1f84f8 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:36.272665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 562/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:36.278549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a98bff-2bfc-4488-ba0f-6321b89d7841 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:36.373177 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a98bff-2bfc-4488-ba0f-6321b89d7841 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:36.405355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ff80d-3baf-4b14-81da-dddc7a5d72d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:36.406017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ff80d-3baf-4b14-81da-dddc7a5d72d3 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:36.406332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ff80d-3baf-4b14-81da-dddc7a5d72d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:36.406613 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ff80d-3baf-4b14-81da-dddc7a5d72d3 None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:36.407315 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ff80d-3baf-4b14-81da-dddc7a5d72d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:36.408748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ff80d-3baf-4b14-81da-dddc7a5d72d3 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:36.434416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 572/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 14:19:36 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:19:38.699689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e501217-8ce8-46f7-af94-31df7dd0fb67 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:38.700212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e501217-8ce8-46f7-af94-31df7dd0fb67 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:38.700305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e501217-8ce8-46f7-af94-31df7dd0fb67 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:38.701585 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 563/1135] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:38.707154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1ade3-25ef-4f43-825e-77e639d6db90 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:38.707576 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1ade3-25ef-4f43-825e-77e639d6db90 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:38.707707 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1ade3-25ef-4f43-825e-77e639d6db90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:38.725199 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-6ba1ade3-25ef-4f43-825e-77e639d6db90 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:38.726395 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6ba1ade3-25ef-4f43-825e-77e639d6db90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:38.790005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 573/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:38.814710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e501217-8ce8-46f7-af94-31df7dd0fb67 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:38.913209 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e501217-8ce8-46f7-af94-31df7dd0fb67 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:38.945326 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65fd07-64ed-4139-9166-429b10b29589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:38.946666 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65fd07-64ed-4139-9166-429b10b29589 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:38.946945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65fd07-64ed-4139-9166-429b10b29589 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:38.947220 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65fd07-64ed-4139-9166-429b10b29589 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:38.948387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65fd07-64ed-4139-9166-429b10b29589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:38.949869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65fd07-64ed-4139-9166-429b10b29589 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:38.951436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 564/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:19:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:38.957333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1ade3-25ef-4f43-825e-77e639d6db90 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:39.049018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1ade3-25ef-4f43-825e-77e639d6db90 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:39.081083 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3c7b7-98f4-4f22-b4ed-8a0d4e9c4701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:39.081735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3c7b7-98f4-4f22-b4ed-8a0d4e9c4701 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:39.082015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3c7b7-98f4-4f22-b4ed-8a0d4e9c4701 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:39.082318 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3c7b7-98f4-4f22-b4ed-8a0d4e9c4701 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:39.083026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3c7b7-98f4-4f22-b4ed-8a0d4e9c4701 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:39.084448 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3c7b7-98f4-4f22-b4ed-8a0d4e9c4701 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:39.104695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 574/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:19:38 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:19:41.364925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7083d0-74fe-4222-9469-ed427736a003 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:41.365470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7083d0-74fe-4222-9469-ed427736a003 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:41.365470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7083d0-74fe-4222-9469-ed427736a003 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:41.366871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 565/1139] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:41.372634 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735e9e-9249-4715-ace3-701a0f976e1f None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:41.373028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735e9e-9249-4715-ace3-701a0f976e1f None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:41.373187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735e9e-9249-4715-ace3-701a0f976e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:41.389945 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-a2735e9e-9249-4715-ace3-701a0f976e1f None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:41.391155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a2735e9e-9249-4715-ace3-701a0f976e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:41.456055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 575/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:41.480261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7083d0-74fe-4222-9469-ed427736a003 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:41.581190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7083d0-74fe-4222-9469-ed427736a003 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:41.614872 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8783492-2e38-4718-a35a-eceb2eb72571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:41.615667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8783492-2e38-4718-a35a-eceb2eb72571 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:41.615953 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8783492-2e38-4718-a35a-eceb2eb72571 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:41.616232 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8783492-2e38-4718-a35a-eceb2eb72571 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:41.626702 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8783492-2e38-4718-a35a-eceb2eb72571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-b8783492-2e38-4718-a35a-eceb2eb72571 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:19:41.635177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:41.636283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:41.642102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:41.642102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:41.642102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:41.642102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:41.642102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:19:41.642102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:19:41.642102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:19:41.642102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:19:41.642102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:19:41.642102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:19:41.642102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:19:41.642102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:41.642102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 566/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:19:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:41.642876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735e9e-9249-4715-ace3-701a0f976e1f None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:41.735796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735e9e-9249-4715-ace3-701a0f976e1f None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:41.767701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9ed57-4d51-47dc-a28e-331ba62ac383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:41.768354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9ed57-4d51-47dc-a28e-331ba62ac383 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:41.768639 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9ed57-4d51-47dc-a28e-331ba62ac383 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:41.768915 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9ed57-4d51-47dc-a28e-331ba62ac383 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:41.769658 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9ed57-4d51-47dc-a28e-331ba62ac383 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:41.769966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9ed57-4d51-47dc-a28e-331ba62ac383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:41.771375 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9ed57-4d51-47dc-a28e-331ba62ac383 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:41.779288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 576/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:19:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:41.785197 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8783492-2e38-4718-a35a-eceb2eb72571 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:41.879424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8783492-2e38-4718-a35a-eceb2eb72571 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:41.910226 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6aa806-eb8a-4016-b629-ae5d22213b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:41.911072 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6aa806-eb8a-4016-b629-ae5d22213b9c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:41.911354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6aa806-eb8a-4016-b629-ae5d22213b9c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:41.911627 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6aa806-eb8a-4016-b629-ae5d22213b9c None admin] PATH_INFO: `/v3/users/adc75e4c8648463c84ef4dbbc96c1113` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:41.924478 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6aa806-eb8a-4016-b629-ae5d22213b9c None admin] RBAC: Authorizing `identity:get_user(user_id=adc75e4c8648463c84ef4dbbc96c1113)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:41.925896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6aa806-eb8a-4016-b629-ae5d22213b9c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:41.927526 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 567/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:19:41 2022] GET /identity/v3/users/adc75e4c8648463c84ef4dbbc96c1113 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:41.933758 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9ed57-4d51-47dc-a28e-331ba62ac383 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:42.028482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9ed57-4d51-47dc-a28e-331ba62ac383 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:42.060464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e042ce-818c-4073-8033-92f1d0a7a8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:42.061102 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e042ce-818c-4073-8033-92f1d0a7a8de None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:42.061385 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e042ce-818c-4073-8033-92f1d0a7a8de None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:42.061663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e042ce-818c-4073-8033-92f1d0a7a8de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:42.125233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e042ce-818c-4073-8033-92f1d0a7a8de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:42.126711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e042ce-818c-4073-8033-92f1d0a7a8de None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:42.220780 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 577/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:19:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:19:42.226730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6aa806-eb8a-4016-b629-ae5d22213b9c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:42.323001 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6aa806-eb8a-4016-b629-ae5d22213b9c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:42.355589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6ed2e-0931-4db7-8609-c7225d7e6b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:42.356429 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6ed2e-0931-4db7-8609-c7225d7e6b09 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:42.356713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6ed2e-0931-4db7-8609-c7225d7e6b09 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:42.356987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6ed2e-0931-4db7-8609-c7225d7e6b09 None admin] PATH_INFO: `/v3/projects/031f9f141283448ab66dae8a74cec7f7` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:42.358135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6ed2e-0931-4db7-8609-c7225d7e6b09 None admin] RBAC: Authorizing `identity:get_project(project_id=031f9f141283448ab66dae8a74cec7f7)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:42.359602 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6ed2e-0931-4db7-8609-c7225d7e6b09 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:42.361241 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 568/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:19:42 2022] GET /identity/v3/projects/031f9f141283448ab66dae8a74cec7f7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:42.367263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e042ce-818c-4073-8033-92f1d0a7a8de None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:42.459381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e042ce-818c-4073-8033-92f1d0a7a8de None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:42.490962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ec79d-2226-4332-8b13-6a96c3566971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:42.491633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ec79d-2226-4332-8b13-6a96c3566971 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:42.491915 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ec79d-2226-4332-8b13-6a96c3566971 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:42.492197 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ec79d-2226-4332-8b13-6a96c3566971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:42.493045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ec79d-2226-4332-8b13-6a96c3566971 None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=031f9f141283448ab66dae8a74cec7f7, user.id=adc75e4c8648463c84ef4dbbc96c1113) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:42.493352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ec79d-2226-4332-8b13-6a96c3566971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:42.494806 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ec79d-2226-4332-8b13-6a96c3566971 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:42.499962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 578/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:19:42 2022] GET /identity/v3/role_assignments?user.id=adc75e4c8648463c84ef4dbbc96c1113&scope.project.id=031f9f141283448ab66dae8a74cec7f7&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:19:44.688443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3630f64-6ef9-475e-a697-0ee0a1659320 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:44.688970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3630f64-6ef9-475e-a697-0ee0a1659320 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:44.689065 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3630f64-6ef9-475e-a697-0ee0a1659320 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:44.690382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 569/1147] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:44.695648 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950057d9-01f3-4417-9f3e-03ffdcc6e2ac None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:44.696079 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950057d9-01f3-4417-9f3e-03ffdcc6e2ac None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:44.696172 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950057d9-01f3-4417-9f3e-03ffdcc6e2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:44.712466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-950057d9-01f3-4417-9f3e-03ffdcc6e2ac None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:44.713615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-950057d9-01f3-4417-9f3e-03ffdcc6e2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:44.776506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 579/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:19:44.799816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3630f64-6ef9-475e-a697-0ee0a1659320 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:44.899068 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3630f64-6ef9-475e-a697-0ee0a1659320 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:44.931648 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1d344-18ca-4292-bd0b-3f0f530d6e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:44.932422 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1d344-18ca-4292-bd0b-3f0f530d6e68 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:44.932703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1d344-18ca-4292-bd0b-3f0f530d6e68 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:44.932976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1d344-18ca-4292-bd0b-3f0f530d6e68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:44.942750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1d344-18ca-4292-bd0b-3f0f530d6e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-a5a1d344-18ca-4292-bd0b-3f0f530d6e68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:19:44.950305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:44.951328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:44.952164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:44.952164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:44.952164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:44.952164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:44.952164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:19:44.952164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:19:44.952164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:19:44.952164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:19:44.952164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:19:44.952164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:19:44.952164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:19:44.952164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:44.952164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 570/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:19:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:44.957781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950057d9-01f3-4417-9f3e-03ffdcc6e2ac None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:45.051018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950057d9-01f3-4417-9f3e-03ffdcc6e2ac None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:45.082664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227353cb-1785-4572-a030-0ec83e91f0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:45.083313 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227353cb-1785-4572-a030-0ec83e91f0a0 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:45.083611 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227353cb-1785-4572-a030-0ec83e91f0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:45.083872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227353cb-1785-4572-a030-0ec83e91f0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:45.084609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227353cb-1785-4572-a030-0ec83e91f0a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:45.084910 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227353cb-1785-4572-a030-0ec83e91f0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:45.086879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227353cb-1785-4572-a030-0ec83e91f0a0 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:45.094585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 580/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:19:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:45.100461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1d344-18ca-4292-bd0b-3f0f530d6e68 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:45.204398 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1d344-18ca-4292-bd0b-3f0f530d6e68 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:45.237738 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9f1f7-4da7-436c-85b5-8ef615b7ce7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:45.238623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9f1f7-4da7-436c-85b5-8ef615b7ce7e None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:45.238903 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9f1f7-4da7-436c-85b5-8ef615b7ce7e None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:45.239176 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9f1f7-4da7-436c-85b5-8ef615b7ce7e None admin] PATH_INFO: `/v3/users/adc75e4c8648463c84ef4dbbc96c1113` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:45.240341 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9f1f7-4da7-436c-85b5-8ef615b7ce7e None admin] RBAC: Authorizing `identity:get_user(user_id=adc75e4c8648463c84ef4dbbc96c1113)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:45.241775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9f1f7-4da7-436c-85b5-8ef615b7ce7e None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:45.243448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 571/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:19:45 2022] GET /identity/v3/users/adc75e4c8648463c84ef4dbbc96c1113 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:45.249284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227353cb-1785-4572-a030-0ec83e91f0a0 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:45.343745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227353cb-1785-4572-a030-0ec83e91f0a0 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:45.375246 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981388f0-2b1f-4a53-8f60-edfabcdc3ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:45.376091 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981388f0-2b1f-4a53-8f60-edfabcdc3ff5 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:45.376375 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981388f0-2b1f-4a53-8f60-edfabcdc3ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:45.376648 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981388f0-2b1f-4a53-8f60-edfabcdc3ff5 None admin] PATH_INFO: `/v3/projects/031f9f141283448ab66dae8a74cec7f7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:45.377813 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981388f0-2b1f-4a53-8f60-edfabcdc3ff5 None admin] RBAC: Authorizing `identity:get_project(project_id=031f9f141283448ab66dae8a74cec7f7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:45.379282 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981388f0-2b1f-4a53-8f60-edfabcdc3ff5 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:45.380946 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 581/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:19:45 2022] GET /identity/v3/projects/031f9f141283448ab66dae8a74cec7f7 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:45.387347 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9f1f7-4da7-436c-85b5-8ef615b7ce7e None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:45.487002 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9f1f7-4da7-436c-85b5-8ef615b7ce7e None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:45.519119 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3c4dd-0899-4158-ae91-2d892b66e966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:45.519987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3c4dd-0899-4158-ae91-2d892b66e966 None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:45.520267 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3c4dd-0899-4158-ae91-2d892b66e966 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:45.520538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3c4dd-0899-4158-ae91-2d892b66e966 None admin] PATH_INFO: `/v3/projects/031f9f141283448ab66dae8a74cec7f7/users/adc75e4c8648463c84ef4dbbc96c1113/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:45.522476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3c4dd-0899-4158-ae91-2d892b66e966 None admin] RBAC: Authorizing `identity:create_grant(project_id=031f9f141283448ab66dae8a74cec7f7, user_id=adc75e4c8648463c84ef4dbbc96c1113, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:45.524474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3c4dd-0899-4158-ae91-2d892b66e966 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:45.536944 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 572/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:19:45 2022] PUT /identity/v3/projects/031f9f141283448ab66dae8a74cec7f7/users/adc75e4c8648463c84ef4dbbc96c1113/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:19:47.735605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834533c6-967c-493f-8876-f89971d5c82e None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:47.736135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834533c6-967c-493f-8876-f89971d5c82e None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:47.736244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834533c6-967c-493f-8876-f89971d5c82e None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:47.737531 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 582/1154] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:47.742939 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75da70-41ee-4672-b9ac-25b46688e40d None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:47.743334 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75da70-41ee-4672-b9ac-25b46688e40d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:47.743499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75da70-41ee-4672-b9ac-25b46688e40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:47.760398 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-af75da70-41ee-4672-b9ac-25b46688e40d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:47.761590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-af75da70-41ee-4672-b9ac-25b46688e40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:47.825650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 573/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:47.849745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834533c6-967c-493f-8876-f89971d5c82e None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:47.946382 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834533c6-967c-493f-8876-f89971d5c82e None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:47.978486 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64722fb8-ace0-424e-bb4b-26f6d8865f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:47.979260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64722fb8-ace0-424e-bb4b-26f6d8865f53 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:47.979546 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64722fb8-ace0-424e-bb4b-26f6d8865f53 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:47.979822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64722fb8-ace0-424e-bb4b-26f6d8865f53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:47.989466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64722fb8-ace0-424e-bb4b-26f6d8865f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-64722fb8-ace0-424e-bb4b-26f6d8865f53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:19:47.997041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:47.998160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:47.999388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:47.999388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:47.999388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:47.999388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:47.999388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:19:47.999388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:19:47.999388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:19:47.999388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:19:47.999388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:19:47.999388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:19:47.999388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:19:47.999388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:19:47.999388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 583/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:19:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:48.004152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75da70-41ee-4672-b9ac-25b46688e40d None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:48.099269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75da70-41ee-4672-b9ac-25b46688e40d None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:48.131474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee06cdf-16f6-488f-a0ae-e83d480624ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:48.132129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee06cdf-16f6-488f-a0ae-e83d480624ac None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:48.132414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee06cdf-16f6-488f-a0ae-e83d480624ac None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:48.133273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee06cdf-16f6-488f-a0ae-e83d480624ac None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:48.134485 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee06cdf-16f6-488f-a0ae-e83d480624ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:48.134800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee06cdf-16f6-488f-a0ae-e83d480624ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:48.136172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee06cdf-16f6-488f-a0ae-e83d480624ac None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:48.143965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 574/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:19:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:48.150023 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64722fb8-ace0-424e-bb4b-26f6d8865f53 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:48.248333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64722fb8-ace0-424e-bb4b-26f6d8865f53 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:48.280490 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590902e-77be-4e3b-86df-934ad55b48ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:48.281735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590902e-77be-4e3b-86df-934ad55b48ae None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:48.282243 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590902e-77be-4e3b-86df-934ad55b48ae None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:48.282720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590902e-77be-4e3b-86df-934ad55b48ae None admin] PATH_INFO: `/v3/users/adc75e4c8648463c84ef4dbbc96c1113` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:48.284778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590902e-77be-4e3b-86df-934ad55b48ae None admin] RBAC: Authorizing `identity:get_user(user_id=adc75e4c8648463c84ef4dbbc96c1113)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:48.287481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590902e-77be-4e3b-86df-934ad55b48ae None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:48.290499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 584/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:19:48 2022] GET /identity/v3/users/adc75e4c8648463c84ef4dbbc96c1113 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:48.296189 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee06cdf-16f6-488f-a0ae-e83d480624ac None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:48.393808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee06cdf-16f6-488f-a0ae-e83d480624ac None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:48.426306 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4505175-efab-4ead-9ed2-8c5a78e93589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:48.426937 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505175-efab-4ead-9ed2-8c5a78e93589 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:48.427220 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505175-efab-4ead-9ed2-8c5a78e93589 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:48.427496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505175-efab-4ead-9ed2-8c5a78e93589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:48.492050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4505175-efab-4ead-9ed2-8c5a78e93589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:48.494516 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4505175-efab-4ead-9ed2-8c5a78e93589 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:48.588778 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 575/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:19:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:19:48.594639 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590902e-77be-4e3b-86df-934ad55b48ae None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:48.689766 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590902e-77be-4e3b-86df-934ad55b48ae None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:48.720635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3a5b2-08b4-4df4-99f9-bd2728001f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:48.721479 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3a5b2-08b4-4df4-99f9-bd2728001f26 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:48.721760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3a5b2-08b4-4df4-99f9-bd2728001f26 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:48.722033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3a5b2-08b4-4df4-99f9-bd2728001f26 None admin] PATH_INFO: `/v3/projects/031f9f141283448ab66dae8a74cec7f7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:48.723221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3a5b2-08b4-4df4-99f9-bd2728001f26 None admin] RBAC: Authorizing `identity:get_project(project_id=031f9f141283448ab66dae8a74cec7f7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:48.724653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3a5b2-08b4-4df4-99f9-bd2728001f26 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:48.726312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 585/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:19:48 2022] GET /identity/v3/projects/031f9f141283448ab66dae8a74cec7f7 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:48.732777 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4505175-efab-4ead-9ed2-8c5a78e93589 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:48.827967 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4505175-efab-4ead-9ed2-8c5a78e93589 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:48.861916 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878b5a1-35a0-46c3-a906-af8d1194b622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:48.862720 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878b5a1-35a0-46c3-a906-af8d1194b622 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:48.863005 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878b5a1-35a0-46c3-a906-af8d1194b622 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:48.863280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878b5a1-35a0-46c3-a906-af8d1194b622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:48.864110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878b5a1-35a0-46c3-a906-af8d1194b622 None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=031f9f141283448ab66dae8a74cec7f7, user.id=adc75e4c8648463c84ef4dbbc96c1113) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:48.864419 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878b5a1-35a0-46c3-a906-af8d1194b622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:48.865841 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878b5a1-35a0-46c3-a906-af8d1194b622 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:48.871542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 576/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:19:48 2022] GET /identity/v3/role_assignments?user.id=adc75e4c8648463c84ef4dbbc96c1113&scope.project.id=031f9f141283448ab66dae8a74cec7f7&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:51.098596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e6fba-8ad7-43a6-8cc7-63a6a4d25b3d None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:51.099230 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e6fba-8ad7-43a6-8cc7-63a6a4d25b3d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:51.099230 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e6fba-8ad7-43a6-8cc7-63a6a4d25b3d None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:51.100482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 586/1162] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:51.106505 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663ee85-dc9a-4dd6-b1d0-926e2f1b15aa None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:51.106910 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663ee85-dc9a-4dd6-b1d0-926e2f1b15aa None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:51.107055 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663ee85-dc9a-4dd6-b1d0-926e2f1b15aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:51.123336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-c663ee85-dc9a-4dd6-b1d0-926e2f1b15aa None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:51.124508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c663ee85-dc9a-4dd6-b1d0-926e2f1b15aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:51.187696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 577/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:51.210099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e6fba-8ad7-43a6-8cc7-63a6a4d25b3d None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:51.310454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e6fba-8ad7-43a6-8cc7-63a6a4d25b3d None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:51.343245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7d331-5020-444c-96fe-6c9118361bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:51.343880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7d331-5020-444c-96fe-6c9118361bd7 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:51.344162 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7d331-5020-444c-96fe-6c9118361bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:51.344435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7d331-5020-444c-96fe-6c9118361bd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:51.407959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7d331-5020-444c-96fe-6c9118361bd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:51.409497 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7d331-5020-444c-96fe-6c9118361bd7 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:51.502261 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 587/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:19:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:19:51.508919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663ee85-dc9a-4dd6-b1d0-926e2f1b15aa None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:51.605062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663ee85-dc9a-4dd6-b1d0-926e2f1b15aa None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:51.637251 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead396c-5b10-4495-bd64-b95389cb68e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:51.638025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead396c-5b10-4495-bd64-b95389cb68e2 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:51.638334 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead396c-5b10-4495-bd64-b95389cb68e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:51.638607 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead396c-5b10-4495-bd64-b95389cb68e2 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:51.644960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead396c-5b10-4495-bd64-b95389cb68e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:51.646416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead396c-5b10-4495-bd64-b95389cb68e2 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-8ead396c-5b10-4495-bd64-b95389cb68e2 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:19:51.661366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:19:51.662639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:19:51.663745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:19:51.663745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:19:51.663745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:19:51.663745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:19:51.663745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:19:51.663745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:19:51.663745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:19:51.663745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:19:51.663745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:19:51.663745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:19:51.663745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 17 14:19:51.663745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:19:51.663745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 17 14:19:51.663745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:19:51.663745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 578/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 14:19:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:19:51.668512 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7d331-5020-444c-96fe-6c9118361bd7 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:51.762672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7d331-5020-444c-96fe-6c9118361bd7 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:51.795025 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3992b-ec35-4120-82c4-da1535422e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:51.795671 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3992b-ec35-4120-82c4-da1535422e24 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:51.795956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3992b-ec35-4120-82c4-da1535422e24 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:51.796233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3992b-ec35-4120-82c4-da1535422e24 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:51.796950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3992b-ec35-4120-82c4-da1535422e24 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:19:51.797257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3992b-ec35-4120-82c4-da1535422e24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:51.798660 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3992b-ec35-4120-82c4-da1535422e24 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:51.806104 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 588/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 17 14:19:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:54.044814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7ee3a-65a3-4a2a-9aa0-db610234eb5d None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:54.045376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7ee3a-65a3-4a2a-9aa0-db610234eb5d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:54.045376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7ee3a-65a3-4a2a-9aa0-db610234eb5d None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:54.046764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 579/1167] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:54.052136 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fb716-0e6b-44e2-b91d-df6f975a76a0 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:54.052554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fb716-0e6b-44e2-b91d-df6f975a76a0 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:54.052686 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fb716-0e6b-44e2-b91d-df6f975a76a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:54.070535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-5a4fb716-0e6b-44e2-b91d-df6f975a76a0 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:54.071706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5a4fb716-0e6b-44e2-b91d-df6f975a76a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:54.133957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 589/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:54.156725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7ee3a-65a3-4a2a-9aa0-db610234eb5d None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:54.253821 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7ee3a-65a3-4a2a-9aa0-db610234eb5d None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:54.286331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916fc44-3d32-4d61-8101-9b94b9f8e2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:54.286985 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916fc44-3d32-4d61-8101-9b94b9f8e2d9 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:54.287268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916fc44-3d32-4d61-8101-9b94b9f8e2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:54.287547 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916fc44-3d32-4d61-8101-9b94b9f8e2d9 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:54.288295 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916fc44-3d32-4d61-8101-9b94b9f8e2d9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:54.290495 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916fc44-3d32-4d61-8101-9b94b9f8e2d9 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:54.304674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 580/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Tue May 17 14:19:54 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:19:56.581678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681adfd-3b3b-41fe-acd1-9fb7ecd6940e None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:56.582203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681adfd-3b3b-41fe-acd1-9fb7ecd6940e None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:56.582203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681adfd-3b3b-41fe-acd1-9fb7ecd6940e None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:56.583502 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 590/1170] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:56.589262 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618f1d4-d334-456b-ac84-66eac501778f None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:56.589639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618f1d4-d334-456b-ac84-66eac501778f None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:56.589833 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618f1d4-d334-456b-ac84-66eac501778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:56.606792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-e618f1d4-d334-456b-ac84-66eac501778f None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:56.607962 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e618f1d4-d334-456b-ac84-66eac501778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:56.671496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 581/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:56.696308 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681adfd-3b3b-41fe-acd1-9fb7ecd6940e None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:56.791895 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681adfd-3b3b-41fe-acd1-9fb7ecd6940e None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:56.823566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98017bb-7429-4f60-bb4e-eb02bb0afc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:56.824403 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98017bb-7429-4f60-bb4e-eb02bb0afc0d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:56.824677 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98017bb-7429-4f60-bb4e-eb02bb0afc0d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:56.824944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98017bb-7429-4f60-bb4e-eb02bb0afc0d None admin] PATH_INFO: `/v3/domains/b25a5ebf1f01429c89fe244ede7e65cc` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:56.834987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98017bb-7429-4f60-bb4e-eb02bb0afc0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=b25a5ebf1f01429c89fe244ede7e65cc)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:56.836434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98017bb-7429-4f60-bb4e-eb02bb0afc0d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:56.838006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 591/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Tue May 17 14:19:56 2022] GET /identity/v3/domains/b25a5ebf1f01429c89fe244ede7e65cc => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:56.843720 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618f1d4-d334-456b-ac84-66eac501778f None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:56.937715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618f1d4-d334-456b-ac84-66eac501778f None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:56.970109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215ccce-166a-421b-aa50-2c8940d24399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:56.970779 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215ccce-166a-421b-aa50-2c8940d24399 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:56.971056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215ccce-166a-421b-aa50-2c8940d24399 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:56.971326 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215ccce-166a-421b-aa50-2c8940d24399 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:56.972031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215ccce-166a-421b-aa50-2c8940d24399 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:56.973436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215ccce-166a-421b-aa50-2c8940d24399 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:56.998319 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 582/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 14:19:56 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:19:59.231692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b22efb-9935-4588-8d59-42b93dc182e4 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:59.232120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b22efb-9935-4588-8d59-42b93dc182e4 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:59.232238 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b22efb-9935-4588-8d59-42b93dc182e4 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:59.233585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 592/1174] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:19:59.238761 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f8a07-a77c-41ed-b5a8-6a13a3514fca None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:59.239185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f8a07-a77c-41ed-b5a8-6a13a3514fca None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:59.239322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f8a07-a77c-41ed-b5a8-6a13a3514fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:59.255972 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-515f8a07-a77c-41ed-b5a8-6a13a3514fca None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:19:59.257152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-515f8a07-a77c-41ed-b5a8-6a13a3514fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:19:59.321491 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 583/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:19:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:19:59.345965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b22efb-9935-4588-8d59-42b93dc182e4 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:59.442991 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b22efb-9935-4588-8d59-42b93dc182e4 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:59.475821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35e626-1668-464c-bdc9-8a677bd54c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:59.477058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35e626-1668-464c-bdc9-8a677bd54c25 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:59.477340 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35e626-1668-464c-bdc9-8a677bd54c25 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:59.477617 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35e626-1668-464c-bdc9-8a677bd54c25 None admin] PATH_INFO: `/v3/domains/b25a5ebf1f01429c89fe244ede7e65cc` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:59.478818 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35e626-1668-464c-bdc9-8a677bd54c25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b25a5ebf1f01429c89fe244ede7e65cc)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:59.480246 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35e626-1668-464c-bdc9-8a677bd54c25 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:59.481847 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 593/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Tue May 17 14:19:59 2022] GET /identity/v3/domains/b25a5ebf1f01429c89fe244ede7e65cc => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:19:59.487603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f8a07-a77c-41ed-b5a8-6a13a3514fca None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:19:59.582634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f8a07-a77c-41ed-b5a8-6a13a3514fca None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:19:59.614236 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d469150-964a-4920-a360-e8fb36d1fe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:19:59.614894 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d469150-964a-4920-a360-e8fb36d1fe80 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:19:59.615180 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d469150-964a-4920-a360-e8fb36d1fe80 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:19:59.615456 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d469150-964a-4920-a360-e8fb36d1fe80 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:19:59.616162 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d469150-964a-4920-a360-e8fb36d1fe80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:19:59.618209 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d469150-964a-4920-a360-e8fb36d1fe80 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:19:59.636542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 584/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:19:59 2022] POST /identity/v3/users => generated 311 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:20:01.864619 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a295a-ab24-4b06-b9fb-f149242f9de8 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:01.865186 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a295a-ab24-4b06-b9fb-f149242f9de8 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:01.865186 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a295a-ab24-4b06-b9fb-f149242f9de8 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:01.867281 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 594/1178] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:20:01.872438 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c656ded-34ca-4905-9436-b7984b26f1bf None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:01.872857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c656ded-34ca-4905-9436-b7984b26f1bf None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:01.872995 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c656ded-34ca-4905-9436-b7984b26f1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:01.889864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-3c656ded-34ca-4905-9436-b7984b26f1bf None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:20:01.891083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3c656ded-34ca-4905-9436-b7984b26f1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:20:01.954735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 585/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:20:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:20:01.978815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a295a-ab24-4b06-b9fb-f149242f9de8 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:02.075764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a295a-ab24-4b06-b9fb-f149242f9de8 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:02.107544 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576967fb-656a-41dd-9490-df32a47ca347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:02.108317 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576967fb-656a-41dd-9490-df32a47ca347 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:02.108599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576967fb-656a-41dd-9490-df32a47ca347 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:02.108874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576967fb-656a-41dd-9490-df32a47ca347 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:02.119089 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576967fb-656a-41dd-9490-df32a47ca347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-576967fb-656a-41dd-9490-df32a47ca347 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:20:02.126593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:20:02.127700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:20:02.128741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:20:02.128741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:20:02.128741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:20:02.128741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:20:02.128741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:20:02.128741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:20:02.128741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:20:02.128741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:20:02.128741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:20:02.128741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:20:02.128741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:20:02.128741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:20:02.130327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 595/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:20:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:20:02.133605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c656ded-34ca-4905-9436-b7984b26f1bf None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:02.228233 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c656ded-34ca-4905-9436-b7984b26f1bf None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:02.261194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57058783-3a53-45a9-9733-1f9022905f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:02.261857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57058783-3a53-45a9-9733-1f9022905f7e None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:02.262141 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57058783-3a53-45a9-9733-1f9022905f7e None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:02.262450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57058783-3a53-45a9-9733-1f9022905f7e None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:02.263195 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57058783-3a53-45a9-9733-1f9022905f7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:20:02.263596 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57058783-3a53-45a9-9733-1f9022905f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:20:02.264968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57058783-3a53-45a9-9733-1f9022905f7e None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:20:02.273406 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 586/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:20:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:20:02.279124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576967fb-656a-41dd-9490-df32a47ca347 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:02.377973 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576967fb-656a-41dd-9490-df32a47ca347 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:02.409477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ec94d-267d-49e8-bef9-651ff4048a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:02.410359 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ec94d-267d-49e8-bef9-651ff4048a90 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:02.410641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ec94d-267d-49e8-bef9-651ff4048a90 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:02.410912 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ec94d-267d-49e8-bef9-651ff4048a90 None admin] PATH_INFO: `/v3/users/465a4ba1ac0d4aaaae477e4887164c8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:02.423247 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ec94d-267d-49e8-bef9-651ff4048a90 None admin] RBAC: Authorizing `identity:get_user(user_id=465a4ba1ac0d4aaaae477e4887164c8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:20:02.424690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ec94d-267d-49e8-bef9-651ff4048a90 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:20:02.426331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 596/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:20:02 2022] GET /identity/v3/users/465a4ba1ac0d4aaaae477e4887164c8b => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:20:02.432796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57058783-3a53-45a9-9733-1f9022905f7e None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:02.529713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57058783-3a53-45a9-9733-1f9022905f7e None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:02.561955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa5b81-2307-43c7-a93c-5c40cced0758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:02.562624 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa5b81-2307-43c7-a93c-5c40cced0758 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:02.562911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa5b81-2307-43c7-a93c-5c40cced0758 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:02.563190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa5b81-2307-43c7-a93c-5c40cced0758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:02.626457 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa5b81-2307-43c7-a93c-5c40cced0758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:20:02.627916 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa5b81-2307-43c7-a93c-5c40cced0758 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:20:02.721167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 587/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:20:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:20:02.727574 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ec94d-267d-49e8-bef9-651ff4048a90 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:02.833912 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ec94d-267d-49e8-bef9-651ff4048a90 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:02.866271 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64682941-0329-4100-a083-41972b792b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:02.867743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64682941-0329-4100-a083-41972b792b16 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:02.868028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64682941-0329-4100-a083-41972b792b16 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:02.868302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64682941-0329-4100-a083-41972b792b16 None admin] PATH_INFO: `/v3/projects/391d05714c9a43a685a3f7bffe082bf5` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:02.869479 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64682941-0329-4100-a083-41972b792b16 None admin] RBAC: Authorizing `identity:get_project(project_id=391d05714c9a43a685a3f7bffe082bf5)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:20:02.870950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64682941-0329-4100-a083-41972b792b16 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:20:02.872617 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 597/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:20:02 2022] GET /identity/v3/projects/391d05714c9a43a685a3f7bffe082bf5 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:20:02.878680 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa5b81-2307-43c7-a93c-5c40cced0758 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:02.969904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa5b81-2307-43c7-a93c-5c40cced0758 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:03.002010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8323cc-374d-42fb-9d5e-63dfdaba60de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:03.002603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8323cc-374d-42fb-9d5e-63dfdaba60de None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:03.002883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8323cc-374d-42fb-9d5e-63dfdaba60de None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:03.003154 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8323cc-374d-42fb-9d5e-63dfdaba60de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:03.003967 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8323cc-374d-42fb-9d5e-63dfdaba60de None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=391d05714c9a43a685a3f7bffe082bf5, user.id=465a4ba1ac0d4aaaae477e4887164c8b) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:20:03.004272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8323cc-374d-42fb-9d5e-63dfdaba60de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:20:03.005682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8323cc-374d-42fb-9d5e-63dfdaba60de None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:20:03.011169 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 588/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:20:02 2022] GET /identity/v3/role_assignments?user.id=465a4ba1ac0d4aaaae477e4887164c8b&scope.project.id=391d05714c9a43a685a3f7bffe082bf5&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:20:05.265104 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a49678-c04c-4f8e-9268-55e8533b85fa None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:05.265599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a49678-c04c-4f8e-9268-55e8533b85fa None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:05.265709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a49678-c04c-4f8e-9268-55e8533b85fa None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:05.267013 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 598/1186] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:20:05.272063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515091bf-63ef-4b9f-9797-343e1e5960b1 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:05.272464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515091bf-63ef-4b9f-9797-343e1e5960b1 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:05.273192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515091bf-63ef-4b9f-9797-343e1e5960b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:05.289834 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-515091bf-63ef-4b9f-9797-343e1e5960b1 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:20:05.291053 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-515091bf-63ef-4b9f-9797-343e1e5960b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:20:05.355320 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 589/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:20:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:20:05.378613 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a49678-c04c-4f8e-9268-55e8533b85fa None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:05.475873 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a49678-c04c-4f8e-9268-55e8533b85fa None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:05.508764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea79a0-0633-4ad3-86ff-669f59623904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:05.509531 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea79a0-0633-4ad3-86ff-669f59623904 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:05.509812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea79a0-0633-4ad3-86ff-669f59623904 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:05.510086 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea79a0-0633-4ad3-86ff-669f59623904 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:05.519712 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea79a0-0633-4ad3-86ff-669f59623904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-cdea79a0-0633-4ad3-86ff-669f59623904 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:20:05.527303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:20:05.528432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:20:05.529618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:20:05.529618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:20:05.529618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:20:05.529618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:20:05.529618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:20:05.529618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:20:05.529618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:20:05.529618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:20:05.529618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:20:05.529618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:20:05.529618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:20:05.529618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:20:05.529618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 599/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:20:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:20:05.534466 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515091bf-63ef-4b9f-9797-343e1e5960b1 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:05.627377 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515091bf-63ef-4b9f-9797-343e1e5960b1 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:05.659313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b4f04-e028-479a-a1d1-758e49683b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:05.659970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b4f04-e028-479a-a1d1-758e49683b47 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:05.660253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b4f04-e028-479a-a1d1-758e49683b47 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:05.660530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b4f04-e028-479a-a1d1-758e49683b47 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:05.661274 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b4f04-e028-479a-a1d1-758e49683b47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:20:05.661580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b4f04-e028-479a-a1d1-758e49683b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:20:05.662975 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b4f04-e028-479a-a1d1-758e49683b47 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:20:05.671484 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 590/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:20:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:20:05.677289 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea79a0-0633-4ad3-86ff-669f59623904 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:05.772385 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea79a0-0633-4ad3-86ff-669f59623904 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:05.805332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591de3f2-3d54-4ee3-8bfc-5f53023dcaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:05.806205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591de3f2-3d54-4ee3-8bfc-5f53023dcaf0 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:05.806487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591de3f2-3d54-4ee3-8bfc-5f53023dcaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:05.806761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591de3f2-3d54-4ee3-8bfc-5f53023dcaf0 None admin] PATH_INFO: `/v3/users/465a4ba1ac0d4aaaae477e4887164c8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:05.807927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591de3f2-3d54-4ee3-8bfc-5f53023dcaf0 None admin] RBAC: Authorizing `identity:get_user(user_id=465a4ba1ac0d4aaaae477e4887164c8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:20:05.809358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591de3f2-3d54-4ee3-8bfc-5f53023dcaf0 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:20:05.810976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 600/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:20:05 2022] GET /identity/v3/users/465a4ba1ac0d4aaaae477e4887164c8b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:20:05.816553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b4f04-e028-479a-a1d1-758e49683b47 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:05.913101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b4f04-e028-479a-a1d1-758e49683b47 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:05.946397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5046b-746c-4711-b6c7-d79169206253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:05.947234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5046b-746c-4711-b6c7-d79169206253 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:05.947515 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5046b-746c-4711-b6c7-d79169206253 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:05.947790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5046b-746c-4711-b6c7-d79169206253 None admin] PATH_INFO: `/v3/projects/391d05714c9a43a685a3f7bffe082bf5` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:05.948950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5046b-746c-4711-b6c7-d79169206253 None admin] RBAC: Authorizing `identity:get_project(project_id=391d05714c9a43a685a3f7bffe082bf5)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:20:05.950397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5046b-746c-4711-b6c7-d79169206253 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:20:05.952047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 591/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:20:05 2022] GET /identity/v3/projects/391d05714c9a43a685a3f7bffe082bf5 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:20:05.957987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591de3f2-3d54-4ee3-8bfc-5f53023dcaf0 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:06.052645 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591de3f2-3d54-4ee3-8bfc-5f53023dcaf0 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:06.084734 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32043a-fb2e-4c33-9e51-d2139184238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:06.086105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32043a-fb2e-4c33-9e51-d2139184238b None admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:06.086416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32043a-fb2e-4c33-9e51-d2139184238b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:06.086691 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32043a-fb2e-4c33-9e51-d2139184238b None admin] PATH_INFO: `/v3/projects/391d05714c9a43a685a3f7bffe082bf5/users/465a4ba1ac0d4aaaae477e4887164c8b/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:06.088658 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32043a-fb2e-4c33-9e51-d2139184238b None admin] RBAC: Authorizing `identity:create_grant(project_id=391d05714c9a43a685a3f7bffe082bf5, user_id=465a4ba1ac0d4aaaae477e4887164c8b, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:20:06.090095 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32043a-fb2e-4c33-9e51-d2139184238b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:20:06.102798 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 601/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:20:05 2022] PUT /identity/v3/projects/391d05714c9a43a685a3f7bffe082bf5/users/465a4ba1ac0d4aaaae477e4887164c8b/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:20:08.368893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8073f-4259-4be5-82ab-f6602dd04acd None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:08.369418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8073f-4259-4be5-82ab-f6602dd04acd None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:08.369531 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8073f-4259-4be5-82ab-f6602dd04acd None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:08.370849 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 592/1193] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:20:08.375966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529309cc-97c1-48dc-a009-fc5b97a07b66 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:08.376469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529309cc-97c1-48dc-a009-fc5b97a07b66 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:08.376568 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529309cc-97c1-48dc-a009-fc5b97a07b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:08.392855 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-529309cc-97c1-48dc-a009-fc5b97a07b66 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:20:08.394010 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-529309cc-97c1-48dc-a009-fc5b97a07b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:20:08.457016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 602/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:20:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:20:08.480896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8073f-4259-4be5-82ab-f6602dd04acd None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:08.580846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8073f-4259-4be5-82ab-f6602dd04acd None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:08.615562 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da44314-1573-4bbb-b0be-25a704189121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:08.616383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da44314-1573-4bbb-b0be-25a704189121 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:08.616826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da44314-1573-4bbb-b0be-25a704189121 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:08.617108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da44314-1573-4bbb-b0be-25a704189121 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:08.626860 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da44314-1573-4bbb-b0be-25a704189121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-3da44314-1573-4bbb-b0be-25a704189121 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:20:08.635167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:20:08.636237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:20:08.637261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:20:08.637261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:20:08.637261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:20:08.637261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:20:08.637261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:20:08.637261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:20:08.637261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:20:08.637261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:20:08.637261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:20:08.637261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:20:08.637261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:20:08.637261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:20:08.637261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 593/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:20:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:20:08.642415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529309cc-97c1-48dc-a009-fc5b97a07b66 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:08.734633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529309cc-97c1-48dc-a009-fc5b97a07b66 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:08.766334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc859f-382a-4ae1-b1bb-99b3e744dfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:08.766982 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc859f-382a-4ae1-b1bb-99b3e744dfa6 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:08.767262 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc859f-382a-4ae1-b1bb-99b3e744dfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:08.767533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc859f-382a-4ae1-b1bb-99b3e744dfa6 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:08.768264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc859f-382a-4ae1-b1bb-99b3e744dfa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:20:08.768565 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc859f-382a-4ae1-b1bb-99b3e744dfa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:20:08.769922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc859f-382a-4ae1-b1bb-99b3e744dfa6 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:20:08.778049 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 603/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:20:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:20:08.783729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da44314-1573-4bbb-b0be-25a704189121 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:08.878953 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da44314-1573-4bbb-b0be-25a704189121 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:08.911014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222f056-6ef4-43c3-ab91-cf54377c04c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:08.911859 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222f056-6ef4-43c3-ab91-cf54377c04c7 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:08.912140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222f056-6ef4-43c3-ab91-cf54377c04c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:08.912410 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222f056-6ef4-43c3-ab91-cf54377c04c7 None admin] PATH_INFO: `/v3/users/465a4ba1ac0d4aaaae477e4887164c8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:08.913605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222f056-6ef4-43c3-ab91-cf54377c04c7 None admin] RBAC: Authorizing `identity:get_user(user_id=465a4ba1ac0d4aaaae477e4887164c8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:20:08.915065 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222f056-6ef4-43c3-ab91-cf54377c04c7 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:20:08.916672 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 594/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 17 14:20:08 2022] GET /identity/v3/users/465a4ba1ac0d4aaaae477e4887164c8b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:20:08.922332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc859f-382a-4ae1-b1bb-99b3e744dfa6 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:09.017239 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc859f-382a-4ae1-b1bb-99b3e744dfa6 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:09.048296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025630b7-a181-4c94-af21-cc421e104085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:09.048920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025630b7-a181-4c94-af21-cc421e104085 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:09.049198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025630b7-a181-4c94-af21-cc421e104085 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:09.049468 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025630b7-a181-4c94-af21-cc421e104085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:09.111726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025630b7-a181-4c94-af21-cc421e104085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:20:09.113150 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025630b7-a181-4c94-af21-cc421e104085 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:20:09.204621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 604/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:20:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:20:09.210760 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222f056-6ef4-43c3-ab91-cf54377c04c7 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:09.304573 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222f056-6ef4-43c3-ab91-cf54377c04c7 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:09.336232 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4246aa-6a4c-45de-bda0-5ca0ae99b0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:09.337072 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4246aa-6a4c-45de-bda0-5ca0ae99b0c4 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:09.337355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4246aa-6a4c-45de-bda0-5ca0ae99b0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:09.337628 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4246aa-6a4c-45de-bda0-5ca0ae99b0c4 None admin] PATH_INFO: `/v3/projects/391d05714c9a43a685a3f7bffe082bf5` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:09.338798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4246aa-6a4c-45de-bda0-5ca0ae99b0c4 None admin] RBAC: Authorizing `identity:get_project(project_id=391d05714c9a43a685a3f7bffe082bf5)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:20:09.340226 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4246aa-6a4c-45de-bda0-5ca0ae99b0c4 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:20:09.341884 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 595/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 17 14:20:09 2022] GET /identity/v3/projects/391d05714c9a43a685a3f7bffe082bf5 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:20:09.348146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025630b7-a181-4c94-af21-cc421e104085 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:20:09.440984 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025630b7-a181-4c94-af21-cc421e104085 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:20:09.472941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b7e63-d393-4532-9025-6dfcf05f146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:20:09.473578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b7e63-d393-4532-9025-6dfcf05f146b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:20:09.473861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b7e63-d393-4532-9025-6dfcf05f146b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:20:09.474137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b7e63-d393-4532-9025-6dfcf05f146b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:20:09.474990 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b7e63-d393-4532-9025-6dfcf05f146b None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=391d05714c9a43a685a3f7bffe082bf5, user.id=465a4ba1ac0d4aaaae477e4887164c8b) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:20:09.475300 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b7e63-d393-4532-9025-6dfcf05f146b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:20:09.477353 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b7e63-d393-4532-9025-6dfcf05f146b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:20:09.482983 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 605/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:20:09 2022] GET /identity/v3/role_assignments?user.id=465a4ba1ac0d4aaaae477e4887164c8b&scope.project.id=391d05714c9a43a685a3f7bffe082bf5&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:10.487909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd0386-9b8d-4826-9d22-921c9c3eaf14 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:10.489754 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd0386-9b8d-4826-9d22-921c9c3eaf14 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:10.489754 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd0386-9b8d-4826-9d22-921c9c3eaf14 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:10.490588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 596/1201] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:21:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:21:10.496416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096dadf-d7aa-4e26-b780-5081f99c9d54 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:10.497008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096dadf-d7aa-4e26-b780-5081f99c9d54 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:10.497008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096dadf-d7aa-4e26-b780-5081f99c9d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:10.517424 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-a096dadf-d7aa-4e26-b780-5081f99c9d54 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:21:10.518693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a096dadf-d7aa-4e26-b780-5081f99c9d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:21:10.602342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 606/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:21:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:21:10.621959 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd0386-9b8d-4826-9d22-921c9c3eaf14 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:10.772319 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd0386-9b8d-4826-9d22-921c9c3eaf14 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:10.819250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9d3b0-7b4f-421d-b960-341227771dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:10.820080 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9d3b0-7b4f-421d-b960-341227771dfc None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:10.820359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9d3b0-7b4f-421d-b960-341227771dfc None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:10.820627 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9d3b0-7b4f-421d-b960-341227771dfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:10.838309 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9d3b0-7b4f-421d-b960-341227771dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:10.838309 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9d3b0-7b4f-421d-b960-341227771dfc None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:10.864361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-6ba9d3b0-7b4f-421d-b960-341227771dfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:10.864361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:10.864361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:10.864361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:10.864361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:10.864361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:10.864361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:10.864361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:10.864361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:10.864361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:10.864361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:10.864361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:10.864361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:21:10.864361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:21:10.864361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:10.865458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:10.866467 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:21:10.866467 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:21:10.866467 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:10.866467 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:10.866467 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 597/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:21:10.872147 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096dadf-d7aa-4e26-b780-5081f99c9d54 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:10.992195 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096dadf-d7aa-4e26-b780-5081f99c9d54 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:11.040871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34439a-c32a-4563-81ec-8114fec1e311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:11.041668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34439a-c32a-4563-81ec-8114fec1e311 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:11.042044 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34439a-c32a-4563-81ec-8114fec1e311 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:11.042378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34439a-c32a-4563-81ec-8114fec1e311 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:11.043091 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34439a-c32a-4563-81ec-8114fec1e311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:11.043396 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34439a-c32a-4563-81ec-8114fec1e311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:11.044979 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34439a-c32a-4563-81ec-8114fec1e311 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:11.057763 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 607/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:11.063383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9d3b0-7b4f-421d-b960-341227771dfc None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:11.183789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9d3b0-7b4f-421d-b960-341227771dfc None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:11.226954 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82daa00-94a0-4563-b80c-0998d2cc7685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:11.227637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82daa00-94a0-4563-b80c-0998d2cc7685 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:11.227908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82daa00-94a0-4563-b80c-0998d2cc7685 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:11.228254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82daa00-94a0-4563-b80c-0998d2cc7685 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:11.229121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82daa00-94a0-4563-b80c-0998d2cc7685 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:11.230930 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82daa00-94a0-4563-b80c-0998d2cc7685 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:11.256301 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 598/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 17 14:21:11 2022] POST /identity/v3/users => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:21:14.016012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb1d9a-8d01-49c5-a717-a146c5dad9e0 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:14.016598 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb1d9a-8d01-49c5-a717-a146c5dad9e0 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:14.016711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb1d9a-8d01-49c5-a717-a146c5dad9e0 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:14.018392 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 608/1206] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:21:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:21:14.024391 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be69e1-30f1-4079-a09a-3cca0e975cb0 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:14.024863 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be69e1-30f1-4079-a09a-3cca0e975cb0 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:14.024981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be69e1-30f1-4079-a09a-3cca0e975cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:14.045089 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-65be69e1-30f1-4079-a09a-3cca0e975cb0 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:21:14.046317 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-65be69e1-30f1-4079-a09a-3cca0e975cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:21:14.117269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 599/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:21:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:21:14.140836 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb1d9a-8d01-49c5-a717-a146c5dad9e0 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:14.248877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb1d9a-8d01-49c5-a717-a146c5dad9e0 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:14.284940 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e947b-c247-41b6-9f52-f36211ec0473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:14.285687 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e947b-c247-41b6-9f52-f36211ec0473 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:14.285991 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e947b-c247-41b6-9f52-f36211ec0473 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:14.286372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e947b-c247-41b6-9f52-f36211ec0473 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:14.297357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e947b-c247-41b6-9f52-f36211ec0473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-358e947b-c247-41b6-9f52-f36211ec0473 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:21:14.306006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:14.307129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:14.308088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:14.308088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:14.308088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:14.308088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:14.308088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:21:14.308088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:21:14.308088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:21:14.308088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:21:14.308088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:21:14.308088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:21:14.308088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:21:14.308088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:14.308088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 609/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:21:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:14.313578 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be69e1-30f1-4079-a09a-3cca0e975cb0 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:14.422170 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be69e1-30f1-4079-a09a-3cca0e975cb0 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:14.459323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8365bb8-cf76-43c7-8b2e-d6df11205a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:14.459999 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8365bb8-cf76-43c7-8b2e-d6df11205a51 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:14.460316 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8365bb8-cf76-43c7-8b2e-d6df11205a51 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:14.460550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8365bb8-cf76-43c7-8b2e-d6df11205a51 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:14.461306 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8365bb8-cf76-43c7-8b2e-d6df11205a51 None admin] RBAC: Adding query filter params (name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:14.461611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8365bb8-cf76-43c7-8b2e-d6df11205a51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:14.463021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8365bb8-cf76-43c7-8b2e-d6df11205a51 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:14.471416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 600/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:21:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:14.477327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e947b-c247-41b6-9f52-f36211ec0473 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:14.582740 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e947b-c247-41b6-9f52-f36211ec0473 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:14.624709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da446f60-ce16-4623-b3c2-61ed0a7b686c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:14.625668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da446f60-ce16-4623-b3c2-61ed0a7b686c None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:14.625994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da446f60-ce16-4623-b3c2-61ed0a7b686c None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:14.626308 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da446f60-ce16-4623-b3c2-61ed0a7b686c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:14.639720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da446f60-ce16-4623-b3c2-61ed0a7b686c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:14.641557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da446f60-ce16-4623-b3c2-61ed0a7b686c None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:14.667442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-da446f60-ce16-4623-b3c2-61ed0a7b686c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:14.667442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:14.667442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:14.667442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:14.667442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:14.667442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:14.667442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:14.667442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:14.667442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:14.667442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:14.667442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:14.667442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:14.667442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:21:14.667442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:21:14.667442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:14.668454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:14.669354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:21:14.669354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:21:14.669354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:14.669354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:14.669354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 610/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:14.675348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8365bb8-cf76-43c7-8b2e-d6df11205a51 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:14.793240 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8365bb8-cf76-43c7-8b2e-d6df11205a51 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:14.836381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ebfd7-9cf2-43c2-8935-c079626a4339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:14.836990 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ebfd7-9cf2-43c2-8935-c079626a4339 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:14.837338 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ebfd7-9cf2-43c2-8935-c079626a4339 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:14.837558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ebfd7-9cf2-43c2-8935-c079626a4339 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:14.838332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ebfd7-9cf2-43c2-8935-c079626a4339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:14.838640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ebfd7-9cf2-43c2-8935-c079626a4339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:14.840040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ebfd7-9cf2-43c2-8935-c079626a4339 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:14.854022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 601/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:14.859743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da446f60-ce16-4623-b3c2-61ed0a7b686c None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:14.977442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da446f60-ce16-4623-b3c2-61ed0a7b686c None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:15.015259 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5deb821-8a49-4f9b-8585-d298a38c6fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:15.016301 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5deb821-8a49-4f9b-8585-d298a38c6fe2 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:15.016872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5deb821-8a49-4f9b-8585-d298a38c6fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:15.016872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5deb821-8a49-4f9b-8585-d298a38c6fe2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:15.027263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5deb821-8a49-4f9b-8585-d298a38c6fe2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:15.028805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5deb821-8a49-4f9b-8585-d298a38c6fe2 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-b5deb821-8a49-4f9b-8585-d298a38c6fe2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:21:15.044057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:15.045105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:15.046085 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:15.046085 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:15.046085 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:21:15.046085 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:21:15.046085 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:21:15.046085 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:21:15.046085 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:21:15.046085 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:21:15.046085 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 14:21:15.046085 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:15.046085 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 611/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:15.051951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ebfd7-9cf2-43c2-8935-c079626a4339 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:15.164284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ebfd7-9cf2-43c2-8935-c079626a4339 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:15.201623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1229f5-0157-4b91-a327-f5be4772c0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:15.202405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1229f5-0157-4b91-a327-f5be4772c0c6 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:15.203920 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1229f5-0157-4b91-a327-f5be4772c0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:15.204707 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1229f5-0157-4b91-a327-f5be4772c0c6 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:15.206230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1229f5-0157-4b91-a327-f5be4772c0c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:15.206230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1229f5-0157-4b91-a327-f5be4772c0c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:15.207432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1229f5-0157-4b91-a327-f5be4772c0c6 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:15.229279 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 602/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 17 14:21:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:15.235122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5deb821-8a49-4f9b-8585-d298a38c6fe2 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:15.345324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5deb821-8a49-4f9b-8585-d298a38c6fe2 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:15.384618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e5b11-257d-4ad1-92ba-4171a962389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:15.385413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e5b11-257d-4ad1-92ba-4171a962389b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:15.385768 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e5b11-257d-4ad1-92ba-4171a962389b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:15.386116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e5b11-257d-4ad1-92ba-4171a962389b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:15.466160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e5b11-257d-4ad1-92ba-4171a962389b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:15.467695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e5b11-257d-4ad1-92ba-4171a962389b None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:15.572021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 612/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:21:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:21:15.577404 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1229f5-0157-4b91-a327-f5be4772c0c6 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:15.694821 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1229f5-0157-4b91-a327-f5be4772c0c6 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:15.733172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ebe0a-0987-4d9b-a65d-c018763ba30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:15.733885 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ebe0a-0987-4d9b-a65d-c018763ba30d None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:15.734243 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ebe0a-0987-4d9b-a65d-c018763ba30d None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:15.734522 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ebe0a-0987-4d9b-a65d-c018763ba30d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:15.745548 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ebe0a-0987-4d9b-a65d-c018763ba30d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:15.747389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ebe0a-0987-4d9b-a65d-c018763ba30d None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:15.767618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-a64ebe0a-0987-4d9b-a65d-c018763ba30d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:15.767618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:15.767618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:15.767618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:15.767618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:15.767618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:15.767618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:15.767618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:15.767618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:15.767618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:15.767618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:15.767618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:15.767618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:21:15.767618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:21:15.767618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:15.768594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:15.769621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:21:15.769621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:21:15.769621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:15.769621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:15.769621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 603/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:15.775212 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e5b11-257d-4ad1-92ba-4171a962389b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:15.892704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e5b11-257d-4ad1-92ba-4171a962389b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:15.934640 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff5e1a-1bad-4dea-8388-782585fb21d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:15.935542 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5e1a-1bad-4dea-8388-782585fb21d2 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:15.935958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5e1a-1bad-4dea-8388-782585fb21d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:15.936444 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5e1a-1bad-4dea-8388-782585fb21d2 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:15.937492 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff5e1a-1bad-4dea-8388-782585fb21d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:15.937945 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff5e1a-1bad-4dea-8388-782585fb21d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:15.939800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff5e1a-1bad-4dea-8388-782585fb21d2 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:15.960044 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 613/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:15.961436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ebe0a-0987-4d9b-a65d-c018763ba30d None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:16.075969 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ebe0a-0987-4d9b-a65d-c018763ba30d None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:16.119432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb98f95-5ce1-4411-b2e7-8ecddb6ca100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:16.120735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb98f95-5ce1-4411-b2e7-8ecddb6ca100 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:16.121031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb98f95-5ce1-4411-b2e7-8ecddb6ca100 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:16.121356 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb98f95-5ce1-4411-b2e7-8ecddb6ca100 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:16.131590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb98f95-5ce1-4411-b2e7-8ecddb6ca100 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:16.133068 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb98f95-5ce1-4411-b2e7-8ecddb6ca100 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:16.148444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-feb98f95-5ce1-4411-b2e7-8ecddb6ca100 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:21:16.148444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:16.148444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:16.148444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:16.148444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:16.148444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:16.148444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:16.148444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:16.148444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:16.148444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:16.148444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:16.148444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:16.148444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:21:16.148444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:21:16.148444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:16.149718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:16.150837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:21:16.150837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:21:16.150837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:21:16.150837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:21:16.150837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:21:16.150837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:21:16.150837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:21:16.150837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:16.155655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff5e1a-1bad-4dea-8388-782585fb21d2 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:16.156193 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 604/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:21:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:16.271979 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff5e1a-1bad-4dea-8388-782585fb21d2 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:16.307439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676d8b7-3506-4344-b12f-9c50a6edbf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:16.308296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676d8b7-3506-4344-b12f-9c50a6edbf86 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:16.309107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676d8b7-3506-4344-b12f-9c50a6edbf86 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:16.309464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676d8b7-3506-4344-b12f-9c50a6edbf86 None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:16.310376 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676d8b7-3506-4344-b12f-9c50a6edbf86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:16.310758 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676d8b7-3506-4344-b12f-9c50a6edbf86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:16.312343 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676d8b7-3506-4344-b12f-9c50a6edbf86 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:16.331564 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 614/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:21:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:16.333339 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb98f95-5ce1-4411-b2e7-8ecddb6ca100 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:16.447817 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb98f95-5ce1-4411-b2e7-8ecddb6ca100 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:16.487308 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2e79d-136b-4c65-9d66-b8ad387a0f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:16.488029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2e79d-136b-4c65-9d66-b8ad387a0f37 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:16.488381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2e79d-136b-4c65-9d66-b8ad387a0f37 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:16.489115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2e79d-136b-4c65-9d66-b8ad387a0f37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:16.490045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2e79d-136b-4c65-9d66-b8ad387a0f37 None admin] RBAC: Adding query filter params (role.id=4aa22f352696432bbf8fcd9d74ba0dc7, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=fad90f42ebfe43eb8256611a88df87ca) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:16.490393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2e79d-136b-4c65-9d66-b8ad387a0f37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:16.492032 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2e79d-136b-4c65-9d66-b8ad387a0f37 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:16.498232 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 605/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:21:16 2022] GET /identity/v3/role_assignments?user.id=fad90f42ebfe43eb8256611a88df87ca&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=4aa22f352696432bbf8fcd9d74ba0dc7 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:21:18.851911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2760530-4164-422b-ac4e-f925f2987b68 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:18.852463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2760530-4164-422b-ac4e-f925f2987b68 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:18.852463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2760530-4164-422b-ac4e-f925f2987b68 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:18.854101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 615/1220] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:21:18.859783 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c31e7-62e9-47a4-a50d-64aa79772316 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:18.860246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c31e7-62e9-47a4-a50d-64aa79772316 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:18.860332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c31e7-62e9-47a4-a50d-64aa79772316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:18.877819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b31c31e7-62e9-47a4-a50d-64aa79772316 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:21:18.879205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b31c31e7-62e9-47a4-a50d-64aa79772316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:21:18.953355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 606/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:21:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:21:18.979406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2760530-4164-422b-ac4e-f925f2987b68 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:19.095464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2760530-4164-422b-ac4e-f925f2987b68 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:19.135311 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25c73c-826e-47f3-ac01-82f622fa273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:19.136173 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25c73c-826e-47f3-ac01-82f622fa273b None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:19.136461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25c73c-826e-47f3-ac01-82f622fa273b None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:19.136739 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25c73c-826e-47f3-ac01-82f622fa273b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:19.149423 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25c73c-826e-47f3-ac01-82f622fa273b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-bb25c73c-826e-47f3-ac01-82f622fa273b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:21:19.157457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:19.159352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:19.160724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:19.160724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:19.160724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:19.160724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:19.160724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:21:19.160724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:21:19.160724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:21:19.160724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:21:19.160724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:21:19.160724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:21:19.160724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:21:19.160724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:19.160724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 616/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:21:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:19.165465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c31e7-62e9-47a4-a50d-64aa79772316 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:19.275952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c31e7-62e9-47a4-a50d-64aa79772316 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:19.310784 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63402cc-b32f-4a50-820c-05cafb702e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:19.311449 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63402cc-b32f-4a50-820c-05cafb702e27 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:19.311732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63402cc-b32f-4a50-820c-05cafb702e27 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:19.312009 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63402cc-b32f-4a50-820c-05cafb702e27 None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:19.312744 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63402cc-b32f-4a50-820c-05cafb702e27 None admin] RBAC: Adding query filter params (name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:19.313049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63402cc-b32f-4a50-820c-05cafb702e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:19.314518 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63402cc-b32f-4a50-820c-05cafb702e27 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:19.323160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 607/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:21:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:19.329757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25c73c-826e-47f3-ac01-82f622fa273b None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:19.440089 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25c73c-826e-47f3-ac01-82f622fa273b None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:19.477545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da3ade-8706-4b88-923f-50c1925e92ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:19.478562 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da3ade-8706-4b88-923f-50c1925e92ad None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:19.478847 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da3ade-8706-4b88-923f-50c1925e92ad None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:19.479125 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da3ade-8706-4b88-923f-50c1925e92ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:19.491354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da3ade-8706-4b88-923f-50c1925e92ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:19.492812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da3ade-8706-4b88-923f-50c1925e92ad None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:19.519076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-33da3ade-8706-4b88-923f-50c1925e92ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:19.519076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:19.519076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:19.519076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:19.519076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:19.519076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:19.519076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:19.519076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:19.519076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:19.519076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:19.519076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:19.519076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:19.519076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:21:19.519076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:21:19.519076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:19.520241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:19.521764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:21:19.521764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:21:19.521764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:19.521764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:19.521764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 617/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:21:19.526968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63402cc-b32f-4a50-820c-05cafb702e27 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:19.643167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63402cc-b32f-4a50-820c-05cafb702e27 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:19.680512 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64eda01-3e12-45c5-a599-b5533ea92f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:19.681179 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64eda01-3e12-45c5-a599-b5533ea92f3c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:19.681461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64eda01-3e12-45c5-a599-b5533ea92f3c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:19.681739 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64eda01-3e12-45c5-a599-b5533ea92f3c None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:19.682504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64eda01-3e12-45c5-a599-b5533ea92f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:19.682787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64eda01-3e12-45c5-a599-b5533ea92f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:19.684156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64eda01-3e12-45c5-a599-b5533ea92f3c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:19.696349 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 608/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:19.702071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da3ade-8706-4b88-923f-50c1925e92ad None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:19.813906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da3ade-8706-4b88-923f-50c1925e92ad None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:19.849655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699f744-42ca-43a6-95d0-85fcc7cc7494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:19.850489 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f744-42ca-43a6-95d0-85fcc7cc7494 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:19.850791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f744-42ca-43a6-95d0-85fcc7cc7494 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:19.851062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f744-42ca-43a6-95d0-85fcc7cc7494 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:19.858828 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699f744-42ca-43a6-95d0-85fcc7cc7494 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:19.860259 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699f744-42ca-43a6-95d0-85fcc7cc7494 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-c699f744-42ca-43a6-95d0-85fcc7cc7494 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:21:19.875433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:19.876665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:19.878405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:19.878405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:19.878405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:21:19.878405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:21:19.878405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:21:19.878405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:21:19.878405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:21:19.878405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:21:19.878405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 14:21:19.878405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:19.878405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 618/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:19.883192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64eda01-3e12-45c5-a599-b5533ea92f3c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:19.995598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64eda01-3e12-45c5-a599-b5533ea92f3c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:20.038590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ceac0f-59de-4baf-8f62-5b40f3f419da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:20.039579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ceac0f-59de-4baf-8f62-5b40f3f419da None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:20.039884 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ceac0f-59de-4baf-8f62-5b40f3f419da None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:20.040165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ceac0f-59de-4baf-8f62-5b40f3f419da None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:20.041204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ceac0f-59de-4baf-8f62-5b40f3f419da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:20.041574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ceac0f-59de-4baf-8f62-5b40f3f419da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:20.043776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ceac0f-59de-4baf-8f62-5b40f3f419da None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:20.064411 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 609/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 17 14:21:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:20.071146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699f744-42ca-43a6-95d0-85fcc7cc7494 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:20.179222 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699f744-42ca-43a6-95d0-85fcc7cc7494 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:20.213251 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b050e-a3fb-4431-be45-66437318fa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:20.214056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b050e-a3fb-4431-be45-66437318fa95 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:20.214400 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b050e-a3fb-4431-be45-66437318fa95 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:20.214733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b050e-a3fb-4431-be45-66437318fa95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:20.226862 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b050e-a3fb-4431-be45-66437318fa95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:20.228416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b050e-a3fb-4431-be45-66437318fa95 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:20.245596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-8f5b050e-a3fb-4431-be45-66437318fa95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:20.245596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:20.245596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:20.245596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:20.245596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:20.245596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:20.245596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:20.245596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:20.245596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:20.245596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:20.245596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:20.245596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:20.245596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:21:20.245596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:21:20.245596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:20.246911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:20.248364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:21:20.248364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:21:20.248364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:20.248364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:20.248364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 619/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:20.254735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ceac0f-59de-4baf-8f62-5b40f3f419da None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:20.361409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ceac0f-59de-4baf-8f62-5b40f3f419da None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:20.398777 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192c92c-29fe-4ffd-b488-94b658ad892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:20.399440 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192c92c-29fe-4ffd-b488-94b658ad892d None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:20.399720 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192c92c-29fe-4ffd-b488-94b658ad892d None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:20.399986 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192c92c-29fe-4ffd-b488-94b658ad892d None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:20.400703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192c92c-29fe-4ffd-b488-94b658ad892d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:20.401001 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192c92c-29fe-4ffd-b488-94b658ad892d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:20.402405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192c92c-29fe-4ffd-b488-94b658ad892d None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:20.414731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 610/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:20.420982 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b050e-a3fb-4431-be45-66437318fa95 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:20.543966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b050e-a3fb-4431-be45-66437318fa95 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:20.590641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed704c7-b885-4ad0-9e21-e1e64ef45d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:20.591568 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed704c7-b885-4ad0-9e21-e1e64ef45d1d None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:20.592057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed704c7-b885-4ad0-9e21-e1e64ef45d1d None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:20.592333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed704c7-b885-4ad0-9e21-e1e64ef45d1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:20.599658 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed704c7-b885-4ad0-9e21-e1e64ef45d1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:20.601160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed704c7-b885-4ad0-9e21-e1e64ef45d1d None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:20.619670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-4ed704c7-b885-4ad0-9e21-e1e64ef45d1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:21:20.619670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:20.619670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:20.619670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:20.619670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:20.619670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:20.619670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:20.619670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:20.619670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:20.619670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:20.619670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:20.619670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:20.619670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:21:20.619670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:21:20.619670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:20.620876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:20.621866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:21:20.621866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:21:20.621866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:21:20.621866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:21:20.621866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:21:20.621866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:21:20.621866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:21:20.621866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:20.621866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 620/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:21:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:20.627384 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192c92c-29fe-4ffd-b488-94b658ad892d None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:20.741445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192c92c-29fe-4ffd-b488-94b658ad892d None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:20.779565 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e7366-1025-4bf1-98f7-3478090f62a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:20.780377 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e7366-1025-4bf1-98f7-3478090f62a2 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:20.780655 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e7366-1025-4bf1-98f7-3478090f62a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:20.781009 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e7366-1025-4bf1-98f7-3478090f62a2 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:20.781809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e7366-1025-4bf1-98f7-3478090f62a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:20.782116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e7366-1025-4bf1-98f7-3478090f62a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:20.783760 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e7366-1025-4bf1-98f7-3478090f62a2 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:20.797118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 611/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:21:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:21:20.803890 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed704c7-b885-4ad0-9e21-e1e64ef45d1d None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:20.907775 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed704c7-b885-4ad0-9e21-e1e64ef45d1d None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:20.944243 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86431654-049d-44fb-a5ac-2a0c446aa951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:20.945414 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86431654-049d-44fb-a5ac-2a0c446aa951 None admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:20.945811 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86431654-049d-44fb-a5ac-2a0c446aa951 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:20.946065 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86431654-049d-44fb-a5ac-2a0c446aa951 None admin] PATH_INFO: `/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/fad90f42ebfe43eb8256611a88df87ca/roles/4aa22f352696432bbf8fcd9d74ba0dc7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:20.964629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86431654-049d-44fb-a5ac-2a0c446aa951 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac7d1119033458393ad6f78fc0df7a3, user_id=fad90f42ebfe43eb8256611a88df87ca, role_id=4aa22f352696432bbf8fcd9d74ba0dc7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:20.966717 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86431654-049d-44fb-a5ac-2a0c446aa951 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:20.982502 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 621/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:21:20 2022] PUT /identity/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/fad90f42ebfe43eb8256611a88df87ca/roles/4aa22f352696432bbf8fcd9d74ba0dc7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:21:23.600423 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec37f8-15f9-4a09-8b87-5a31335dd7a9 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:23.600981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec37f8-15f9-4a09-8b87-5a31335dd7a9 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:23.600981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec37f8-15f9-4a09-8b87-5a31335dd7a9 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:23.602276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 612/1233] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:21:23.609499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036078e4-c28a-42aa-8ccb-ea586bdc8cdd None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:23.610042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036078e4-c28a-42aa-8ccb-ea586bdc8cdd None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:23.610042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036078e4-c28a-42aa-8ccb-ea586bdc8cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:23.628027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-036078e4-c28a-42aa-8ccb-ea586bdc8cdd None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:21:23.630419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-036078e4-c28a-42aa-8ccb-ea586bdc8cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:21:23.708779 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 622/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:21:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:21:23.732777 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec37f8-15f9-4a09-8b87-5a31335dd7a9 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:23.839323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec37f8-15f9-4a09-8b87-5a31335dd7a9 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:23.874811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6aec8-b8e8-4686-9b32-1d0b8fa8c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:23.875749 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6aec8-b8e8-4686-9b32-1d0b8fa8c925 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:23.876035 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6aec8-b8e8-4686-9b32-1d0b8fa8c925 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:23.876307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6aec8-b8e8-4686-9b32-1d0b8fa8c925 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:23.887590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6aec8-b8e8-4686-9b32-1d0b8fa8c925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-8da6aec8-b8e8-4686-9b32-1d0b8fa8c925 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:21:23.896387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:23.898222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:23.899148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:23.899148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:23.899148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:23.899148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:23.899148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:21:23.899148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:21:23.899148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:21:23.899148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:21:23.899148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:21:23.899148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:21:23.899148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 14:21:23.899148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:23.899148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 613/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 17 14:21:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:23.904217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036078e4-c28a-42aa-8ccb-ea586bdc8cdd None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:24.014043 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036078e4-c28a-42aa-8ccb-ea586bdc8cdd None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:24.052244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d70f8-4e48-4217-ace0-62351f489018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:24.053213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d70f8-4e48-4217-ace0-62351f489018 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:24.053735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d70f8-4e48-4217-ace0-62351f489018 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:24.054124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d70f8-4e48-4217-ace0-62351f489018 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:24.055166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d70f8-4e48-4217-ace0-62351f489018 None admin] RBAC: Adding query filter params (name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:24.055810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d70f8-4e48-4217-ace0-62351f489018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:24.057197 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d70f8-4e48-4217-ace0-62351f489018 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:24.066563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 623/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 17 14:21:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:24.072334 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6aec8-b8e8-4686-9b32-1d0b8fa8c925 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:24.184029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6aec8-b8e8-4686-9b32-1d0b8fa8c925 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:24.224162 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de86812-b646-4de7-bae7-bad80ff89466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:24.224972 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de86812-b646-4de7-bae7-bad80ff89466 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:24.225258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de86812-b646-4de7-bae7-bad80ff89466 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:24.225537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de86812-b646-4de7-bae7-bad80ff89466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:24.236447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de86812-b646-4de7-bae7-bad80ff89466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:24.237939 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de86812-b646-4de7-bae7-bad80ff89466 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:24.256951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-5de86812-b646-4de7-bae7-bad80ff89466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:24.256951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:24.256951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:24.256951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:24.256951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:24.256951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:24.256951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:24.256951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:24.256951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:24.256951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:24.256951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:24.256951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:24.256951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:21:24.256951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:21:24.256951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:24.258418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:24.259594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:21:24.259594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:21:24.259594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:24.259594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:24.259594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 614/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:24.264297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d70f8-4e48-4217-ace0-62351f489018 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:24.382849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d70f8-4e48-4217-ace0-62351f489018 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:24.418508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c562d2c-1ce3-45c0-a2c6-568cc4830d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:24.419170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c562d2c-1ce3-45c0-a2c6-568cc4830d66 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:24.419452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c562d2c-1ce3-45c0-a2c6-568cc4830d66 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:24.419729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c562d2c-1ce3-45c0-a2c6-568cc4830d66 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:24.420443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c562d2c-1ce3-45c0-a2c6-568cc4830d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:24.420762 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c562d2c-1ce3-45c0-a2c6-568cc4830d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:24.422126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c562d2c-1ce3-45c0-a2c6-568cc4830d66 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:24.434394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 624/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:21:24.440340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de86812-b646-4de7-bae7-bad80ff89466 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:24.562043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de86812-b646-4de7-bae7-bad80ff89466 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:24.603219 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de61bd-5d09-4c95-bfe1-403aac86a8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:24.604022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de61bd-5d09-4c95-bfe1-403aac86a8bb None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:24.604304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de61bd-5d09-4c95-bfe1-403aac86a8bb None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:24.604597 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de61bd-5d09-4c95-bfe1-403aac86a8bb None admin] PATH_INFO: `/v3/users/placement` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:24.612694 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de61bd-5d09-4c95-bfe1-403aac86a8bb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:24.614435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de61bd-5d09-4c95-bfe1-403aac86a8bb None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-b5de61bd-5d09-4c95-bfe1-403aac86a8bb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:21:24.629790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:24.631034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:24.632024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:24.632024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:24.632024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:21:24.632024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:21:24.632024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:21:24.632024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:21:24.632024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:21:24.632024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:21:24.632024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 14:21:24.632024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:24.632024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 615/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:24.637587 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c562d2c-1ce3-45c0-a2c6-568cc4830d66 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:24.748016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c562d2c-1ce3-45c0-a2c6-568cc4830d66 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:24.788504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a628354-a10b-4610-a1e9-349009439391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:24.789176 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a628354-a10b-4610-a1e9-349009439391 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:24.789457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a628354-a10b-4610-a1e9-349009439391 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:24.789727 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a628354-a10b-4610-a1e9-349009439391 None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:24.790592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a628354-a10b-4610-a1e9-349009439391 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:24.790901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a628354-a10b-4610-a1e9-349009439391 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:24.792334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a628354-a10b-4610-a1e9-349009439391 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:24.809161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 625/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 17 14:21:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:24.815314 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de61bd-5d09-4c95-bfe1-403aac86a8bb None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:24.921752 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de61bd-5d09-4c95-bfe1-403aac86a8bb None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:24.954897 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06eed1-908e-4d8a-95c4-abaddca1faea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:24.955550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06eed1-908e-4d8a-95c4-abaddca1faea None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:24.955832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06eed1-908e-4d8a-95c4-abaddca1faea None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:24.956110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06eed1-908e-4d8a-95c4-abaddca1faea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:25.031452 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06eed1-908e-4d8a-95c4-abaddca1faea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:25.032919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06eed1-908e-4d8a-95c4-abaddca1faea None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:25.148026 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 616/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:21:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 14:21:25.149471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a628354-a10b-4610-a1e9-349009439391 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:25.254869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a628354-a10b-4610-a1e9-349009439391 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:25.293327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7927e4a-ddcb-44a8-904f-2a84a5299d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:25.294280 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7927e4a-ddcb-44a8-904f-2a84a5299d86 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:25.294566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7927e4a-ddcb-44a8-904f-2a84a5299d86 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:25.294946 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7927e4a-ddcb-44a8-904f-2a84a5299d86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:25.307702 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7927e4a-ddcb-44a8-904f-2a84a5299d86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:25.309505 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7927e4a-ddcb-44a8-904f-2a84a5299d86 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:25.328721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-e7927e4a-ddcb-44a8-904f-2a84a5299d86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:25.328721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:25.328721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:25.328721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:25.328721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:25.328721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:25.328721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:25.328721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:25.328721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:25.328721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:25.328721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:25.328721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:25.328721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:21:25.328721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:21:25.328721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:25.330144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:25.331533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:21:25.331533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:21:25.331533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:25.331533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:25.331533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 626/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:25.336283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06eed1-908e-4d8a-95c4-abaddca1faea None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:25.446891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06eed1-908e-4d8a-95c4-abaddca1faea None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:25.493221 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8211056-a03b-450a-bbee-0d8f36aee19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:25.493896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8211056-a03b-450a-bbee-0d8f36aee19c None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:25.494193 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8211056-a03b-450a-bbee-0d8f36aee19c None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:25.494491 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8211056-a03b-450a-bbee-0d8f36aee19c None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:25.495214 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8211056-a03b-450a-bbee-0d8f36aee19c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:25.495521 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8211056-a03b-450a-bbee-0d8f36aee19c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:25.496897 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8211056-a03b-450a-bbee-0d8f36aee19c None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:25.509510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 617/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:25.515426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7927e4a-ddcb-44a8-904f-2a84a5299d86 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:25.644435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7927e4a-ddcb-44a8-904f-2a84a5299d86 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:25.680458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5e25e-189c-4b91-a3dd-177d7a72d4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:25.681360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e25e-189c-4b91-a3dd-177d7a72d4a2 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:25.681767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e25e-189c-4b91-a3dd-177d7a72d4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:25.682041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e25e-189c-4b91-a3dd-177d7a72d4a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:25.690201 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5e25e-189c-4b91-a3dd-177d7a72d4a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:25.692756 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5e25e-189c-4b91-a3dd-177d7a72d4a2 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:25.710336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-e2e5e25e-189c-4b91-a3dd-177d7a72d4a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:21:25.710336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:25.710336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:25.710336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:25.710336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:25.710336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:25.710336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:25.710336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:25.710336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:25.710336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:25.710336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:25.710336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:25.710336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:21:25.710336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:21:25.710336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:25.711481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:25.712545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:21:25.712545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:21:25.712545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:21:25.712545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:21:25.712545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:21:25.712545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:21:25.712545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:21:25.712545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:25.712545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 627/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:21:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:21:25.717710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8211056-a03b-450a-bbee-0d8f36aee19c None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:25.824373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8211056-a03b-450a-bbee-0d8f36aee19c None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:25.860782 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1d111-eb76-41ea-b6ef-e4425a8df29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:25.861389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1d111-eb76-41ea-b6ef-e4425a8df29d None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:25.861666 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1d111-eb76-41ea-b6ef-e4425a8df29d None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:25.861938 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1d111-eb76-41ea-b6ef-e4425a8df29d None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:25.863339 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1d111-eb76-41ea-b6ef-e4425a8df29d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:25.863597 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1d111-eb76-41ea-b6ef-e4425a8df29d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:25.865052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1d111-eb76-41ea-b6ef-e4425a8df29d None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:25.880150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 618/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:21:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:25.887632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5e25e-189c-4b91-a3dd-177d7a72d4a2 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:26.019921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5e25e-189c-4b91-a3dd-177d7a72d4a2 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:26.057129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f052a74-77e4-48bf-bc17-d6d06e39d393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:26.058092 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f052a74-77e4-48bf-bc17-d6d06e39d393 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:26.058400 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f052a74-77e4-48bf-bc17-d6d06e39d393 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:26.058673 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f052a74-77e4-48bf-bc17-d6d06e39d393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:26.059854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f052a74-77e4-48bf-bc17-d6d06e39d393 None admin] RBAC: Adding query filter params (role.id=4aa22f352696432bbf8fcd9d74ba0dc7, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=fad90f42ebfe43eb8256611a88df87ca) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:26.060131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f052a74-77e4-48bf-bc17-d6d06e39d393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:26.062129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f052a74-77e4-48bf-bc17-d6d06e39d393 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:26.069573 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 628/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:21:25 2022] GET /identity/v3/role_assignments?user.id=fad90f42ebfe43eb8256611a88df87ca&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=4aa22f352696432bbf8fcd9d74ba0dc7 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:21:28.669954 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c82925-a4bd-4860-a647-5a59db161e32 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:28.670546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c82925-a4bd-4860-a647-5a59db161e32 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:28.670546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c82925-a4bd-4860-a647-5a59db161e32 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:28.672058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 619/1247] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:21:28.679475 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7c2e3-7dba-4e95-b3cc-80b0dd641bd5 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:28.680007 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7c2e3-7dba-4e95-b3cc-80b0dd641bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:28.680176 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7c2e3-7dba-4e95-b3cc-80b0dd641bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:28.698282 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-43c7c2e3-7dba-4e95-b3cc-80b0dd641bd5 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:21:28.699446 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-43c7c2e3-7dba-4e95-b3cc-80b0dd641bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:21:28.770252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 629/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:21:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:21:28.798360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c82925-a4bd-4860-a647-5a59db161e32 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:28.908934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c82925-a4bd-4860-a647-5a59db161e32 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:28.947565 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3796f37-b4f6-42ea-bf56-66ecdea0c6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:28.948288 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3796f37-b4f6-42ea-bf56-66ecdea0c6d3 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:28.948571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3796f37-b4f6-42ea-bf56-66ecdea0c6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:28.948904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3796f37-b4f6-42ea-bf56-66ecdea0c6d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:28.961445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3796f37-b4f6-42ea-bf56-66ecdea0c6d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-d3796f37-b4f6-42ea-bf56-66ecdea0c6d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:21:28.969090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:28.970264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:28.971225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:28.971225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:28.971225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:28.971225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:28.971225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:21:28.971225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:21:28.971225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:21:28.971225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:21:28.971225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:21:28.971225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:21:28.971225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:21:28.971225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:28.971225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 620/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:21:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:28.977212 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7c2e3-7dba-4e95-b3cc-80b0dd641bd5 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:29.100407 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7c2e3-7dba-4e95-b3cc-80b0dd641bd5 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:29.149065 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe37de9-59be-4b2e-b4bf-fb90b30dcb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:29.149762 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe37de9-59be-4b2e-b4bf-fb90b30dcb0f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:29.150077 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe37de9-59be-4b2e-b4bf-fb90b30dcb0f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:29.150367 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe37de9-59be-4b2e-b4bf-fb90b30dcb0f None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:29.151113 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe37de9-59be-4b2e-b4bf-fb90b30dcb0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:29.151418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe37de9-59be-4b2e-b4bf-fb90b30dcb0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:29.152797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe37de9-59be-4b2e-b4bf-fb90b30dcb0f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:29.161782 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 630/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:21:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:21:29.168583 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3796f37-b4f6-42ea-bf56-66ecdea0c6d3 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:29.272318 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3796f37-b4f6-42ea-bf56-66ecdea0c6d3 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:29.313503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54944b-c8c1-4581-9cea-b7cb2124c322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:29.314334 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54944b-c8c1-4581-9cea-b7cb2124c322 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:29.314676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54944b-c8c1-4581-9cea-b7cb2124c322 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:29.315029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54944b-c8c1-4581-9cea-b7cb2124c322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:29.326866 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54944b-c8c1-4581-9cea-b7cb2124c322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:29.328533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54944b-c8c1-4581-9cea-b7cb2124c322 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:29.346987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-3a54944b-c8c1-4581-9cea-b7cb2124c322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:29.346987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:29.346987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:29.346987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:29.346987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:29.346987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:29.346987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:29.346987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:29.346987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:29.346987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:29.346987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:29.346987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:29.346987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:21:29.346987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:21:29.346987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:29.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:29.348984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:21:29.348984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:21:29.348984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:29.348984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:29.348984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 621/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:29.354820 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe37de9-59be-4b2e-b4bf-fb90b30dcb0f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:29.464179 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe37de9-59be-4b2e-b4bf-fb90b30dcb0f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:29.499209 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cbd2d-8cf3-4ae3-9b7e-2bb02b7ffafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:29.499987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cbd2d-8cf3-4ae3-9b7e-2bb02b7ffafa None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:29.500335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cbd2d-8cf3-4ae3-9b7e-2bb02b7ffafa None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:29.500687 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cbd2d-8cf3-4ae3-9b7e-2bb02b7ffafa None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:29.501503 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cbd2d-8cf3-4ae3-9b7e-2bb02b7ffafa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:29.501808 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cbd2d-8cf3-4ae3-9b7e-2bb02b7ffafa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:29.503300 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cbd2d-8cf3-4ae3-9b7e-2bb02b7ffafa None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:29.516343 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 631/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:29.522839 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54944b-c8c1-4581-9cea-b7cb2124c322 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:29.640442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54944b-c8c1-4581-9cea-b7cb2124c322 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:29.679943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bd7eb-6479-4113-9294-a93da3506ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:29.680814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bd7eb-6479-4113-9294-a93da3506ede None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:29.681128 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bd7eb-6479-4113-9294-a93da3506ede None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:29.681432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bd7eb-6479-4113-9294-a93da3506ede None admin] PATH_INFO: `/v3/users/placement` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:29.690282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bd7eb-6479-4113-9294-a93da3506ede None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:29.691930 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bd7eb-6479-4113-9294-a93da3506ede None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-b25bd7eb-6479-4113-9294-a93da3506ede None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:21:29.706350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:29.708230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:29.709477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:29.709477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:29.709477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:21:29.709477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:21:29.709477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:21:29.709477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:21:29.709477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:21:29.709477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:21:29.709477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 14:21:29.709477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:29.709477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 622/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:21:29.713402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cbd2d-8cf3-4ae3-9b7e-2bb02b7ffafa None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:29.823150 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cbd2d-8cf3-4ae3-9b7e-2bb02b7ffafa None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:29.861981 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b9f70-548d-4d6f-a8f0-ab6dee40687c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:29.862837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b9f70-548d-4d6f-a8f0-ab6dee40687c None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:29.863188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b9f70-548d-4d6f-a8f0-ab6dee40687c None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:29.863804 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b9f70-548d-4d6f-a8f0-ab6dee40687c None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:29.864246 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b9f70-548d-4d6f-a8f0-ab6dee40687c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:29.864554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b9f70-548d-4d6f-a8f0-ab6dee40687c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:29.866042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b9f70-548d-4d6f-a8f0-ab6dee40687c None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:29.886144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 632/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 17 14:21:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:29.892533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bd7eb-6479-4113-9294-a93da3506ede None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:30.001092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bd7eb-6479-4113-9294-a93da3506ede None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:30.037287 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66196423-d2fa-447d-be72-971b769653d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:30.037952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66196423-d2fa-447d-be72-971b769653d4 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:30.038268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66196423-d2fa-447d-be72-971b769653d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:30.038546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66196423-d2fa-447d-be72-971b769653d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:30.112082 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66196423-d2fa-447d-be72-971b769653d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:30.113654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66196423-d2fa-447d-be72-971b769653d4 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:30.215919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 623/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:21:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:21:30.221682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b9f70-548d-4d6f-a8f0-ab6dee40687c None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:30.321036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b9f70-548d-4d6f-a8f0-ab6dee40687c None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:30.357816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b0d8-4064-49e6-87c0-50bd6854d72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:30.358836 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b0d8-4064-49e6-87c0-50bd6854d72f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:30.359121 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b0d8-4064-49e6-87c0-50bd6854d72f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:30.359398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b0d8-4064-49e6-87c0-50bd6854d72f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:30.369845 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91b0d8-4064-49e6-87c0-50bd6854d72f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:30.371255 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91b0d8-4064-49e6-87c0-50bd6854d72f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:30.389477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-ad91b0d8-4064-49e6-87c0-50bd6854d72f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:30.389477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:30.389477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:30.389477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:30.389477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:30.389477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:30.389477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:30.389477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:30.389477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:30.389477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:30.389477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:30.389477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:30.389477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:21:30.389477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:21:30.389477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:30.390665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:30.392026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:21:30.392026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:21:30.392026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:30.392026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:30.392026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 633/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:30.397185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66196423-d2fa-447d-be72-971b769653d4 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:30.496611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66196423-d2fa-447d-be72-971b769653d4 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:30.530704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd285e-87e7-4547-ab0f-10c6681ae3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:30.531625 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd285e-87e7-4547-ab0f-10c6681ae3ac None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:30.532380 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd285e-87e7-4547-ab0f-10c6681ae3ac None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:30.532719 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd285e-87e7-4547-ab0f-10c6681ae3ac None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:30.533802 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd285e-87e7-4547-ab0f-10c6681ae3ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:30.534268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd285e-87e7-4547-ab0f-10c6681ae3ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:30.536955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd285e-87e7-4547-ab0f-10c6681ae3ac None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:30.554350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 624/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:30.560256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b0d8-4064-49e6-87c0-50bd6854d72f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:30.662715 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b0d8-4064-49e6-87c0-50bd6854d72f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:30.694970 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3f71c-11da-4702-8fcf-e45dda833a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:30.695739 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3f71c-11da-4702-8fcf-e45dda833a00 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:30.696024 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3f71c-11da-4702-8fcf-e45dda833a00 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:30.696302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3f71c-11da-4702-8fcf-e45dda833a00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:30.702667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3f71c-11da-4702-8fcf-e45dda833a00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:30.704360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3f71c-11da-4702-8fcf-e45dda833a00 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:30.718244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-94f3f71c-11da-4702-8fcf-e45dda833a00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:21:30.718244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:30.718244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:30.718244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:30.718244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:30.718244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:30.718244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:30.718244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:30.718244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:30.718244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:30.718244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:30.718244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:30.718244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:21:30.718244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:21:30.718244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:30.719635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:30.720537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:21:30.720537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:21:30.720537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:21:30.720537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:21:30.720537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:21:30.720537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:21:30.720537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:21:30.720537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:30.720537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 634/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:21:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:30.725356 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd285e-87e7-4547-ab0f-10c6681ae3ac None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:30.823783 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd285e-87e7-4547-ab0f-10c6681ae3ac None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:30.856728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bd795-e4c1-4646-aa7d-de07d4c6d494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:30.857445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bd795-e4c1-4646-aa7d-de07d4c6d494 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:30.857748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bd795-e4c1-4646-aa7d-de07d4c6d494 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:30.858064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bd795-e4c1-4646-aa7d-de07d4c6d494 None admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:30.858942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bd795-e4c1-4646-aa7d-de07d4c6d494 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:30.859276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bd795-e4c1-4646-aa7d-de07d4c6d494 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:30.860762 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bd795-e4c1-4646-aa7d-de07d4c6d494 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:30.873627 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 625/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:21:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:30.879607 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3f71c-11da-4702-8fcf-e45dda833a00 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:30.974884 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3f71c-11da-4702-8fcf-e45dda833a00 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:31.007199 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a127e-9e60-437b-9851-f2fc342f30f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:31.007834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a127e-9e60-437b-9851-f2fc342f30f5 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:31.008119 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a127e-9e60-437b-9851-f2fc342f30f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:31.008395 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a127e-9e60-437b-9851-f2fc342f30f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:31.009220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a127e-9e60-437b-9851-f2fc342f30f5 None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=fad90f42ebfe43eb8256611a88df87ca) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:31.009531 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a127e-9e60-437b-9851-f2fc342f30f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:31.010988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a127e-9e60-437b-9851-f2fc342f30f5 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:31.016207 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 635/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:21:30 2022] GET /identity/v3/role_assignments?user.id=fad90f42ebfe43eb8256611a88df87ca&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:33.202102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b205f7a-eced-424f-810d-4d36c2eea17d None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:33.202537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b205f7a-eced-424f-810d-4d36c2eea17d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:33.202734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b205f7a-eced-424f-810d-4d36c2eea17d None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:33.204416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 626/1261] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:21:33.210575 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe8b95-c579-43be-bfe7-bd8211f7895b None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:33.211022 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe8b95-c579-43be-bfe7-bd8211f7895b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:33.211437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe8b95-c579-43be-bfe7-bd8211f7895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:33.230413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-dbbe8b95-c579-43be-bfe7-bd8211f7895b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:21:33.231584 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-dbbe8b95-c579-43be-bfe7-bd8211f7895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:21:33.294027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 636/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:21:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:21:33.315940 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b205f7a-eced-424f-810d-4d36c2eea17d None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:33.419712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b205f7a-eced-424f-810d-4d36c2eea17d None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:33.453340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350269fd-bec7-4af2-b7f0-dd52bf98b1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:33.454351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350269fd-bec7-4af2-b7f0-dd52bf98b1ec None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:33.454632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350269fd-bec7-4af2-b7f0-dd52bf98b1ec None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:33.454902 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350269fd-bec7-4af2-b7f0-dd52bf98b1ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:33.465101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350269fd-bec7-4af2-b7f0-dd52bf98b1ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-350269fd-bec7-4af2-b7f0-dd52bf98b1ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:21:33.472633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:33.473729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:33.474945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:33.474945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:33.474945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:33.474945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:33.474945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:21:33.474945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:21:33.474945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:21:33.474945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:21:33.474945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:21:33.474945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:21:33.474945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:21:33.474945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:33.474945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 627/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:21:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:33.479692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe8b95-c579-43be-bfe7-bd8211f7895b None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:33.588373 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe8b95-c579-43be-bfe7-bd8211f7895b None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:33.624279 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20135203-26ca-4cd1-95e1-29c8d6569572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:33.624934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20135203-26ca-4cd1-95e1-29c8d6569572 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:33.625211 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20135203-26ca-4cd1-95e1-29c8d6569572 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:33.625482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20135203-26ca-4cd1-95e1-29c8d6569572 None admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:33.626242 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20135203-26ca-4cd1-95e1-29c8d6569572 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:33.626544 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20135203-26ca-4cd1-95e1-29c8d6569572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:33.627902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20135203-26ca-4cd1-95e1-29c8d6569572 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:33.636184 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 637/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:21:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:33.642043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350269fd-bec7-4af2-b7f0-dd52bf98b1ec None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:33.742879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350269fd-bec7-4af2-b7f0-dd52bf98b1ec None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:33.776734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2fb04-e719-4a80-bfc0-389d55d52da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:33.777515 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2fb04-e719-4a80-bfc0-389d55d52da9 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:33.777800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2fb04-e719-4a80-bfc0-389d55d52da9 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:33.778075 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2fb04-e719-4a80-bfc0-389d55d52da9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:33.788656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2fb04-e719-4a80-bfc0-389d55d52da9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:33.790226 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2fb04-e719-4a80-bfc0-389d55d52da9 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:33.807570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-eed2fb04-e719-4a80-bfc0-389d55d52da9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:33.807570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:33.807570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:33.807570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:33.807570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:33.807570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:33.807570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:33.807570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:33.807570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:33.807570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:33.807570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:33.807570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:33.807570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:21:33.807570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:21:33.807570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:33.808473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:33.809376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:21:33.809376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:21:33.809376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:33.809376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:33.809376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 628/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:33.814450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20135203-26ca-4cd1-95e1-29c8d6569572 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:33.908639 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20135203-26ca-4cd1-95e1-29c8d6569572 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:33.939866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303529c-a91d-4c94-b607-769c2e899c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:33.940509 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303529c-a91d-4c94-b607-769c2e899c62 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:33.940929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303529c-a91d-4c94-b607-769c2e899c62 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:33.941210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303529c-a91d-4c94-b607-769c2e899c62 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:33.941926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303529c-a91d-4c94-b607-769c2e899c62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:33.942260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303529c-a91d-4c94-b607-769c2e899c62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:33.943662 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303529c-a91d-4c94-b607-769c2e899c62 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:33.955062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 638/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:33.961182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2fb04-e719-4a80-bfc0-389d55d52da9 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:34.058390 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2fb04-e719-4a80-bfc0-389d55d52da9 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:34.091981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911383c9-b0f5-4161-8e90-82128454d8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:34.092854 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911383c9-b0f5-4161-8e90-82128454d8a9 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:34.093165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911383c9-b0f5-4161-8e90-82128454d8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:34.093472 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911383c9-b0f5-4161-8e90-82128454d8a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:34.101903 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911383c9-b0f5-4161-8e90-82128454d8a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:34.103457 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911383c9-b0f5-4161-8e90-82128454d8a9 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-911383c9-b0f5-4161-8e90-82128454d8a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:21:34.118258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:34.119323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:34.120357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:34.120357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:34.120357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:21:34.120357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:21:34.120357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:21:34.120357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:21:34.120357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:21:34.120357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:21:34.120357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 14:21:34.120357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:34.120357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 629/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 14:21:34.125161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303529c-a91d-4c94-b607-769c2e899c62 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:34.219928 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303529c-a91d-4c94-b607-769c2e899c62 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:34.251326 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b98e3-bcf0-437c-9ec9-1301a10a185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:34.251978 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b98e3-bcf0-437c-9ec9-1301a10a185a None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:34.252259 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b98e3-bcf0-437c-9ec9-1301a10a185a None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:34.252536 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b98e3-bcf0-437c-9ec9-1301a10a185a None admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:34.253906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b98e3-bcf0-437c-9ec9-1301a10a185a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:34.254372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b98e3-bcf0-437c-9ec9-1301a10a185a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:34.255756 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b98e3-bcf0-437c-9ec9-1301a10a185a None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:34.272721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 639/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 17 14:21:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:34.278187 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911383c9-b0f5-4161-8e90-82128454d8a9 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:34.373316 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911383c9-b0f5-4161-8e90-82128454d8a9 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:34.405619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9d3bb-040f-4a88-825b-9cdb98c38170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:34.406414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9d3bb-040f-4a88-825b-9cdb98c38170 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:34.406697 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9d3bb-040f-4a88-825b-9cdb98c38170 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:34.406967 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9d3bb-040f-4a88-825b-9cdb98c38170 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:34.416938 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9d3bb-040f-4a88-825b-9cdb98c38170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:34.418409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9d3bb-040f-4a88-825b-9cdb98c38170 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:34.434671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-73e9d3bb-040f-4a88-825b-9cdb98c38170 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:34.434671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:34.434671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:34.434671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:34.434671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:34.434671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:34.434671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:34.434671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:34.434671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:34.434671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:34.434671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:34.434671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:34.434671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:21:34.434671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:21:34.434671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:34.435695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:34.436980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:21:34.436980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:21:34.436980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:34.436980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:34.436980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 630/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:34.442226 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b98e3-bcf0-437c-9ec9-1301a10a185a None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:34.540488 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b98e3-bcf0-437c-9ec9-1301a10a185a None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:34.577849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86784ad2-9d37-4db9-a63e-52ff200fe4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:34.578533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86784ad2-9d37-4db9-a63e-52ff200fe4ce None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:34.579071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86784ad2-9d37-4db9-a63e-52ff200fe4ce None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:34.579342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86784ad2-9d37-4db9-a63e-52ff200fe4ce None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:34.580058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86784ad2-9d37-4db9-a63e-52ff200fe4ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:34.580359 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86784ad2-9d37-4db9-a63e-52ff200fe4ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:34.581858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86784ad2-9d37-4db9-a63e-52ff200fe4ce None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:34.592512 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 640/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:34.598618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9d3bb-040f-4a88-825b-9cdb98c38170 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:34.695878 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9d3bb-040f-4a88-825b-9cdb98c38170 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:34.728644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf634189-2822-4d94-a01e-267de9e41a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:34.729417 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf634189-2822-4d94-a01e-267de9e41a4b None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:34.729700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf634189-2822-4d94-a01e-267de9e41a4b None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:34.729970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf634189-2822-4d94-a01e-267de9e41a4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:34.736583 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf634189-2822-4d94-a01e-267de9e41a4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:34.739166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf634189-2822-4d94-a01e-267de9e41a4b None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:34.752917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-cf634189-2822-4d94-a01e-267de9e41a4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:21:34.752917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:34.752917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:34.752917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:34.752917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:34.752917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:34.752917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:34.752917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:34.752917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:34.752917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:34.752917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:34.752917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:34.752917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:21:34.752917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:21:34.752917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:34.754589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:34.755797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:21:34.755797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:21:34.755797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:21:34.755797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:21:34.755797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:21:34.755797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:21:34.755797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:21:34.755797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:34.755797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 631/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:21:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:34.760860 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86784ad2-9d37-4db9-a63e-52ff200fe4ce None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:34.857141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86784ad2-9d37-4db9-a63e-52ff200fe4ce None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:34.889283 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48055f5a-0dca-49ce-ac23-62e8b16ff9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:34.889924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48055f5a-0dca-49ce-ac23-62e8b16ff9d4 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:34.890227 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48055f5a-0dca-49ce-ac23-62e8b16ff9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:34.890506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48055f5a-0dca-49ce-ac23-62e8b16ff9d4 None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:34.891284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48055f5a-0dca-49ce-ac23-62e8b16ff9d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:34.891589 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48055f5a-0dca-49ce-ac23-62e8b16ff9d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:34.893010 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48055f5a-0dca-49ce-ac23-62e8b16ff9d4 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:34.904415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 641/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:21:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:34.910986 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf634189-2822-4d94-a01e-267de9e41a4b None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:35.010457 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf634189-2822-4d94-a01e-267de9e41a4b None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:35.044137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2a70a-0bb0-4139-ab48-1b3e52842ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:35.045061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2a70a-0bb0-4139-ab48-1b3e52842ece None admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:35.045379 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2a70a-0bb0-4139-ab48-1b3e52842ece None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:35.045677 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2a70a-0bb0-4139-ab48-1b3e52842ece None admin] PATH_INFO: `/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/fad90f42ebfe43eb8256611a88df87ca/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:35.047653 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2a70a-0bb0-4139-ab48-1b3e52842ece None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac7d1119033458393ad6f78fc0df7a3, user_id=fad90f42ebfe43eb8256611a88df87ca, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:35.049191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2a70a-0bb0-4139-ab48-1b3e52842ece None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:35.062017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 632/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 17 14:21:34 2022] PUT /identity/v3/projects/8ac7d1119033458393ad6f78fc0df7a3/users/fad90f42ebfe43eb8256611a88df87ca/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:21:37.358452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba903db-b3cd-40c2-b5ac-76cd4e932e12 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:37.358972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba903db-b3cd-40c2-b5ac-76cd4e932e12 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:37.358972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba903db-b3cd-40c2-b5ac-76cd4e932e12 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:37.360357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 642/1274] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:21:37.366407 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7791b-0790-451f-8c48-e0e943289a52 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:37.366813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7791b-0790-451f-8c48-e0e943289a52 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:37.367021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7791b-0790-451f-8c48-e0e943289a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:37.384587 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-3aa7791b-0790-451f-8c48-e0e943289a52 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:21:37.385891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3aa7791b-0790-451f-8c48-e0e943289a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:21:37.454622 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 633/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:21:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:21:37.480026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba903db-b3cd-40c2-b5ac-76cd4e932e12 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:37.592258 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba903db-b3cd-40c2-b5ac-76cd4e932e12 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:37.626567 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4951f-05b5-4c63-a634-e0c475471570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:37.627350 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4951f-05b5-4c63-a634-e0c475471570 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:37.627632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4951f-05b5-4c63-a634-e0c475471570 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:37.627916 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4951f-05b5-4c63-a634-e0c475471570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:37.638146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4951f-05b5-4c63-a634-e0c475471570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-77d4951f-05b5-4c63-a634-e0c475471570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 14:21:37.647097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:37.648202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:37.649165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:37.649165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:37.649165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:37.649165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:37.649165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 14:21:37.649165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 14:21:37.649165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 14:21:37.649165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 14:21:37.649165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 14:21:37.649165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 14:21:37.649165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 14:21:37.649165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:37.649165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 643/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 17 14:21:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:37.654373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7791b-0790-451f-8c48-e0e943289a52 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:37.757722 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7791b-0790-451f-8c48-e0e943289a52 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:37.789135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a002a-f553-4308-bd4b-6bf4443c2b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:37.789789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a002a-f553-4308-bd4b-6bf4443c2b2d None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:37.790070 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a002a-f553-4308-bd4b-6bf4443c2b2d None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:37.790371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a002a-f553-4308-bd4b-6bf4443c2b2d None admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:37.791108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a002a-f553-4308-bd4b-6bf4443c2b2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:37.791411 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a002a-f553-4308-bd4b-6bf4443c2b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:37.792772 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a002a-f553-4308-bd4b-6bf4443c2b2d None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:37.800966 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 634/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 17 14:21:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:37.807809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4951f-05b5-4c63-a634-e0c475471570 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:37.906571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4951f-05b5-4c63-a634-e0c475471570 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:37.940678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820f530-356d-4619-ab87-9af53d1c861c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:37.941569 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820f530-356d-4619-ab87-9af53d1c861c None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:37.941889 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820f530-356d-4619-ab87-9af53d1c861c None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:37.942217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820f530-356d-4619-ab87-9af53d1c861c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:37.952788 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820f530-356d-4619-ab87-9af53d1c861c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:37.954645 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820f530-356d-4619-ab87-9af53d1c861c None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:37.973219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-1820f530-356d-4619-ab87-9af53d1c861c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:37.973219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:37.973219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:37.973219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:37.973219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:37.973219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:37.973219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:37.973219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:37.973219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:37.973219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:37.973219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:37.973219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:37.973219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:21:37.973219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:21:37.973219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:37.974273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:37.975203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:21:37.975203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:21:37.975203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:37.975203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:37.975203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 644/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:37.980164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a002a-f553-4308-bd4b-6bf4443c2b2d None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:38.075325 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a002a-f553-4308-bd4b-6bf4443c2b2d None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:38.107563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131cf08-c2e5-4f36-b41f-44623d272885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:38.108200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131cf08-c2e5-4f36-b41f-44623d272885 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:38.108476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131cf08-c2e5-4f36-b41f-44623d272885 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:38.108744 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131cf08-c2e5-4f36-b41f-44623d272885 None admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:38.109452 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131cf08-c2e5-4f36-b41f-44623d272885 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:38.109753 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131cf08-c2e5-4f36-b41f-44623d272885 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:38.111244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131cf08-c2e5-4f36-b41f-44623d272885 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:38.122942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 635/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:38.128693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820f530-356d-4619-ab87-9af53d1c861c None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:38.226801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820f530-356d-4619-ab87-9af53d1c861c None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:38.259491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53fc30-7b15-470a-ba14-8be434362cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:38.260353 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53fc30-7b15-470a-ba14-8be434362cc2 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:38.260655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53fc30-7b15-470a-ba14-8be434362cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:38.260952 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53fc30-7b15-470a-ba14-8be434362cc2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:38.268657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53fc30-7b15-470a-ba14-8be434362cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:38.270207 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53fc30-7b15-470a-ba14-8be434362cc2 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-cb53fc30-7b15-470a-ba14-8be434362cc2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 14:21:38.285260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:38.286390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:38.287580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:38.287580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:38.287580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 14:21:38.287580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 14:21:38.287580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 14:21:38.287580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 14:21:38.287580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 14:21:38.287580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 14:21:38.287580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 14:21:38.287580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:38.287580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 645/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:38.292205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131cf08-c2e5-4f36-b41f-44623d272885 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:38.387632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131cf08-c2e5-4f36-b41f-44623d272885 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:38.422284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ad869-ea7c-4369-b342-85504d93bb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:38.422955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ad869-ea7c-4369-b342-85504d93bb07 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:38.423238 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ad869-ea7c-4369-b342-85504d93bb07 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:38.423515 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ad869-ea7c-4369-b342-85504d93bb07 None admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:38.424354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ad869-ea7c-4369-b342-85504d93bb07 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:38.424663 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ad869-ea7c-4369-b342-85504d93bb07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:38.426823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ad869-ea7c-4369-b342-85504d93bb07 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:38.445034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 636/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 17 14:21:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:38.450841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53fc30-7b15-470a-ba14-8be434362cc2 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:38.549246 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53fc30-7b15-470a-ba14-8be434362cc2 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:38.584054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c4d67-b711-4805-a36b-f1a95d6221a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:38.584722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4d67-b711-4805-a36b-f1a95d6221a2 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:38.585041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4d67-b711-4805-a36b-f1a95d6221a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:38.585341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4d67-b711-4805-a36b-f1a95d6221a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:38.651652 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c4d67-b711-4805-a36b-f1a95d6221a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:38.653080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c4d67-b711-4805-a36b-f1a95d6221a2 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:38.746923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 646/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 17 14:21:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 14:21:38.753518 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ad869-ea7c-4369-b342-85504d93bb07 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:38.857909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ad869-ea7c-4369-b342-85504d93bb07 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:38.899465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef522d-8fb7-4747-8626-42e9b98d2e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:38.900245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef522d-8fb7-4747-8626-42e9b98d2e89 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:38.900523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef522d-8fb7-4747-8626-42e9b98d2e89 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:38.900792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef522d-8fb7-4747-8626-42e9b98d2e89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:38.911327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef522d-8fb7-4747-8626-42e9b98d2e89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:38.915167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef522d-8fb7-4747-8626-42e9b98d2e89 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:38.936366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-9cef522d-8fb7-4747-8626-42e9b98d2e89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:38.936366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:38.936366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:38.936366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:38.936366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:38.936366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:38.936366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:38.936366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:38.936366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:38.936366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:38.936366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:38.936366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:38.936366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 14:21:38.936366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 14:21:38.936366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:38.937439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:38.938768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 14:21:38.938768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 14:21:38.938768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 14:21:38.938768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:38.938768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 637/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:38.943596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c4d67-b711-4805-a36b-f1a95d6221a2 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:39.042370 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c4d67-b711-4805-a36b-f1a95d6221a2 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:39.074899 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d882ad-2122-4587-a90f-d206007a79e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:39.075542 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d882ad-2122-4587-a90f-d206007a79e4 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:39.075823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d882ad-2122-4587-a90f-d206007a79e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:39.076092 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d882ad-2122-4587-a90f-d206007a79e4 None admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:39.076803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d882ad-2122-4587-a90f-d206007a79e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:39.077103 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d882ad-2122-4587-a90f-d206007a79e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:39.078482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d882ad-2122-4587-a90f-d206007a79e4 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:39.090260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 647/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 17 14:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:39.095748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef522d-8fb7-4747-8626-42e9b98d2e89 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:39.189665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef522d-8fb7-4747-8626-42e9b98d2e89 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:39.246411 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a2416-9f9b-41b0-b4bb-7641f3d0f0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:39.247232 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a2416-9f9b-41b0-b4bb-7641f3d0f0d4 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:39.247514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a2416-9f9b-41b0-b4bb-7641f3d0f0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:39.247787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a2416-9f9b-41b0-b4bb-7641f3d0f0d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:39.257144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a2416-9f9b-41b0-b4bb-7641f3d0f0d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:39.258637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a2416-9f9b-41b0-b4bb-7641f3d0f0d4 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:39.272980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application [None req-b24a2416-9f9b-41b0-b4bb-7641f3d0f0d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:21:39.272980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:39.272980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:39.272980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:39.272980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:39.272980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:39.272980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:39.272980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:39.272980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:39.272980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:39.272980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:39.272980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:39.272980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 14:21:39.272980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 14:21:39.272980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application with Lock( May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:39.274108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:39.275336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 14:21:39.275336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 14:21:39.275336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 14:21:39.275336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 14:21:39.275336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 14:21:39.275336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 14:21:39.275336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 14:21:39.275336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: ERROR keystone.server.flask.application May 17 14:21:39.275336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 638/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 17 14:21:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:39.279903 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d882ad-2122-4587-a90f-d206007a79e4 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:39.372765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d882ad-2122-4587-a90f-d206007a79e4 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:39.404288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d7833-57dc-483f-8d4c-5c84a0d7ad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:39.404919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d7833-57dc-483f-8d4c-5c84a0d7ad2f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:39.405198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d7833-57dc-483f-8d4c-5c84a0d7ad2f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:39.405471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d7833-57dc-483f-8d4c-5c84a0d7ad2f None admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:39.406269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d7833-57dc-483f-8d4c-5c84a0d7ad2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:39.406574 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d7833-57dc-483f-8d4c-5c84a0d7ad2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:39.407994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d7833-57dc-483f-8d4c-5c84a0d7ad2f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:39.419433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 648/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 17 14:21:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:39.425595 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a2416-9f9b-41b0-b4bb-7641f3d0f0d4 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:39.524553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a2416-9f9b-41b0-b4bb-7641f3d0f0d4 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:39.558922 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfa508-dece-4b19-bd39-a930960b058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:39.559567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfa508-dece-4b19-bd39-a930960b058a None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:39.559846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfa508-dece-4b19-bd39-a930960b058a None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:39.560118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfa508-dece-4b19-bd39-a930960b058a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:39.560940 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfa508-dece-4b19-bd39-a930960b058a None admin] RBAC: Adding query filter params (role.id=adb74c52c74c4fac82c692163a0c6d8b, scope.project.id=8ac7d1119033458393ad6f78fc0df7a3, user.id=fad90f42ebfe43eb8256611a88df87ca) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:39.561251 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfa508-dece-4b19-bd39-a930960b058a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:39.562718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfa508-dece-4b19-bd39-a930960b058a None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:39.569251 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 639/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 17 14:21:39 2022] GET /identity/v3/role_assignments?user.id=fad90f42ebfe43eb8256611a88df87ca&scope.project.id=8ac7d1119033458393ad6f78fc0df7a3&role.id=adb74c52c74c4fac82c692163a0c6d8b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:41.818633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8c17d-2fb4-4441-9a77-e53913f8be1a None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:41.819200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8c17d-2fb4-4441-9a77-e53913f8be1a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:41.819296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8c17d-2fb4-4441-9a77-e53913f8be1a None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:41.820718 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 649/1288] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:21:41.825976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9ca84-48f7-4a1c-84b0-dc4ff766a07b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:41.826431 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9ca84-48f7-4a1c-84b0-dc4ff766a07b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:41.826543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9ca84-48f7-4a1c-84b0-dc4ff766a07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:41.843083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7fc9ca84-48f7-4a1c-84b0-dc4ff766a07b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:21:41.844240 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7fc9ca84-48f7-4a1c-84b0-dc4ff766a07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:21:41.906188 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 640/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:21:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:21:41.930553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8c17d-2fb4-4441-9a77-e53913f8be1a None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:42.040554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8c17d-2fb4-4441-9a77-e53913f8be1a None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:42.076332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10bf2f-87fe-4a08-accd-8b7f31dbca5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:42.077093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10bf2f-87fe-4a08-accd-8b7f31dbca5f None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:42.077404 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10bf2f-87fe-4a08-accd-8b7f31dbca5f None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:42.077701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10bf2f-87fe-4a08-accd-8b7f31dbca5f None admin] PATH_INFO: `/v3/services/placement` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:42.078441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10bf2f-87fe-4a08-accd-8b7f31dbca5f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:42.080155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10bf2f-87fe-4a08-accd-8b7f31dbca5f None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-0f10bf2f-87fe-4a08-accd-8b7f31dbca5f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:42.092078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:42.093149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:42.094021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:42.094021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:42.094021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:42.094021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:42.094021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:42.094021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:42.094021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:42.094021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:42.094021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:42.094021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:42.094021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:21:42.094021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:21:42.094021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 14:21:42.094021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:42.094021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 650/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 14:21:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:42.100231 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9ca84-48f7-4a1c-84b0-dc4ff766a07b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:42.198833 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9ca84-48f7-4a1c-84b0-dc4ff766a07b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:42.231993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049162e-2531-447d-a75b-24975c7b3fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:42.232647 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049162e-2531-447d-a75b-24975c7b3fdd None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:42.232928 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049162e-2531-447d-a75b-24975c7b3fdd None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:42.233201 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049162e-2531-447d-a75b-24975c7b3fdd None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:42.233901 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049162e-2531-447d-a75b-24975c7b3fdd None admin] RBAC: Adding query filter params (name=placement) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:42.234231 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049162e-2531-447d-a75b-24975c7b3fdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:42.235604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049162e-2531-447d-a75b-24975c7b3fdd None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:42.240696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 641/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Tue May 17 14:21:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:42.246570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10bf2f-87fe-4a08-accd-8b7f31dbca5f None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:42.354163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10bf2f-87fe-4a08-accd-8b7f31dbca5f None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:42.386236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f116b6a-f67e-434a-9218-937546162245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:42.386887 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f116b6a-f67e-434a-9218-937546162245 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:42.387168 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f116b6a-f67e-434a-9218-937546162245 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:42.387442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f116b6a-f67e-434a-9218-937546162245 None admin] PATH_INFO: `/v3/services` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:42.388134 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f116b6a-f67e-434a-9218-937546162245 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:42.388437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f116b6a-f67e-434a-9218-937546162245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:42.389798 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f116b6a-f67e-434a-9218-937546162245 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:42.394926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 651/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Tue May 17 14:21:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:21:44.603204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c4aba-2805-4662-ba92-c765f4c2901b None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:44.603732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c4aba-2805-4662-ba92-c765f4c2901b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:44.603732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c4aba-2805-4662-ba92-c765f4c2901b None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:44.605012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 642/1293] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:21:44.610299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7e20e-25c5-490a-b1eb-31a3d0e42546 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:44.610717 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7e20e-25c5-490a-b1eb-31a3d0e42546 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:44.610848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7e20e-25c5-490a-b1eb-31a3d0e42546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:44.627153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c3c7e20e-25c5-490a-b1eb-31a3d0e42546 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:21:44.628928 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c3c7e20e-25c5-490a-b1eb-31a3d0e42546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:21:44.691292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 652/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:21:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:21:44.714017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c4aba-2805-4662-ba92-c765f4c2901b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:44.809800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c4aba-2805-4662-ba92-c765f4c2901b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:44.841990 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7df89-e735-47a7-b65c-5463cae5bc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:44.842666 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7df89-e735-47a7-b65c-5463cae5bc87 None admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:44.842966 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7df89-e735-47a7-b65c-5463cae5bc87 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:44.843227 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7df89-e735-47a7-b65c-5463cae5bc87 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:44.843982 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7df89-e735-47a7-b65c-5463cae5bc87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:44.845358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7df89-e735-47a7-b65c-5463cae5bc87 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:44.858817 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 643/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 17 14:21:44 2022] POST /identity/v3/services => generated 246 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:21:47.087906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded120ce-e5cc-4b4b-8902-9db4ef048050 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:47.088469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded120ce-e5cc-4b4b-8902-9db4ef048050 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:47.088469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded120ce-e5cc-4b4b-8902-9db4ef048050 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:47.089789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 653/1296] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:21:47.094982 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32ce5b-53cb-4ca6-9171-5c9f2c067ea2 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:47.095366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32ce5b-53cb-4ca6-9171-5c9f2c067ea2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:47.095526 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32ce5b-53cb-4ca6-9171-5c9f2c067ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:47.112700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-2c32ce5b-53cb-4ca6-9171-5c9f2c067ea2 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:21:47.113854 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-2c32ce5b-53cb-4ca6-9171-5c9f2c067ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:21:47.181776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 644/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:21:47 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 14:21:47.204388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded120ce-e5cc-4b4b-8902-9db4ef048050 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:47.301416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded120ce-e5cc-4b4b-8902-9db4ef048050 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:47.333514 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63336f1b-9f8b-418f-9f26-4c9b7c6acaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:47.334830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63336f1b-9f8b-418f-9f26-4c9b7c6acaa2 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:47.335291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63336f1b-9f8b-418f-9f26-4c9b7c6acaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:47.335738 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63336f1b-9f8b-418f-9f26-4c9b7c6acaa2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:47.336809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63336f1b-9f8b-418f-9f26-4c9b7c6acaa2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:47.339133 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63336f1b-9f8b-418f-9f26-4c9b7c6acaa2 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-63336f1b-9f8b-418f-9f26-4c9b7c6acaa2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:47.353020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:47.354309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:47.355205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:47.355205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:47.355205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:47.355205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:47.355205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:47.355205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:47.355205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:47.355205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:47.355205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:47.355205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:47.355205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:21:47.355205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:21:47.355205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 14:21:47.355205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:47.355205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 654/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 14:21:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:47.361078 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32ce5b-53cb-4ca6-9171-5c9f2c067ea2 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:47.456885 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32ce5b-53cb-4ca6-9171-5c9f2c067ea2 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:47.490020 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187dccc-6985-46da-abe4-bdc664d37737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:47.490726 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187dccc-6985-46da-abe4-bdc664d37737 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:47.491013 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187dccc-6985-46da-abe4-bdc664d37737 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:47.491290 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187dccc-6985-46da-abe4-bdc664d37737 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:47.491991 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187dccc-6985-46da-abe4-bdc664d37737 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:47.492295 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187dccc-6985-46da-abe4-bdc664d37737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:47.493666 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187dccc-6985-46da-abe4-bdc664d37737 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:47.498720 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 645/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Tue May 17 14:21:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:47.505414 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63336f1b-9f8b-418f-9f26-4c9b7c6acaa2 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:47.601138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63336f1b-9f8b-418f-9f26-4c9b7c6acaa2 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:47.633237 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c0ab0-b375-4df0-a745-94e79fcfa070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:47.633879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c0ab0-b375-4df0-a745-94e79fcfa070 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:47.634164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c0ab0-b375-4df0-a745-94e79fcfa070 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:47.634470 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c0ab0-b375-4df0-a745-94e79fcfa070 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:47.635249 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c0ab0-b375-4df0-a745-94e79fcfa070 None admin] RBAC: Adding query filter params (interface=public, service_id=5a5ec90749874afc9d771539c15df878, region_id=RegionOne) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:47.635560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c0ab0-b375-4df0-a745-94e79fcfa070 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:47.636927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c0ab0-b375-4df0-a745-94e79fcfa070 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:47.641718 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 655/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 17 14:21:47 2022] GET /identity/v3/endpoints?service_id=5a5ec90749874afc9d771539c15df878&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:47.647446 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187dccc-6985-46da-abe4-bdc664d37737 None admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:47.747970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187dccc-6985-46da-abe4-bdc664d37737 None admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:47.779641 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7c161-92a1-4459-a8f3-f4ed33485dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:47.780297 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7c161-92a1-4459-a8f3-f4ed33485dca None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:47.780582 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7c161-92a1-4459-a8f3-f4ed33485dca None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:47.780859 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7c161-92a1-4459-a8f3-f4ed33485dca None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:47.781542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7c161-92a1-4459-a8f3-f4ed33485dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:47.782940 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7c161-92a1-4459-a8f3-f4ed33485dca None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:47.790136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 646/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 17 14:21:47 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:21:49.968773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb89f9-13e2-4cbf-b159-45da568f84bb None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:49.969309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb89f9-13e2-4cbf-b159-45da568f84bb None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:49.969309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb89f9-13e2-4cbf-b159-45da568f84bb None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:49.970684 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 656/1302] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:21:49.976010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6ea16-5bf0-4014-bdf3-37b8f0037bc2 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:49.976392 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6ea16-5bf0-4014-bdf3-37b8f0037bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:49.976557 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6ea16-5bf0-4014-bdf3-37b8f0037bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:49.992593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-eda6ea16-5bf0-4014-bdf3-37b8f0037bc2 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:21:49.993742 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-eda6ea16-5bf0-4014-bdf3-37b8f0037bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:21:50.056134 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 647/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:21:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 14:21:50.078878 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb89f9-13e2-4cbf-b159-45da568f84bb None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:50.173516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb89f9-13e2-4cbf-b159-45da568f84bb None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:50.206509 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8c605-5756-4c24-a1cd-f137f19f3114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:50.207299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8c605-5756-4c24-a1cd-f137f19f3114 None admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:50.207581 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8c605-5756-4c24-a1cd-f137f19f3114 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:50.207854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8c605-5756-4c24-a1cd-f137f19f3114 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:50.208500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8c605-5756-4c24-a1cd-f137f19f3114 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:50.209863 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8c605-5756-4c24-a1cd-f137f19f3114 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application [None req-99e8c605-5756-4c24-a1cd-f137f19f3114 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 14:21:50.221331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 14:21:50.222548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.get_or_create( May 17 14:21:50.223415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 14:21:50.223415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application with Lock( May 17 14:21:50.223415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 14:21:50.223415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self._enter() May 17 14:21:50.223415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 14:21:50.223415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 14:21:50.223415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 14:21:50.223415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application return self.creator() May 17 14:21:50.223415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 14:21:50.223415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application created_value = creator( May 17 14:21:50.223415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 14:21:50.223415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 14:21:50.223415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 14:21:50.223415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: ERROR keystone.server.flask.application May 17 14:21:50.223415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 657/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 17 14:21:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 14:21:50.228577 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6ea16-5bf0-4014-bdf3-37b8f0037bc2 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:50.324127 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6ea16-5bf0-4014-bdf3-37b8f0037bc2 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:50.356053 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7e274-d6d4-4f97-a0cf-f8e005aae0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:50.356714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7e274-d6d4-4f97-a0cf-f8e005aae0c5 None admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:50.356999 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7e274-d6d4-4f97-a0cf-f8e005aae0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:50.357274 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7e274-d6d4-4f97-a0cf-f8e005aae0c5 None admin] PATH_INFO: `/v3/services` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:50.357983 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7e274-d6d4-4f97-a0cf-f8e005aae0c5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:21:50.358321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7e274-d6d4-4f97-a0cf-f8e005aae0c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:50.359699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7e274-d6d4-4f97-a0cf-f8e005aae0c5 None admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:50.365248 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 648/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Tue May 17 14:21:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:21:50.371339 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8c605-5756-4c24-a1cd-f137f19f3114 None admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:21:50.464598 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8c605-5756-4c24-a1cd-f137f19f3114 None admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:21:50.496062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40d251-3a20-4de2-8c70-98e95efae382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:21:50.496633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40d251-3a20-4de2-8c70-98e95efae382 None admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:21:50.496912 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40d251-3a20-4de2-8c70-98e95efae382 None admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:21:50.497180 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40d251-3a20-4de2-8c70-98e95efae382 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:21:50.497906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40d251-3a20-4de2-8c70-98e95efae382 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:21:50.499298 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40d251-3a20-4de2-8c70-98e95efae382 None admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:21:50.517005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 658/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 17 14:21:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:22:55.142999 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bfdbc-efe0-4162-82da-14210655235f None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:22:55.143461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bfdbc-efe0-4162-82da-14210655235f None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:22:55.143461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bfdbc-efe0-4162-82da-14210655235f None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:22:55.148611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 649/1307] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:22:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:22:55.150105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c4425-c8e3-4fb6-bafc-2e22197e82d3 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:22:55.150541 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c4425-c8e3-4fb6-bafc-2e22197e82d3 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:22:55.150777 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c4425-c8e3-4fb6-bafc-2e22197e82d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:22:55.280598 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-853c4425-c8e3-4fb6-bafc-2e22197e82d3 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:22:55.283268 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-853c4425-c8e3-4fb6-bafc-2e22197e82d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:22:55.411593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 659/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:22:55.463789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adea75-dc54-4cbb-9f6b-8fb397e262b9 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:22:55.464081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adea75-dc54-4cbb-9f6b-8fb397e262b9 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:22:55.464357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adea75-dc54-4cbb-9f6b-8fb397e262b9 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:22:55.465969 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 650/1309] 10.222.0.48 () {54 vars in 964 bytes} [Tue May 17 14:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:22:55.473321 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40281267-cbc6-4d1f-8eb9-93edaf90ba36 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:22:55.473701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40281267-cbc6-4d1f-8eb9-93edaf90ba36 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:22:55.474049 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40281267-cbc6-4d1f-8eb9-93edaf90ba36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:22:55.560559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-40281267-cbc6-4d1f-8eb9-93edaf90ba36 None None] MFA Rules not processed for user `7b03ca44da654c3a9a5d9762b8eee189`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:22:55.561760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-40281267-cbc6-4d1f-8eb9-93edaf90ba36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:22:55.639773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 660/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Tue May 17 14:22:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:22:55.649746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adea75-dc54-4cbb-9f6b-8fb397e262b9 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:22:55.651704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b0adea75-dc54-4cbb-9f6b-8fb397e262b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:22:55.770660 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adea75-dc54-4cbb-9f6b-8fb397e262b9 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:22:55.852201 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17316646-c979-4070-a175-b3a54a4d23ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:22:55.852870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17316646-c979-4070-a175-b3a54a4d23ee service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:22:55.853151 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17316646-c979-4070-a175-b3a54a4d23ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:22:55.853477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17316646-c979-4070-a175-b3a54a4d23ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:22:55.855146 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-17316646-c979-4070-a175-b3a54a4d23ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:22:55.964599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17316646-c979-4070-a175-b3a54a4d23ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:22:55.965972 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17316646-c979-4070-a175-b3a54a4d23ee service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:22:55.984641 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 651/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:22:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:22:58.554472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7417c4-ae4c-4249-91e7-2cfe684e8b64 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:22:58.555050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7417c4-ae4c-4249-91e7-2cfe684e8b64 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:22:58.555050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7417c4-ae4c-4249-91e7-2cfe684e8b64 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:22:58.556379 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 661/1312] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:22:58.561816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fd9ad-c11c-434f-9ab6-aa9e366e900a None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:22:58.562293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fd9ad-c11c-434f-9ab6-aa9e366e900a None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:22:58.562469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fd9ad-c11c-434f-9ab6-aa9e366e900a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:22:58.646803 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-408fd9ad-c11c-434f-9ab6-aa9e366e900a None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:22:58.648055 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-408fd9ad-c11c-434f-9ab6-aa9e366e900a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:22:58.747106 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 652/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:22:58.785697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7417c4-ae4c-4249-91e7-2cfe684e8b64 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:22:58.787434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2f7417c4-ae4c-4249-91e7-2cfe684e8b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:22:58.899072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7417c4-ae4c-4249-91e7-2cfe684e8b64 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:22:58.972964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acd283-12fd-48a1-9f1f-8ab461e2577a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:22:58.973786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acd283-12fd-48a1-9f1f-8ab461e2577a service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:22:58.974170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acd283-12fd-48a1-9f1f-8ab461e2577a service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:22:58.974576 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acd283-12fd-48a1-9f1f-8ab461e2577a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:22:58.976377 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-76acd283-12fd-48a1-9f1f-8ab461e2577a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:22:59.087840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acd283-12fd-48a1-9f1f-8ab461e2577a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:22:59.089429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acd283-12fd-48a1-9f1f-8ab461e2577a service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:22:59.110920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 662/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:23:01.692043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eddad-e972-43e3-990a-4316c8a74778 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:01.692623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eddad-e972-43e3-990a-4316c8a74778 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:01.692623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eddad-e972-43e3-990a-4316c8a74778 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:01.693968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 653/1315] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:01.699307 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3910abd-6d2a-4598-8729-e7d41bb43932 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:01.699737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3910abd-6d2a-4598-8729-e7d41bb43932 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:01.699853 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3910abd-6d2a-4598-8729-e7d41bb43932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:01.762805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-f3910abd-6d2a-4598-8729-e7d41bb43932 None None] MFA Rules not processed for user `e85023b8270143b3943eb58af91e46eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:01.764008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f3910abd-6d2a-4598-8729-e7d41bb43932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:01.857450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 663/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:23:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:01.898559 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eddad-e972-43e3-990a-4316c8a74778 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:23:01.901110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c28eddad-e972-43e3-990a-4316c8a74778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:02.004798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eddad-e972-43e3-990a-4316c8a74778 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:23:02.077937 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9253f-0e5f-4f55-be1c-bdabfcf0629a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:23:02.079298 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9253f-0e5f-4f55-be1c-bdabfcf0629a service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:02.079584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9253f-0e5f-4f55-be1c-bdabfcf0629a service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:02.079861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9253f-0e5f-4f55-be1c-bdabfcf0629a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:02.081505 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e9f9253f-0e5f-4f55-be1c-bdabfcf0629a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:02.183902 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9253f-0e5f-4f55-be1c-bdabfcf0629a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:23:02.185341 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9253f-0e5f-4f55-be1c-bdabfcf0629a service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:23:02.205530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 654/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:23:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:23:04.947171 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8aff7-fbdc-46c1-a41b-53e90ac10753 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:04.947745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8aff7-fbdc-46c1-a41b-53e90ac10753 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:04.947745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8aff7-fbdc-46c1-a41b-53e90ac10753 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:04.949106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 664/1318] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:04.955484 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e40186-c8f8-4c37-919a-8db618bc5a9c None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:04.955885 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e40186-c8f8-4c37-919a-8db618bc5a9c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:04.956036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e40186-c8f8-4c37-919a-8db618bc5a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:05.019603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-a7e40186-c8f8-4c37-919a-8db618bc5a9c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:05.020788 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a7e40186-c8f8-4c37-919a-8db618bc5a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:05.128934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 655/1319] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:23:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:05.183714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89b129-72bb-4ac4-9ba7-308bfc5e1e1c None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:05.183999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89b129-72bb-4ac4-9ba7-308bfc5e1e1c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:05.184275 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89b129-72bb-4ac4-9ba7-308bfc5e1e1c None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:05.185628 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 665/1320] 10.222.0.48 () {54 vars in 964 bytes} [Tue May 17 14:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:05.191871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c7ff9-c969-406f-9f58-cf4e82ccb04c None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:05.192163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c7ff9-c969-406f-9f58-cf4e82ccb04c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:05.192445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c7ff9-c969-406f-9f58-cf4e82ccb04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:05.268331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-638c7ff9-c969-406f-9f58-cf4e82ccb04c None None] MFA Rules not processed for user `7b03ca44da654c3a9a5d9762b8eee189`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:05.269464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-638c7ff9-c969-406f-9f58-cf4e82ccb04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:05.344941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 656/1321] 10.222.0.48 () {58 vars in 1061 bytes} [Tue May 17 14:23:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:05.353912 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89b129-72bb-4ac4-9ba7-308bfc5e1e1c None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:23:05.355528 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ec89b129-72bb-4ac4-9ba7-308bfc5e1e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:05.455907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89b129-72bb-4ac4-9ba7-308bfc5e1e1c None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:23:05.525973 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf834f-a9b5-4ee3-b3dc-3bb2afdf1f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:23:05.526575 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf834f-a9b5-4ee3-b3dc-3bb2afdf1f1b service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:05.526861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf834f-a9b5-4ee3-b3dc-3bb2afdf1f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:05.527138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf834f-a9b5-4ee3-b3dc-3bb2afdf1f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:05.528768 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a5cf834f-a9b5-4ee3-b3dc-3bb2afdf1f1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:05.636823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf834f-a9b5-4ee3-b3dc-3bb2afdf1f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:23:05.638304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf834f-a9b5-4ee3-b3dc-3bb2afdf1f1b service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:23:05.656901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 666/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:23:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:23:09.041561 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12ab1a-c029-4ae1-a6b6-d945029c9bd1 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:09.041967 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12ab1a-c029-4ae1-a6b6-d945029c9bd1 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:09.042155 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12ab1a-c029-4ae1-a6b6-d945029c9bd1 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:09.044756 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 657/1323] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:09.049126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4945a-45f5-4359-9c10-32f9ee5acdba None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:09.049534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4945a-45f5-4359-9c10-32f9ee5acdba None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:09.049679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4945a-45f5-4359-9c10-32f9ee5acdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:09.114729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-1eb4945a-45f5-4359-9c10-32f9ee5acdba None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:09.115904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-1eb4945a-45f5-4359-9c10-32f9ee5acdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:09.208495 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 667/1324] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:09.243380 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12ab1a-c029-4ae1-a6b6-d945029c9bd1 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:23:09.244988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-db12ab1a-c029-4ae1-a6b6-d945029c9bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:09.347666 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12ab1a-c029-4ae1-a6b6-d945029c9bd1 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:23:09.418536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eb9cd-fba5-47a9-9c3c-c83091ae12c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:23:09.419188 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eb9cd-fba5-47a9-9c3c-c83091ae12c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:09.419467 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eb9cd-fba5-47a9-9c3c-c83091ae12c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:09.419735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eb9cd-fba5-47a9-9c3c-c83091ae12c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:09.421338 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-fe9eb9cd-fba5-47a9-9c3c-c83091ae12c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:09.526742 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9eb9cd-fba5-47a9-9c3c-c83091ae12c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:23:09.528178 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9eb9cd-fba5-47a9-9c3c-c83091ae12c7 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:23:09.547239 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 658/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:23:11.859021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e6564-c7f2-4aeb-ac2d-27ed84d1ceb6 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:11.860282 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e6564-c7f2-4aeb-ac2d-27ed84d1ceb6 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:11.860282 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e6564-c7f2-4aeb-ac2d-27ed84d1ceb6 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:11.861152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 668/1326] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:11.866508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d56fea-8410-4ce8-b7ef-2ee201d0bfa3 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:11.866927 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d56fea-8410-4ce8-b7ef-2ee201d0bfa3 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:11.867064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d56fea-8410-4ce8-b7ef-2ee201d0bfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:11.929325 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-32d56fea-8410-4ce8-b7ef-2ee201d0bfa3 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:11.930537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-32d56fea-8410-4ce8-b7ef-2ee201d0bfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:12.024689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 659/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:12.060347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e6564-c7f2-4aeb-ac2d-27ed84d1ceb6 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:23:12.062463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5a1e6564-c7f2-4aeb-ac2d-27ed84d1ceb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:12.162483 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e6564-c7f2-4aeb-ac2d-27ed84d1ceb6 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:23:12.233563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3ca9b-dafa-4649-af3b-1730a807bdff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:23:12.234264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3ca9b-dafa-4649-af3b-1730a807bdff service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:12.234550 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3ca9b-dafa-4649-af3b-1730a807bdff service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:12.234824 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3ca9b-dafa-4649-af3b-1730a807bdff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:12.236460 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-91f3ca9b-dafa-4649-af3b-1730a807bdff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:12.341436 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3ca9b-dafa-4649-af3b-1730a807bdff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:23:12.342921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3ca9b-dafa-4649-af3b-1730a807bdff service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:23:12.360678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 669/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:23:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:23:14.654761 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63345f-9d9e-4040-bb08-da38488808d1 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:14.655334 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63345f-9d9e-4040-bb08-da38488808d1 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:14.655334 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63345f-9d9e-4040-bb08-da38488808d1 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:14.657523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 660/1329] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:23:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:14.662881 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec6cea-405b-46bb-8431-160c74a530c0 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:14.663312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec6cea-405b-46bb-8431-160c74a530c0 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:14.663595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec6cea-405b-46bb-8431-160c74a530c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:14.727529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-46ec6cea-405b-46bb-8431-160c74a530c0 None None] MFA Rules not processed for user `e85023b8270143b3943eb58af91e46eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:14.728754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-46ec6cea-405b-46bb-8431-160c74a530c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:14.828785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 670/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:23:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:14.865336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63345f-9d9e-4040-bb08-da38488808d1 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:23:14.866916 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1c63345f-9d9e-4040-bb08-da38488808d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:14.969071 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63345f-9d9e-4040-bb08-da38488808d1 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:23:15.044061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3ba94-fc2f-4e09-bea4-eb3b0d113c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:23:15.044331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3ba94-fc2f-4e09-bea4-eb3b0d113c37 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:15.044496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3ba94-fc2f-4e09-bea4-eb3b0d113c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:15.044777 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3ba94-fc2f-4e09-bea4-eb3b0d113c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:15.047083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3cb3ba94-fc2f-4e09-bea4-eb3b0d113c37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:15.154869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3ba94-fc2f-4e09-bea4-eb3b0d113c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:23:15.157006 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3ba94-fc2f-4e09-bea4-eb3b0d113c37 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:23:15.175168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 661/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:23:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:23:17.643883 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104203e3-8ff4-4114-8c4e-bfbee295b511 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:17.644424 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104203e3-8ff4-4114-8c4e-bfbee295b511 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:17.644424 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104203e3-8ff4-4114-8c4e-bfbee295b511 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:17.645765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 671/1332] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:17.651020 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8038e78-26aa-4bd4-b7a5-ccd955ec22c5 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:17.651428 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8038e78-26aa-4bd4-b7a5-ccd955ec22c5 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:17.651570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8038e78-26aa-4bd4-b7a5-ccd955ec22c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:17.719258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-a8038e78-26aa-4bd4-b7a5-ccd955ec22c5 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:17.720536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a8038e78-26aa-4bd4-b7a5-ccd955ec22c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:17.828860 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 662/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:17.864406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104203e3-8ff4-4114-8c4e-bfbee295b511 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:23:17.865934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-104203e3-8ff4-4114-8c4e-bfbee295b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:17.966815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104203e3-8ff4-4114-8c4e-bfbee295b511 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:23:18.037686 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdea6d5-34f5-4bb1-9ea6-1555dccd1f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:23:18.038366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdea6d5-34f5-4bb1-9ea6-1555dccd1f8b service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:18.038644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdea6d5-34f5-4bb1-9ea6-1555dccd1f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:18.038913 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdea6d5-34f5-4bb1-9ea6-1555dccd1f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:18.040532 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-9fdea6d5-34f5-4bb1-9ea6-1555dccd1f8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:18.147192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdea6d5-34f5-4bb1-9ea6-1555dccd1f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:23:18.148638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdea6d5-34f5-4bb1-9ea6-1555dccd1f8b service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:23:18.167069 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 672/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:23:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:23:20.451199 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a1eae-09e3-4274-abc3-0038f1963f4b None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:20.451709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a1eae-09e3-4274-abc3-0038f1963f4b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:20.451709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a1eae-09e3-4274-abc3-0038f1963f4b None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:20.454064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 663/1335] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:20.459344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232ff7c-6ce9-4e9d-9cca-b3a14d4cd234 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:20.459769 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232ff7c-6ce9-4e9d-9cca-b3a14d4cd234 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:20.459882 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232ff7c-6ce9-4e9d-9cca-b3a14d4cd234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:20.523730 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-2232ff7c-6ce9-4e9d-9cca-b3a14d4cd234 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:20.524943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2232ff7c-6ce9-4e9d-9cca-b3a14d4cd234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:20.616297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 673/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:20.656193 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a1eae-09e3-4274-abc3-0038f1963f4b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:23:20.657709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-119a1eae-09e3-4274-abc3-0038f1963f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:20.756937 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a1eae-09e3-4274-abc3-0038f1963f4b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:23:20.828055 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498a42c-65df-44ce-9f75-608171984292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:23:20.828697 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498a42c-65df-44ce-9f75-608171984292 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:20.828984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498a42c-65df-44ce-9f75-608171984292 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:20.829261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498a42c-65df-44ce-9f75-608171984292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:20.830942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a498a42c-65df-44ce-9f75-608171984292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:20.936318 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498a42c-65df-44ce-9f75-608171984292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:23:20.938097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498a42c-65df-44ce-9f75-608171984292 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:23:20.956072 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 664/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:23:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:23:23.515429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d7450-dc30-4c6c-9f4a-ff728104ab1b None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:23.516006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d7450-dc30-4c6c-9f4a-ff728104ab1b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:23.516006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d7450-dc30-4c6c-9f4a-ff728104ab1b None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:23.518783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 674/1338] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:23:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:23.524036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5cf2e-63fd-4859-a61c-4bbed5f521b8 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:23.524425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5cf2e-63fd-4859-a61c-4bbed5f521b8 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:23.524580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5cf2e-63fd-4859-a61c-4bbed5f521b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:23.589451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-bcf5cf2e-63fd-4859-a61c-4bbed5f521b8 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:23.590694 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bcf5cf2e-63fd-4859-a61c-4bbed5f521b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:23.684819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 665/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:23:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:23.720736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d7450-dc30-4c6c-9f4a-ff728104ab1b None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:23:23.722312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-d96d7450-dc30-4c6c-9f4a-ff728104ab1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:23.822709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d7450-dc30-4c6c-9f4a-ff728104ab1b None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:23:23.892910 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1305c-ea3d-4044-9902-1146223b7793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:23:23.893554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1305c-ea3d-4044-9902-1146223b7793 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:23.893839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1305c-ea3d-4044-9902-1146223b7793 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:23.894116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1305c-ea3d-4044-9902-1146223b7793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:23.895783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-62f1305c-ea3d-4044-9902-1146223b7793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:24.000062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1305c-ea3d-4044-9902-1146223b7793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:23:24.001501 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1305c-ea3d-4044-9902-1146223b7793 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:23:24.019204 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 675/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:23:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:23:28.249886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0320d-9a24-4aa9-b2ac-6c571272bc20 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:28.250465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0320d-9a24-4aa9-b2ac-6c571272bc20 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:28.250465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0320d-9a24-4aa9-b2ac-6c571272bc20 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:28.251800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 666/1341] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:28.257088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635aeba5-6e26-49da-9639-7dfedfbce154 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:28.257510 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635aeba5-6e26-49da-9639-7dfedfbce154 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:28.257635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635aeba5-6e26-49da-9639-7dfedfbce154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:28.326607 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-635aeba5-6e26-49da-9639-7dfedfbce154 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:28.329036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-635aeba5-6e26-49da-9639-7dfedfbce154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:28.438777 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 676/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:28.477400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0320d-9a24-4aa9-b2ac-6c571272bc20 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:23:28.479527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c4f0320d-9a24-4aa9-b2ac-6c571272bc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:28.576185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0320d-9a24-4aa9-b2ac-6c571272bc20 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:23:28.580023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8de05-bf34-4cc7-8e9d-717c7174ae65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:23:28.580676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8de05-bf34-4cc7-8e9d-717c7174ae65 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:28.580964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8de05-bf34-4cc7-8e9d-717c7174ae65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:28.581242 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8de05-bf34-4cc7-8e9d-717c7174ae65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:28.590266 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8de05-bf34-4cc7-8e9d-717c7174ae65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:23:28.591747 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8de05-bf34-4cc7-8e9d-717c7174ae65 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:23:28.601846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 667/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:23:31.610976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87627ab-bf98-4fbf-b084-72a2363ef532 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:31.611494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87627ab-bf98-4fbf-b084-72a2363ef532 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:31.611613 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87627ab-bf98-4fbf-b084-72a2363ef532 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:31.612896 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 677/1344] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:31.618287 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d89893-4bd5-4d04-a9f9-c5d5fd0e7964 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:31.618699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d89893-4bd5-4d04-a9f9-c5d5fd0e7964 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:31.618848 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d89893-4bd5-4d04-a9f9-c5d5fd0e7964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:31.647330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-16d89893-4bd5-4d04-a9f9-c5d5fd0e7964 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:31.648525 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-16d89893-4bd5-4d04-a9f9-c5d5fd0e7964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:31.729890 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 668/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:23:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:31.770495 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87627ab-bf98-4fbf-b084-72a2363ef532 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:23:31.781312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87627ab-bf98-4fbf-b084-72a2363ef532 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:23:31.785077 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebb5ba-d64b-4d27-b3c1-cc7b0051eb69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:23:31.785731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebb5ba-d64b-4d27-b3c1-cc7b0051eb69 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:31.786013 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebb5ba-d64b-4d27-b3c1-cc7b0051eb69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:31.786319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebb5ba-d64b-4d27-b3c1-cc7b0051eb69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:31.795747 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebb5ba-d64b-4d27-b3c1-cc7b0051eb69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:23:31.797354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebb5ba-d64b-4d27-b3c1-cc7b0051eb69 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:23:31.806909 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 678/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:23:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:23:36.211134 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98973e-e078-4294-b67c-5fdcd703271b None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:36.211592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98973e-e078-4294-b67c-5fdcd703271b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:36.211703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98973e-e078-4294-b67c-5fdcd703271b None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:36.213076 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 669/1347] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:36.218879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e59b-7e43-4c77-b79a-e0e450042b24 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:36.219289 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e59b-7e43-4c77-b79a-e0e450042b24 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:36.219435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e59b-7e43-4c77-b79a-e0e450042b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:36.237369 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-7687e59b-7e43-4c77-b79a-e0e450042b24 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:36.238596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7687e59b-7e43-4c77-b79a-e0e450042b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:36.246708 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 679/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:36.284165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98973e-e078-4294-b67c-5fdcd703271b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:23:36.294602 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98973e-e078-4294-b67c-5fdcd703271b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:23:36.298778 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223e4d6-a949-49ac-9c18-35ab7cf9cdf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:23:36.299416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223e4d6-a949-49ac-9c18-35ab7cf9cdf7 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:36.299698 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223e4d6-a949-49ac-9c18-35ab7cf9cdf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:36.299976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223e4d6-a949-49ac-9c18-35ab7cf9cdf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:36.308584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223e4d6-a949-49ac-9c18-35ab7cf9cdf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:23:36.310016 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223e4d6-a949-49ac-9c18-35ab7cf9cdf7 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:23:36.319423 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 670/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:23:41.908981 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ae432-e4f8-4e33-9b69-2b7b2a350d2b None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:41.909948 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ae432-e4f8-4e33-9b69-2b7b2a350d2b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:41.910824 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ae432-e4f8-4e33-9b69-2b7b2a350d2b None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:41.912685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 680/1350] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 14:23:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:41.918068 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019be1f-9c7b-411c-9b4b-8633bb73aa71 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:41.918976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019be1f-9c7b-411c-9b4b-8633bb73aa71 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:41.919481 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019be1f-9c7b-411c-9b4b-8633bb73aa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:41.997824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-c019be1f-9c7b-411c-9b4b-8633bb73aa71 None None] MFA Rules not processed for user `fad90f42ebfe43eb8256611a88df87ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:42.000101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c019be1f-9c7b-411c-9b4b-8633bb73aa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:42.115221 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 671/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 14:23:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:46.386346 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e7a9f-0eac-4254-9c70-083f1cc075fd None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:46.386917 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e7a9f-0eac-4254-9c70-083f1cc075fd None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:46.387376 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e7a9f-0eac-4254-9c70-083f1cc075fd None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:46.388814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 681/1352] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 14:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:46.394898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc955a-51d8-410a-bf57-a744189cd93a None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:46.395384 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc955a-51d8-410a-bf57-a744189cd93a None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:46.395482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc955a-51d8-410a-bf57-a744189cd93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:46.417041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-f3cc955a-51d8-410a-bf57-a744189cd93a None None] MFA Rules not processed for user `fad90f42ebfe43eb8256611a88df87ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:46.418288 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f3cc955a-51d8-410a-bf57-a744189cd93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:46.427827 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 672/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 14:23:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:47.924533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a3ecd-da1c-4c6e-9dad-1041617b5ebc None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:47.925064 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a3ecd-da1c-4c6e-9dad-1041617b5ebc None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:47.925064 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a3ecd-da1c-4c6e-9dad-1041617b5ebc None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:47.926463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 682/1354] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 14:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:47.931458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804ef1-bb42-4fed-ac07-dcdcaa988d8b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:47.931849 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804ef1-bb42-4fed-ac07-dcdcaa988d8b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:47.932016 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804ef1-bb42-4fed-ac07-dcdcaa988d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:47.949533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-4f804ef1-bb42-4fed-ac07-dcdcaa988d8b None None] MFA Rules not processed for user `fad90f42ebfe43eb8256611a88df87ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:47.950728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-4f804ef1-bb42-4fed-ac07-dcdcaa988d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:47.960210 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 673/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 14:23:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:23:52.038580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e1027-8d5b-4b34-a6a1-079b06ee4949 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:52.039090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e1027-8d5b-4b34-a6a1-079b06ee4949 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:52.039322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e1027-8d5b-4b34-a6a1-079b06ee4949 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:52.046695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b5bf-1058-449e-a2ad-4c2884d04925 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:52.047585 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b5bf-1058-449e-a2ad-4c2884d04925 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:52.048659 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b5bf-1058-449e-a2ad-4c2884d04925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:52.050527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 683/1356] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:23:52 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:52.072782 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b4a3b5bf-1058-449e-a2ad-4c2884d04925 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:52.073963 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b4a3b5bf-1058-449e-a2ad-4c2884d04925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:52.082778 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 674/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:23:52.139873 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d0f51-5ab7-45e0-87a7-c8402fb23c37 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:52.140180 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d0f51-5ab7-45e0-87a7-c8402fb23c37 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:52.140511 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d0f51-5ab7-45e0-87a7-c8402fb23c37 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:52.141896 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 684/1358] 10.222.0.48 () {54 vars in 961 bytes} [Tue May 17 14:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:52.147692 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb5801-3609-4bb9-8f2d-d13a2de966dd None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:52.148060 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb5801-3609-4bb9-8f2d-d13a2de966dd None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:52.148416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb5801-3609-4bb9-8f2d-d13a2de966dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:52.196465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-c0bb5801-3609-4bb9-8f2d-d13a2de966dd None None] MFA Rules not processed for user `1f443d2ca1534249bb2c4096300ddffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:52.198593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c0bb5801-3609-4bb9-8f2d-d13a2de966dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:52.284562 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 675/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Tue May 17 14:23:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:23:52.292427 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d0f51-5ab7-45e0-87a7-c8402fb23c37 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:23:52.308394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d0f51-5ab7-45e0-87a7-c8402fb23c37 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:23:52.314837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39440cca-5d2a-4360-aa74-c41b52b38228 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:23:52.315602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39440cca-5d2a-4360-aa74-c41b52b38228 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:52.316069 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39440cca-5d2a-4360-aa74-c41b52b38228 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:52.316439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39440cca-5d2a-4360-aa74-c41b52b38228 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:52.330380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39440cca-5d2a-4360-aa74-c41b52b38228 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:23:52.332380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39440cca-5d2a-4360-aa74-c41b52b38228 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:23:52.344474 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 685/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:23:54.811530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2865b-1d34-4a25-b13f-22ba139037b0 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:54.812061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2865b-1d34-4a25-b13f-22ba139037b0 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:54.812172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2865b-1d34-4a25-b13f-22ba139037b0 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:54.813464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 676/1361] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:54.818943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274d02c-bfc3-4955-be47-e1d4c43619af None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:54.819361 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274d02c-bfc3-4955-be47-e1d4c43619af None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:54.819508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274d02c-bfc3-4955-be47-e1d4c43619af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:54.840930 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-0274d02c-bfc3-4955-be47-e1d4c43619af None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:54.843170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-0274d02c-bfc3-4955-be47-e1d4c43619af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:54.851041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 686/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:54.895726 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2865b-1d34-4a25-b13f-22ba139037b0 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:23:54.912201 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2865b-1d34-4a25-b13f-22ba139037b0 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:23:54.918165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcea6ae-12b2-4cf4-b5c1-a954176218fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:23:54.919510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcea6ae-12b2-4cf4-b5c1-a954176218fd service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:54.920185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcea6ae-12b2-4cf4-b5c1-a954176218fd service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:54.921025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcea6ae-12b2-4cf4-b5c1-a954176218fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:54.930273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcea6ae-12b2-4cf4-b5c1-a954176218fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:23:54.932342 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcea6ae-12b2-4cf4-b5c1-a954176218fd service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:23:54.943630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 677/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:23:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:23:57.577998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2b7f6-d678-4eb3-9dca-2f1dab33fa5d None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:57.578566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2b7f6-d678-4eb3-9dca-2f1dab33fa5d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:57.578566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2b7f6-d678-4eb3-9dca-2f1dab33fa5d None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:57.579885 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 687/1364] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:23:57.585267 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccab152-61d4-4fc2-bc71-5d16f4296daa None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:57.585721 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccab152-61d4-4fc2-bc71-5d16f4296daa None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:57.585827 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccab152-61d4-4fc2-bc71-5d16f4296daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:57.604021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-0ccab152-61d4-4fc2-bc71-5d16f4296daa None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:57.605222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0ccab152-61d4-4fc2-bc71-5d16f4296daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:57.613883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 678/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:23:57.659753 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ad794-6026-4f68-98c4-70017d6a5f9c None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:57.660044 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ad794-6026-4f68-98c4-70017d6a5f9c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:57.660326 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ad794-6026-4f68-98c4-70017d6a5f9c None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:57.661662 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 688/1366] 10.222.0.48 () {54 vars in 961 bytes} [Tue May 17 14:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:23:57.667007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad882d00-b258-49c9-9c68-47e6ac7bbc1b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:57.667296 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad882d00-b258-49c9-9c68-47e6ac7bbc1b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:57.667574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad882d00-b258-49c9-9c68-47e6ac7bbc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:57.686520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-ad882d00-b258-49c9-9c68-47e6ac7bbc1b None None] MFA Rules not processed for user `1f443d2ca1534249bb2c4096300ddffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:23:57.687699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ad882d00-b258-49c9-9c68-47e6ac7bbc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:23:57.697056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 679/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Tue May 17 14:23:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:23:57.705147 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ad794-6026-4f68-98c4-70017d6a5f9c None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:23:57.723269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ad794-6026-4f68-98c4-70017d6a5f9c None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:23:57.729542 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0132f-ebd3-4520-80e1-485fa4201d53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:23:57.730257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0132f-ebd3-4520-80e1-485fa4201d53 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:23:57.730545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0132f-ebd3-4520-80e1-485fa4201d53 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:23:57.730823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0132f-ebd3-4520-80e1-485fa4201d53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:23:57.740433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0132f-ebd3-4520-80e1-485fa4201d53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:23:57.742016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0132f-ebd3-4520-80e1-485fa4201d53 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:23:57.751900 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 689/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:00.138413 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fcbd7-1ad1-4496-ab38-dbf66554aeed None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:00.139344 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fcbd7-1ad1-4496-ab38-dbf66554aeed None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:00.139799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fcbd7-1ad1-4496-ab38-dbf66554aeed None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:00.145386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 680/1369] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:24:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:00.147016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c32077-958b-4bc6-a3f6-b428b19ecd49 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:00.147437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c32077-958b-4bc6-a3f6-b428b19ecd49 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:00.147868 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c32077-958b-4bc6-a3f6-b428b19ecd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:00.166429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-56c32077-958b-4bc6-a3f6-b428b19ecd49 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:00.167772 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-56c32077-958b-4bc6-a3f6-b428b19ecd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:00.176750 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 690/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:00.221946 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fcbd7-1ad1-4496-ab38-dbf66554aeed None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:00.236381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8f6d3-bc0b-472f-9c7f-d0663b22e5ff None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:00.236901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8f6d3-bc0b-472f-9c7f-d0663b22e5ff None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:00.237244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8f6d3-bc0b-472f-9c7f-d0663b22e5ff None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:00.237499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fcbd7-1ad1-4496-ab38-dbf66554aeed None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:00.238747 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 691/1371] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:24:00.243832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243806-04aa-435f-b25a-c64481b8fa64 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:00.244057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadd6c0-2fe2-4bd3-8fae-c5c5bf8ca637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:00.244174 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243806-04aa-435f-b25a-c64481b8fa64 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:00.244424 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243806-04aa-435f-b25a-c64481b8fa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:00.244984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadd6c0-2fe2-4bd3-8fae-c5c5bf8ca637 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:00.245358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadd6c0-2fe2-4bd3-8fae-c5c5bf8ca637 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:00.245745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadd6c0-2fe2-4bd3-8fae-c5c5bf8ca637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:00.256280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadd6c0-2fe2-4bd3-8fae-c5c5bf8ca637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:00.258037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadd6c0-2fe2-4bd3-8fae-c5c5bf8ca637 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:00.265902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-9b243806-04aa-435f-b25a-c64481b8fa64 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:00.267131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-9b243806-04aa-435f-b25a-c64481b8fa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:00.269360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 681/1372] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:00.275170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 692/1373] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:24:00.567729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591205b0-6a3c-4d0d-be05-0c3d1a869828 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:00.568051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591205b0-6a3c-4d0d-be05-0c3d1a869828 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:00.568728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591205b0-6a3c-4d0d-be05-0c3d1a869828 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:00.570695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 682/1374] 10.222.0.48 () {54 vars in 963 bytes} [Tue May 17 14:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:00.577016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b54de6-aa68-4241-b70f-1553fd15b93c None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:00.577561 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b54de6-aa68-4241-b70f-1553fd15b93c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:00.577840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b54de6-aa68-4241-b70f-1553fd15b93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:00.625498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-81b54de6-aa68-4241-b70f-1553fd15b93c None None] MFA Rules not processed for user `f7fd6429fee94c89a6a29467b014ec5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:00.626725 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-81b54de6-aa68-4241-b70f-1553fd15b93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:00.686854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 693/1375] 10.222.0.48 () {58 vars in 1060 bytes} [Tue May 17 14:24:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:00.694156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591205b0-6a3c-4d0d-be05-0c3d1a869828 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:00.705424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591205b0-6a3c-4d0d-be05-0c3d1a869828 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:00.708934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbb503-49cc-49fc-9dd8-a2198682a10a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:00.709578 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbb503-49cc-49fc-9dd8-a2198682a10a service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:00.709856 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbb503-49cc-49fc-9dd8-a2198682a10a service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:00.710345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbb503-49cc-49fc-9dd8-a2198682a10a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:00.720522 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbb503-49cc-49fc-9dd8-a2198682a10a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:00.721970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbb503-49cc-49fc-9dd8-a2198682a10a service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:00.731654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 683/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:02.592787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d4910-0af3-47ae-a093-7829639888b8 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:02.593303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d4910-0af3-47ae-a093-7829639888b8 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:02.593303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d4910-0af3-47ae-a093-7829639888b8 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:02.594677 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 694/1377] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:02.600115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de2b4f-46e5-4ec1-a794-19b6b88125c8 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:02.600579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de2b4f-46e5-4ec1-a794-19b6b88125c8 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:02.600688 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de2b4f-46e5-4ec1-a794-19b6b88125c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:02.618688 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-77de2b4f-46e5-4ec1-a794-19b6b88125c8 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:02.619860 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-77de2b4f-46e5-4ec1-a794-19b6b88125c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:02.628458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 684/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:02.672736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d4910-0af3-47ae-a093-7829639888b8 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:02.688628 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d4910-0af3-47ae-a093-7829639888b8 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:02.694356 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d276975-5e3b-4c3c-8add-48a38b67422d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:02.695011 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d276975-5e3b-4c3c-8add-48a38b67422d service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:02.695648 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d276975-5e3b-4c3c-8add-48a38b67422d service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:02.695648 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d276975-5e3b-4c3c-8add-48a38b67422d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:02.705122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d276975-5e3b-4c3c-8add-48a38b67422d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:02.706819 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d276975-5e3b-4c3c-8add-48a38b67422d service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:02.716153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 695/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:04.987938 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eded6c8-a199-46e4-a9ed-1fd19cb95b00 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:04.988475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eded6c8-a199-46e4-a9ed-1fd19cb95b00 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:04.988475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eded6c8-a199-46e4-a9ed-1fd19cb95b00 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:04.989835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 685/1380] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:04.995380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df7ba7-628e-4b6e-a19f-c26bb1b23e62 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:04.995842 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df7ba7-628e-4b6e-a19f-c26bb1b23e62 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:04.995957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df7ba7-628e-4b6e-a19f-c26bb1b23e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:05.014684 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-74df7ba7-628e-4b6e-a19f-c26bb1b23e62 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:05.015902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-74df7ba7-628e-4b6e-a19f-c26bb1b23e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:05.024032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 696/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:05.068144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eded6c8-a199-46e4-a9ed-1fd19cb95b00 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:05.086250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eded6c8-a199-46e4-a9ed-1fd19cb95b00 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:05.091751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7a4f8-6885-4095-9d54-b589d47f38a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:05.092500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7a4f8-6885-4095-9d54-b589d47f38a5 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:05.092777 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7a4f8-6885-4095-9d54-b589d47f38a5 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:05.093055 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7a4f8-6885-4095-9d54-b589d47f38a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:05.101439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7a4f8-6885-4095-9d54-b589d47f38a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:05.103032 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7a4f8-6885-4095-9d54-b589d47f38a5 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:05.113023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 686/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:07.480982 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfc0f6-2521-48c3-bcd4-37b0c7025bc2 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:07.481544 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfc0f6-2521-48c3-bcd4-37b0c7025bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:07.481544 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfc0f6-2521-48c3-bcd4-37b0c7025bc2 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:07.483359 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 697/1383] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:07.489382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13004736-681a-48ed-b1f3-ff29f65a311d None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:07.490236 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13004736-681a-48ed-b1f3-ff29f65a311d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:07.490703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13004736-681a-48ed-b1f3-ff29f65a311d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:07.508678 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-13004736-681a-48ed-b1f3-ff29f65a311d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:07.509842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-13004736-681a-48ed-b1f3-ff29f65a311d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:07.518892 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 687/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:07.562280 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfc0f6-2521-48c3-bcd4-37b0c7025bc2 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:07.577042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfc0f6-2521-48c3-bcd4-37b0c7025bc2 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:07.583075 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c3f7e-df17-49e0-8656-9ec9abed20ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:07.583830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c3f7e-df17-49e0-8656-9ec9abed20ff service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:07.584468 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c3f7e-df17-49e0-8656-9ec9abed20ff service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:07.585028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c3f7e-df17-49e0-8656-9ec9abed20ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:07.594504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c3f7e-df17-49e0-8656-9ec9abed20ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:07.596509 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c3f7e-df17-49e0-8656-9ec9abed20ff service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:07.607594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 698/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:09.859818 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e2869-e735-4d5a-a821-8d0e45260889 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:09.860381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e2869-e735-4d5a-a821-8d0e45260889 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:09.860381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e2869-e735-4d5a-a821-8d0e45260889 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:09.861740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 688/1386] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:09.867215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c79b-03c1-4ab5-8387-c9f857370c22 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:09.867625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c79b-03c1-4ab5-8387-c9f857370c22 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:09.867777 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c79b-03c1-4ab5-8387-c9f857370c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:09.886265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-6316c79b-03c1-4ab5-8387-c9f857370c22 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:09.887466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6316c79b-03c1-4ab5-8387-c9f857370c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:09.896230 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 699/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:09.940330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e2869-e735-4d5a-a821-8d0e45260889 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:09.959446 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e2869-e735-4d5a-a821-8d0e45260889 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:09.966417 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93862de3-35ba-4fcc-a4cb-3c91635126c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:09.968181 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93862de3-35ba-4fcc-a4cb-3c91635126c2 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:09.968542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93862de3-35ba-4fcc-a4cb-3c91635126c2 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:09.968903 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93862de3-35ba-4fcc-a4cb-3c91635126c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:09.979512 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93862de3-35ba-4fcc-a4cb-3c91635126c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:09.981599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93862de3-35ba-4fcc-a4cb-3c91635126c2 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:09.995153 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 689/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:12.408299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e03512-201f-482d-a829-f35d09e19030 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:12.409538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e03512-201f-482d-a829-f35d09e19030 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:12.409538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e03512-201f-482d-a829-f35d09e19030 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:12.411237 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 700/1389] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:24:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:24:12.417684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f362a-a808-4218-9979-d35511ad10b7 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:12.418249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f362a-a808-4218-9979-d35511ad10b7 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:12.418389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f362a-a808-4218-9979-d35511ad10b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:12.440921 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-391f362a-a808-4218-9979-d35511ad10b7 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:12.442580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-391f362a-a808-4218-9979-d35511ad10b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:12.454086 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 690/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:12.509453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e03512-201f-482d-a829-f35d09e19030 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:12.524443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e03512-201f-482d-a829-f35d09e19030 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:12.530964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435269c-154e-479b-8f59-0ea19e030ebd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:12.531540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435269c-154e-479b-8f59-0ea19e030ebd service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:12.531824 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435269c-154e-479b-8f59-0ea19e030ebd service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:12.532103 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435269c-154e-479b-8f59-0ea19e030ebd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:12.540583 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435269c-154e-479b-8f59-0ea19e030ebd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:12.542140 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435269c-154e-479b-8f59-0ea19e030ebd service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:12.551880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 701/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:14.856073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a249ed-685a-407f-839d-4818e6061a23 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:14.857320 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a249ed-685a-407f-839d-4818e6061a23 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:14.857320 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a249ed-685a-407f-839d-4818e6061a23 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:14.858546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 691/1392] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:14.863841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e0f82-6646-407e-ae52-6257cf181acb None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:14.864326 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e0f82-6646-407e-ae52-6257cf181acb None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:14.864442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e0f82-6646-407e-ae52-6257cf181acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:14.882565 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c19e0f82-6646-407e-ae52-6257cf181acb None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:14.883760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c19e0f82-6646-407e-ae52-6257cf181acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:14.891798 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 702/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:14.936532 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a249ed-685a-407f-839d-4818e6061a23 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:14.950820 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a249ed-685a-407f-839d-4818e6061a23 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:14.956556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e99f-5e8a-4bde-838f-0a61bf4139e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:14.957196 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e99f-5e8a-4bde-838f-0a61bf4139e5 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:14.957479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e99f-5e8a-4bde-838f-0a61bf4139e5 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:14.957756 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e99f-5e8a-4bde-838f-0a61bf4139e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:14.965982 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88e99f-5e8a-4bde-838f-0a61bf4139e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:14.967910 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88e99f-5e8a-4bde-838f-0a61bf4139e5 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:14.977134 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 692/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:16.664986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540355e6-fbca-4f72-815f-df8ab25f622b None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:16.665549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540355e6-fbca-4f72-815f-df8ab25f622b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:16.665549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540355e6-fbca-4f72-815f-df8ab25f622b None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:16.666946 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 703/1395] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:16.672261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97c6d7-4c04-40aa-a98c-baf245617419 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:16.672681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97c6d7-4c04-40aa-a98c-baf245617419 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:16.672799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97c6d7-4c04-40aa-a98c-baf245617419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:16.690654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-4c97c6d7-4c04-40aa-a98c-baf245617419 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:16.691841 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-4c97c6d7-4c04-40aa-a98c-baf245617419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:16.700131 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 693/1396] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:16.756915 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af58ac-5689-4bea-8c2a-76c6c623db82 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:16.757204 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af58ac-5689-4bea-8c2a-76c6c623db82 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:16.757484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af58ac-5689-4bea-8c2a-76c6c623db82 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:16.758858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 704/1397] 10.222.0.48 () {54 vars in 962 bytes} [Tue May 17 14:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:16.764590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb51c-9fd8-47ee-8f5e-d2ecddfc2f64 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:16.764878 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb51c-9fd8-47ee-8f5e-d2ecddfc2f64 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:16.765158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb51c-9fd8-47ee-8f5e-d2ecddfc2f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:16.813745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-f8efb51c-9fd8-47ee-8f5e-d2ecddfc2f64 None None] MFA Rules not processed for user `f34ff47d8c4f4d99955340ddbdc3d475`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:16.814973 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f8efb51c-9fd8-47ee-8f5e-d2ecddfc2f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:16.876929 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 694/1398] 10.222.0.48 () {58 vars in 1059 bytes} [Tue May 17 14:24:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:16.884556 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af58ac-5689-4bea-8c2a-76c6c623db82 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:16.896324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af58ac-5689-4bea-8c2a-76c6c623db82 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:16.899835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbeee1a-5a1e-4c37-a018-b0d97848097a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34ff47d8c4f4d99955340ddbdc3d475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:16.900470 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbeee1a-5a1e-4c37-a018-b0d97848097a service glance] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:16.900762 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbeee1a-5a1e-4c37-a018-b0d97848097a service glance] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:16.901029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbeee1a-5a1e-4c37-a018-b0d97848097a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:16.910584 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbeee1a-5a1e-4c37-a018-b0d97848097a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:16.912014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbeee1a-5a1e-4c37-a018-b0d97848097a service glance] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:16.922363 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 705/1399] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:17.280055 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f748e5-7764-438b-aaab-75e35dd418a6 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:17.280461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f748e5-7764-438b-aaab-75e35dd418a6 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:17.280721 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f748e5-7764-438b-aaab-75e35dd418a6 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:17.282083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 695/1400] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:17.287563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7aa77-d188-4906-abc2-35725b725864 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:17.287850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7aa77-d188-4906-abc2-35725b725864 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:17.288129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7aa77-d188-4906-abc2-35725b725864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:17.306033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-2ec7aa77-d188-4906-abc2-35725b725864 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:17.307244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2ec7aa77-d188-4906-abc2-35725b725864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:17.315804 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 706/1401] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:17.361634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f748e5-7764-438b-aaab-75e35dd418a6 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:17.367502 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2e2e6-29e5-4570-955d-040858d73832 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:17.367789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2e2e6-29e5-4570-955d-040858d73832 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:17.368065 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2e2e6-29e5-4570-955d-040858d73832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:17.376953 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f748e5-7764-438b-aaab-75e35dd418a6 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:17.383045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6d162-b44c-4a50-bd4f-618e8b22a02f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:17.383847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6d162-b44c-4a50-bd4f-618e8b22a02f service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:17.384236 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6d162-b44c-4a50-bd4f-618e8b22a02f service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:17.384525 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6d162-b44c-4a50-bd4f-618e8b22a02f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:17.393420 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6d162-b44c-4a50-bd4f-618e8b22a02f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:17.395066 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6d162-b44c-4a50-bd4f-618e8b22a02f service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:17.405054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 696/1402] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:17.416022 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-45c2e2e6-29e5-4570-955d-040858d73832 None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:17.417203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-45c2e2e6-29e5-4570-955d-040858d73832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:17.483977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 707/1403] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 14:24:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:24:17.531282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442d673-87e5-4930-9e6c-7c91c685e732 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:17.531571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442d673-87e5-4930-9e6c-7c91c685e732 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:17.531838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442d673-87e5-4930-9e6c-7c91c685e732 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:17.533305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 697/1404] 10.222.0.48 () {54 vars in 942 bytes} [Tue May 17 14:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:17.542719 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fe0c4-1824-4ba3-9ba5-35fb56142d06 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:17.543245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fe0c4-1824-4ba3-9ba5-35fb56142d06 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:17.543761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fe0c4-1824-4ba3-9ba5-35fb56142d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:17.604952 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c23fe0c4-1824-4ba3-9ba5-35fb56142d06 None None] MFA Rules not processed for user `055264c31c9e4d3dbf234a362ee82698`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:17.606196 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c23fe0c4-1824-4ba3-9ba5-35fb56142d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:17.678004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 708/1405] 10.222.0.48 () {58 vars in 1039 bytes} [Tue May 17 14:24:17 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:17.687264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442d673-87e5-4930-9e6c-7c91c685e732 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:17.700108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442d673-87e5-4930-9e6c-7c91c685e732 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:17.706106 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e525e3-d6c3-46b4-afdf-6e6a25bb4c1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:17.706841 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e525e3-d6c3-46b4-afdf-6e6a25bb4c1b service swift] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:17.707127 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e525e3-d6c3-46b4-afdf-6e6a25bb4c1b service swift] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:17.707395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e525e3-d6c3-46b4-afdf-6e6a25bb4c1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:17.719260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e525e3-d6c3-46b4-afdf-6e6a25bb4c1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:17.721162 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e525e3-d6c3-46b4-afdf-6e6a25bb4c1b service swift] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:17.730066 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 698/1406] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:24:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:24:19.743845 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd1c31-804e-4d63-b0b2-5f0f90a16041 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:19.744836 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd1c31-804e-4d63-b0b2-5f0f90a16041 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:19.745335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd1c31-804e-4d63-b0b2-5f0f90a16041 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:19.751706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 709/1407] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:24:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:19.754366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6c4a6-d792-4de0-8e8d-f6a29e619c62 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:19.754848 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6c4a6-d792-4de0-8e8d-f6a29e619c62 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:19.755789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6c4a6-d792-4de0-8e8d-f6a29e619c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:19.774153 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-16a6c4a6-d792-4de0-8e8d-f6a29e619c62 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:19.775482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-16a6c4a6-d792-4de0-8e8d-f6a29e619c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:19.784789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 699/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:19.829020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd1c31-804e-4d63-b0b2-5f0f90a16041 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:19.844573 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd1c31-804e-4d63-b0b2-5f0f90a16041 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:19.850751 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a6626-074e-442d-87b8-2233edad4c6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:19.851556 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a6626-074e-442d-87b8-2233edad4c6d service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:19.852105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a6626-074e-442d-87b8-2233edad4c6d service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:19.852554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a6626-074e-442d-87b8-2233edad4c6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:19.861925 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a6626-074e-442d-87b8-2233edad4c6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:19.863884 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a6626-074e-442d-87b8-2233edad4c6d service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:19.875337 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 710/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:41.130830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb92620-42e8-416f-97bc-4b446d6cbf8d None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:41.131544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb92620-42e8-416f-97bc-4b446d6cbf8d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:41.131544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb92620-42e8-416f-97bc-4b446d6cbf8d None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:41.132753 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 700/1410] 10.222.0.48 () {54 vars in 918 bytes} [Tue May 17 14:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:41.138840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d8b88-7509-48a0-8345-dea4c4041a07 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:41.139279 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d8b88-7509-48a0-8345-dea4c4041a07 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:41.139378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d8b88-7509-48a0-8345-dea4c4041a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:41.157221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-ad0d8b88-7509-48a0-8345-dea4c4041a07 None None] MFA Rules not processed for user `fad90f42ebfe43eb8256611a88df87ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:41.158424 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ad0d8b88-7509-48a0-8345-dea4c4041a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:41.166667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 711/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Tue May 17 14:24:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:41.180684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aba628-2645-49d9-9593-f33ab82f36e6 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:41.180969 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aba628-2645-49d9-9593-f33ab82f36e6 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:41.181247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aba628-2645-49d9-9593-f33ab82f36e6 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:41.182638 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 701/1412] 10.222.0.48 () {54 vars in 918 bytes} [Tue May 17 14:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:41.187116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d789b-4788-48d6-b818-77afc9e1f865 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:41.187403 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d789b-4788-48d6-b818-77afc9e1f865 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:41.187673 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d789b-4788-48d6-b818-77afc9e1f865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:41.205999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-232d789b-4788-48d6-b818-77afc9e1f865 None None] MFA Rules not processed for user `1f443d2ca1534249bb2c4096300ddffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:41.207210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-232d789b-4788-48d6-b818-77afc9e1f865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:41.217516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 712/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Tue May 17 14:24:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:43.883449 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2bfc8-cdb8-4250-b623-e7e5417d4b99 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:43.884031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2bfc8-cdb8-4250-b623-e7e5417d4b99 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:43.884031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2bfc8-cdb8-4250-b623-e7e5417d4b99 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:43.885360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 14:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:43.890858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f0e11-9757-4e7f-9276-4aa2d7359c4c None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:43.891293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f0e11-9757-4e7f-9276-4aa2d7359c4c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:43.891410 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f0e11-9757-4e7f-9276-4aa2d7359c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:43.909178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c53f0e11-9757-4e7f-9276-4aa2d7359c4c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:43.910404 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c53f0e11-9757-4e7f-9276-4aa2d7359c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:43.918048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 14:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:43.959776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2bfc8-cdb8-4250-b623-e7e5417d4b99 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:43.974275 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2bfc8-cdb8-4250-b623-e7e5417d4b99 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:43.979567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120fa70-273d-4519-be78-70446ef00c19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:43.980199 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120fa70-273d-4519-be78-70446ef00c19 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:43.980485 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120fa70-273d-4519-be78-70446ef00c19 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:43.980760 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120fa70-273d-4519-be78-70446ef00c19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:43.988763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120fa70-273d-4519-be78-70446ef00c19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:43.990422 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120fa70-273d-4519-be78-70446ef00c19 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:43.999842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 703/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:44.991667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e23d7f-1c16-4010-9d04-8775cf913b61 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:44.992287 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e23d7f-1c16-4010-9d04-8775cf913b61 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:44.992287 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e23d7f-1c16-4010-9d04-8775cf913b61 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:44.993568 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 14:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:44.999233 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ca588-1d81-4888-af55-5c14f73076ed None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:44.999644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ca588-1d81-4888-af55-5c14f73076ed None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:44.999787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ca588-1d81-4888-af55-5c14f73076ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:45.017347 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-981ca588-1d81-4888-af55-5c14f73076ed None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:45.018564 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-981ca588-1d81-4888-af55-5c14f73076ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:45.026141 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 14:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:45.216828 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e23d7f-1c16-4010-9d04-8775cf913b61 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:45.231921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e23d7f-1c16-4010-9d04-8775cf913b61 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:45.237530 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821a175-1a09-4851-8305-97af6bbacb99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:45.238161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821a175-1a09-4851-8305-97af6bbacb99 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:45.238470 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821a175-1a09-4851-8305-97af6bbacb99 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:45.238746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821a175-1a09-4851-8305-97af6bbacb99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:45.246760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821a175-1a09-4851-8305-97af6bbacb99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:45.248375 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821a175-1a09-4851-8305-97af6bbacb99 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:45.257921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 715/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:46.233994 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cfadd-b0c2-436f-b181-6a605eed144e None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:46.234488 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cfadd-b0c2-436f-b181-6a605eed144e None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:46.234625 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cfadd-b0c2-436f-b181-6a605eed144e None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:46.235945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 14:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:46.240876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c4cf7-811d-4400-988f-bbefcc1ed78e None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:46.241265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c4cf7-811d-4400-988f-bbefcc1ed78e None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:46.241468 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c4cf7-811d-4400-988f-bbefcc1ed78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:46.260615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-585c4cf7-811d-4400-988f-bbefcc1ed78e None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:46.261816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-585c4cf7-811d-4400-988f-bbefcc1ed78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:46.270196 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 14:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:46.426103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cfadd-b0c2-436f-b181-6a605eed144e None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:46.439921 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cfadd-b0c2-436f-b181-6a605eed144e None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:46.445489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198ce1e-af1e-4f44-a5e6-cea863da1b6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:46.446137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198ce1e-af1e-4f44-a5e6-cea863da1b6d service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:46.446461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198ce1e-af1e-4f44-a5e6-cea863da1b6d service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:46.446741 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198ce1e-af1e-4f44-a5e6-cea863da1b6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:46.455815 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198ce1e-af1e-4f44-a5e6-cea863da1b6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:46.457351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198ce1e-af1e-4f44-a5e6-cea863da1b6d service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:46.467348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 706/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:47.414190 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873749e6-5f2e-4995-b790-2b814e1ff41f None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:47.414775 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873749e6-5f2e-4995-b790-2b814e1ff41f None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:47.414775 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873749e6-5f2e-4995-b790-2b814e1ff41f None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:47.416138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 14:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:47.421918 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6962a2-31f6-4eff-9d75-e25522c2c016 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:47.422373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6962a2-31f6-4eff-9d75-e25522c2c016 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:47.422556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6962a2-31f6-4eff-9d75-e25522c2c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:47.441033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-fb6962a2-31f6-4eff-9d75-e25522c2c016 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:47.442287 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-fb6962a2-31f6-4eff-9d75-e25522c2c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:47.450058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 14:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:47.601126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873749e6-5f2e-4995-b790-2b814e1ff41f None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:47.615880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873749e6-5f2e-4995-b790-2b814e1ff41f None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:47.621175 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d4133-8aa7-4afa-906f-6213aa59c14e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:47.621804 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d4133-8aa7-4afa-906f-6213aa59c14e service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:47.622088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d4133-8aa7-4afa-906f-6213aa59c14e service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:47.622394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d4133-8aa7-4afa-906f-6213aa59c14e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:47.630342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d4133-8aa7-4afa-906f-6213aa59c14e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:47.631914 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d4133-8aa7-4afa-906f-6213aa59c14e service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:47.641102 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 718/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:48.578076 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05edc0-c159-4e8b-b983-dce247a2a21c None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:48.578618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05edc0-c159-4e8b-b983-dce247a2a21c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:48.578618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05edc0-c159-4e8b-b983-dce247a2a21c None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:48.580003 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 14:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:48.585012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78322c5d-9a9f-4fa6-86bf-da82ce037250 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:48.585415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78322c5d-9a9f-4fa6-86bf-da82ce037250 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:48.585564 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78322c5d-9a9f-4fa6-86bf-da82ce037250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:48.603632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-78322c5d-9a9f-4fa6-86bf-da82ce037250 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:48.604824 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-78322c5d-9a9f-4fa6-86bf-da82ce037250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:48.613363 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 14:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:48.763734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05edc0-c159-4e8b-b983-dce247a2a21c None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:48.785702 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05edc0-c159-4e8b-b983-dce247a2a21c None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:48.792293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6f1f5-2ff4-4fc9-b9b9-4004ef6c3cd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:48.792293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6f1f5-2ff4-4fc9-b9b9-4004ef6c3cd3 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:48.792293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6f1f5-2ff4-4fc9-b9b9-4004ef6c3cd3 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:48.792648 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6f1f5-2ff4-4fc9-b9b9-4004ef6c3cd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:48.801553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6f1f5-2ff4-4fc9-b9b9-4004ef6c3cd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:48.803255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6f1f5-2ff4-4fc9-b9b9-4004ef6c3cd3 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:48.813185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 709/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:49.690323 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd44d8e-1658-47d0-91b5-306492ad0602 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:49.690907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd44d8e-1658-47d0-91b5-306492ad0602 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:49.690907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd44d8e-1658-47d0-91b5-306492ad0602 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:49.692249 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 14:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:49.697245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f61bc-e937-4c28-aae5-37bf606d1b31 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:49.697677 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f61bc-e937-4c28-aae5-37bf606d1b31 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:49.697809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f61bc-e937-4c28-aae5-37bf606d1b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:49.716516 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-044f61bc-e937-4c28-aae5-37bf606d1b31 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:49.717706 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-044f61bc-e937-4c28-aae5-37bf606d1b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:49.725346 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 14:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:49.876818 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd44d8e-1658-47d0-91b5-306492ad0602 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:49.891675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd44d8e-1658-47d0-91b5-306492ad0602 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:49.897008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28758e-f210-4ca7-b2fd-a56eb62f6f74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:49.897636 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28758e-f210-4ca7-b2fd-a56eb62f6f74 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:49.897919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28758e-f210-4ca7-b2fd-a56eb62f6f74 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:49.898221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28758e-f210-4ca7-b2fd-a56eb62f6f74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:49.906205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28758e-f210-4ca7-b2fd-a56eb62f6f74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:49.907793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28758e-f210-4ca7-b2fd-a56eb62f6f74 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:49.917002 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 721/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:50.790951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fbc61-8b91-4112-91b7-4c27cafd6528 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:50.791490 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fbc61-8b91-4112-91b7-4c27cafd6528 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:50.791624 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fbc61-8b91-4112-91b7-4c27cafd6528 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:50.792897 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 14:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:50.798114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76057b-c3fd-41b4-8d89-968b6454a7cf None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:50.798545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76057b-c3fd-41b4-8d89-968b6454a7cf None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:50.798687 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76057b-c3fd-41b4-8d89-968b6454a7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:50.816240 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-cd76057b-c3fd-41b4-8d89-968b6454a7cf None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:50.817478 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-cd76057b-c3fd-41b4-8d89-968b6454a7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:50.826035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 14:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:50.974930 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fbc61-8b91-4112-91b7-4c27cafd6528 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:50.989562 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fbc61-8b91-4112-91b7-4c27cafd6528 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:50.994919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceeaffa-abad-49b1-9c15-98d66d8e97b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:50.995550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceeaffa-abad-49b1-9c15-98d66d8e97b9 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:50.995833 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceeaffa-abad-49b1-9c15-98d66d8e97b9 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:50.996109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceeaffa-abad-49b1-9c15-98d66d8e97b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:51.004548 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceeaffa-abad-49b1-9c15-98d66d8e97b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:51.006126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceeaffa-abad-49b1-9c15-98d66d8e97b9 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:51.015415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 712/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:51.888025 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c12f76-13ae-416f-a163-a24db4985711 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:51.888760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c12f76-13ae-416f-a163-a24db4985711 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:51.888760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c12f76-13ae-416f-a163-a24db4985711 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:51.889902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 14:24:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:51.894932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1648-2db5-4229-a6c8-79963d4970ae None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:51.895341 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1648-2db5-4229-a6c8-79963d4970ae None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:51.895497 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1648-2db5-4229-a6c8-79963d4970ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:51.913348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-049b1648-2db5-4229-a6c8-79963d4970ae None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:51.914566 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-049b1648-2db5-4229-a6c8-79963d4970ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:51.922502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 14:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:52.072972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c12f76-13ae-416f-a163-a24db4985711 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:52.087504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c12f76-13ae-416f-a163-a24db4985711 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:52.093659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c46322-cb92-4790-beeb-48670e300d30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:52.094313 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c46322-cb92-4790-beeb-48670e300d30 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:52.094598 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c46322-cb92-4790-beeb-48670e300d30 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:52.094874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c46322-cb92-4790-beeb-48670e300d30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:52.104334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c46322-cb92-4790-beeb-48670e300d30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:52.106891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c46322-cb92-4790-beeb-48670e300d30 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:52.118231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 724/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:53.000581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a44f3-e826-498f-90f1-30a024ddbce2 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:53.001161 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a44f3-e826-498f-90f1-30a024ddbce2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:53.001161 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a44f3-e826-498f-90f1-30a024ddbce2 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:53.002620 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 14:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:53.007623 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a376bd-93e1-41f4-831f-a613b99a032e None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:53.008006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a376bd-93e1-41f4-831f-a613b99a032e None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:53.008185 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a376bd-93e1-41f4-831f-a613b99a032e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:53.026188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-b3a376bd-93e1-41f4-831f-a613b99a032e None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:53.027422 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b3a376bd-93e1-41f4-831f-a613b99a032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:53.035343 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 14:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:53.186558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a44f3-e826-498f-90f1-30a024ddbce2 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:53.200858 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a44f3-e826-498f-90f1-30a024ddbce2 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:53.206447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ae29b-91bf-4ecf-bf58-407c01a72bbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:53.207081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ae29b-91bf-4ecf-bf58-407c01a72bbe service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:53.207365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ae29b-91bf-4ecf-bf58-407c01a72bbe service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:53.207641 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ae29b-91bf-4ecf-bf58-407c01a72bbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:53.215733 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ae29b-91bf-4ecf-bf58-407c01a72bbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:53.217503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ae29b-91bf-4ecf-bf58-407c01a72bbe service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:53.226723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 715/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:55.330771 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dca9af-b821-4672-94c5-bec968f1dad4 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:55.331331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dca9af-b821-4672-94c5-bec968f1dad4 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:55.331331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dca9af-b821-4672-94c5-bec968f1dad4 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:55.332685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 14:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:55.337933 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521d00b-f447-43f4-b49c-ce8df95af3a1 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:55.338414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521d00b-f447-43f4-b49c-ce8df95af3a1 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:55.338604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521d00b-f447-43f4-b49c-ce8df95af3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:55.357473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-5521d00b-f447-43f4-b49c-ce8df95af3a1 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:55.358729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5521d00b-f447-43f4-b49c-ce8df95af3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:55.366529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 14:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:55.406527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dca9af-b821-4672-94c5-bec968f1dad4 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:55.417781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dca9af-b821-4672-94c5-bec968f1dad4 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:55.422167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee250fac-7cfa-4711-ad11-51f0850f7000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:55.422823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250fac-7cfa-4711-ad11-51f0850f7000 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:55.423105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250fac-7cfa-4711-ad11-51f0850f7000 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:55.423382 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250fac-7cfa-4711-ad11-51f0850f7000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:55.432112 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee250fac-7cfa-4711-ad11-51f0850f7000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:55.433535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee250fac-7cfa-4711-ad11-51f0850f7000 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:55.443418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 727/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:24:57.795915 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492028e-fede-473c-8f3a-ac00df361888 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:57.796424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492028e-fede-473c-8f3a-ac00df361888 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:57.796424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492028e-fede-473c-8f3a-ac00df361888 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:57.797752 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 14:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:24:57.803124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f69c4a-8a65-4980-8517-8ee390faa05b None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:57.803547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f69c4a-8a65-4980-8517-8ee390faa05b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:57.803672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f69c4a-8a65-4980-8517-8ee390faa05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:57.821748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-f8f69c4a-8a65-4980-8517-8ee390faa05b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:24:57.822952 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f8f69c4a-8a65-4980-8517-8ee390faa05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:57.830935 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 14:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:24:57.869106 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492028e-fede-473c-8f3a-ac00df361888 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:24:57.870809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1492028e-fede-473c-8f3a-ac00df361888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:24:57.883853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492028e-fede-473c-8f3a-ac00df361888 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:24:57.888058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e30df-8e93-4dd0-95b2-e8d1a085aee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:24:57.888696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e30df-8e93-4dd0-95b2-e8d1a085aee7 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:24:57.888980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e30df-8e93-4dd0-95b2-e8d1a085aee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:24:57.889258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e30df-8e93-4dd0-95b2-e8d1a085aee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:24:57.897822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e30df-8e93-4dd0-95b2-e8d1a085aee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:24:57.899280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e30df-8e93-4dd0-95b2-e8d1a085aee7 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:24:57.908356 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 718/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:25:00.476433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff15723-5a96-400b-bf6b-c1b0584ee05e None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:00.476973 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff15723-5a96-400b-bf6b-c1b0584ee05e None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:00.476973 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff15723-5a96-400b-bf6b-c1b0584ee05e None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:00.478324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 14:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:25:00.484346 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe080d-7b85-462c-ab6e-29c9537d2c77 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:00.484779 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe080d-7b85-462c-ab6e-29c9537d2c77 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:00.484912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe080d-7b85-462c-ab6e-29c9537d2c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:00.503014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-0bfe080d-7b85-462c-ab6e-29c9537d2c77 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:25:00.504201 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0bfe080d-7b85-462c-ab6e-29c9537d2c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:25:00.511922 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 14:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:25:00.550867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff15723-5a96-400b-bf6b-c1b0584ee05e None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:25:00.562218 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff15723-5a96-400b-bf6b-c1b0584ee05e None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:25:00.565758 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f015ce-22b2-4bd3-acd1-ee7f682fbf36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:25:00.566424 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f015ce-22b2-4bd3-acd1-ee7f682fbf36 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:00.566709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f015ce-22b2-4bd3-acd1-ee7f682fbf36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:00.566987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f015ce-22b2-4bd3-acd1-ee7f682fbf36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:00.575760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f015ce-22b2-4bd3-acd1-ee7f682fbf36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:25:00.577202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f015ce-22b2-4bd3-acd1-ee7f682fbf36 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:25:00.586666 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 730/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:25:02.940082 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36128d4-6cb6-4a1c-ad18-44c4fae60096 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:02.940695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36128d4-6cb6-4a1c-ad18-44c4fae60096 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:02.940695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36128d4-6cb6-4a1c-ad18-44c4fae60096 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:02.942013 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 14:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:25:02.947290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903423ed-030c-4279-97ea-2117c080006e None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:02.947748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903423ed-030c-4279-97ea-2117c080006e None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:02.947852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903423ed-030c-4279-97ea-2117c080006e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:02.966872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-903423ed-030c-4279-97ea-2117c080006e None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:25:02.968076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-903423ed-030c-4279-97ea-2117c080006e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:25:02.975738 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 14:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:25:03.013001 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36128d4-6cb6-4a1c-ad18-44c4fae60096 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:25:03.023453 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36128d4-6cb6-4a1c-ad18-44c4fae60096 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:25:03.026961 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367f6c9-a224-46df-a2c1-2c00cbb1351b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:25:03.028183 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f6c9-a224-46df-a2c1-2c00cbb1351b service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:03.028467 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f6c9-a224-46df-a2c1-2c00cbb1351b service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:03.028750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f6c9-a224-46df-a2c1-2c00cbb1351b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:03.037403 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367f6c9-a224-46df-a2c1-2c00cbb1351b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:25:03.038881 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367f6c9-a224-46df-a2c1-2c00cbb1351b service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:25:03.047999 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 721/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:25:05.323513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ac04e-ead3-4ad9-9640-a722def7ca79 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:05.324084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ac04e-ead3-4ad9-9640-a722def7ca79 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:05.324199 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ac04e-ead3-4ad9-9640-a722def7ca79 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:05.325578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 14:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:25:05.331060 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e71e4e-c98a-4188-b93d-b7b57bfdf057 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:05.331475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e71e4e-c98a-4188-b93d-b7b57bfdf057 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:05.331615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e71e4e-c98a-4188-b93d-b7b57bfdf057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:05.349906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-66e71e4e-c98a-4188-b93d-b7b57bfdf057 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:25:05.351108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-66e71e4e-c98a-4188-b93d-b7b57bfdf057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:25:05.359531 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 14:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:25:05.396402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ac04e-ead3-4ad9-9640-a722def7ca79 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:25:05.408368 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ac04e-ead3-4ad9-9640-a722def7ca79 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:25:05.411935 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac950dd-f41a-4721-bfb2-c307ae3afce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:25:05.412568 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac950dd-f41a-4721-bfb2-c307ae3afce9 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:05.412857 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac950dd-f41a-4721-bfb2-c307ae3afce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:05.413133 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac950dd-f41a-4721-bfb2-c307ae3afce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:05.422759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac950dd-f41a-4721-bfb2-c307ae3afce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:25:05.424198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac950dd-f41a-4721-bfb2-c307ae3afce9 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:25:05.433391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 733/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:25:07.784454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed386978-d34b-4da3-83ed-3eae0b303fe4 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:07.785027 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed386978-d34b-4da3-83ed-3eae0b303fe4 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:07.785027 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed386978-d34b-4da3-83ed-3eae0b303fe4 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:07.786401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 14:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:25:07.791669 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c1f35-849f-47e6-b3d9-2fca06df68ab None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:07.792097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c1f35-849f-47e6-b3d9-2fca06df68ab None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:07.792228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c1f35-849f-47e6-b3d9-2fca06df68ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:07.810692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-100c1f35-849f-47e6-b3d9-2fca06df68ab None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:25:07.811887 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-100c1f35-849f-47e6-b3d9-2fca06df68ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:25:07.820028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 14:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:25:07.857247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed386978-d34b-4da3-83ed-3eae0b303fe4 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:25:07.867692 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed386978-d34b-4da3-83ed-3eae0b303fe4 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:25:07.871670 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602afd64-3200-418c-ac03-e8c3ff8d8e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:25:07.872546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602afd64-3200-418c-ac03-e8c3ff8d8e20 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:07.872827 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602afd64-3200-418c-ac03-e8c3ff8d8e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:07.873100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602afd64-3200-418c-ac03-e8c3ff8d8e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:07.881723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602afd64-3200-418c-ac03-e8c3ff8d8e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:25:07.883173 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602afd64-3200-418c-ac03-e8c3ff8d8e20 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:25:07.892849 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 724/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:25:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:25:10.177424 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb264f0-dbfa-4175-ae59-b9ebc585979d None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:10.178012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb264f0-dbfa-4175-ae59-b9ebc585979d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:10.178012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb264f0-dbfa-4175-ae59-b9ebc585979d None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:10.179365 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 14:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:25:10.185156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863ffe-70f6-4de5-9713-bfcb7a41c5e7 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:10.185592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863ffe-70f6-4de5-9713-bfcb7a41c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:10.185702 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863ffe-70f6-4de5-9713-bfcb7a41c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:10.204275 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-1b863ffe-70f6-4de5-9713-bfcb7a41c5e7 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:25:10.205450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1b863ffe-70f6-4de5-9713-bfcb7a41c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:25:10.213111 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 14:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:25:10.251180 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb264f0-dbfa-4175-ae59-b9ebc585979d None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:25:10.261680 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb264f0-dbfa-4175-ae59-b9ebc585979d None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:25:10.265365 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f91121-b7b4-4730-b8fe-f4a646feec1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:25:10.265988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f91121-b7b4-4730-b8fe-f4a646feec1f service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:10.266305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f91121-b7b4-4730-b8fe-f4a646feec1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:10.266577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f91121-b7b4-4730-b8fe-f4a646feec1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:10.275213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f91121-b7b4-4730-b8fe-f4a646feec1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:25:10.276632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f91121-b7b4-4730-b8fe-f4a646feec1f service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:25:10.285665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 736/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:25:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:25:12.628251 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66658458-bffe-48df-b4b0-2822b46815de None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:12.628805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66658458-bffe-48df-b4b0-2822b46815de None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:12.628805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66658458-bffe-48df-b4b0-2822b46815de None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:12.630197 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 14:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:25:12.635630 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bc90e-256f-4698-8d45-b5a6ca21c715 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:12.636059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bc90e-256f-4698-8d45-b5a6ca21c715 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:12.636167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bc90e-256f-4698-8d45-b5a6ca21c715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:12.655761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-236bc90e-256f-4698-8d45-b5a6ca21c715 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:25:12.656954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-236bc90e-256f-4698-8d45-b5a6ca21c715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:25:12.664782 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 14:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:25:12.702205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66658458-bffe-48df-b4b0-2822b46815de None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:25:12.712990 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66658458-bffe-48df-b4b0-2822b46815de None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:25:12.716858 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7155e2c-dd8d-461b-95f9-73d6b1a12a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:25:12.717490 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7155e2c-dd8d-461b-95f9-73d6b1a12a45 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:12.717772 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7155e2c-dd8d-461b-95f9-73d6b1a12a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:12.718049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7155e2c-dd8d-461b-95f9-73d6b1a12a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:12.726802 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7155e2c-dd8d-461b-95f9-73d6b1a12a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:25:12.728222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7155e2c-dd8d-461b-95f9-73d6b1a12a45 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:25:12.738100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 727/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:25:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:25:14.993224 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d41dfa-e1f2-4ba0-82f2-8411d9dbdf9c None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:14.993851 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d41dfa-e1f2-4ba0-82f2-8411d9dbdf9c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:14.993851 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d41dfa-e1f2-4ba0-82f2-8411d9dbdf9c None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:14.995118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 14:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:25:15.000392 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e080e45-e9c2-4583-84e2-93ed4cd1fd5b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:15.000810 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e080e45-e9c2-4583-84e2-93ed4cd1fd5b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:15.000957 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e080e45-e9c2-4583-84e2-93ed4cd1fd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:15.018783 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-0e080e45-e9c2-4583-84e2-93ed4cd1fd5b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:25:15.019975 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0e080e45-e9c2-4583-84e2-93ed4cd1fd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:25:15.028405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 14:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:25:15.064867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d41dfa-e1f2-4ba0-82f2-8411d9dbdf9c None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:25:15.076232 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d41dfa-e1f2-4ba0-82f2-8411d9dbdf9c None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:25:15.080031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca38e06-b441-4a16-a4cf-54c612cba217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:25:15.080659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca38e06-b441-4a16-a4cf-54c612cba217 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:15.080939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca38e06-b441-4a16-a4cf-54c612cba217 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:15.081210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca38e06-b441-4a16-a4cf-54c612cba217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:15.089977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca38e06-b441-4a16-a4cf-54c612cba217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:25:15.091422 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca38e06-b441-4a16-a4cf-54c612cba217 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:25:15.100519 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 739/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:25:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:25:17.334778 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b23c29-dceb-4f7a-bbc3-90796ed57f4c None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:17.335350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b23c29-dceb-4f7a-bbc3-90796ed57f4c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:17.335350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b23c29-dceb-4f7a-bbc3-90796ed57f4c None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:17.336751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 14:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:25:17.343300 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231a63-a274-4846-b02a-baec27b0c49d None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:17.343858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231a63-a274-4846-b02a-baec27b0c49d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:17.343858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231a63-a274-4846-b02a-baec27b0c49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:17.362604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-2c231a63-a274-4846-b02a-baec27b0c49d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:25:17.363834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2c231a63-a274-4846-b02a-baec27b0c49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:25:17.375797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 14:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:25:17.412642 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b23c29-dceb-4f7a-bbc3-90796ed57f4c None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:25:17.423745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b23c29-dceb-4f7a-bbc3-90796ed57f4c None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:25:17.427153 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f381a50-e129-467b-a6d5-65244776d0ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:25:17.427774 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f381a50-e129-467b-a6d5-65244776d0ac service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:17.428051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f381a50-e129-467b-a6d5-65244776d0ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:17.428329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f381a50-e129-467b-a6d5-65244776d0ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:17.437086 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f381a50-e129-467b-a6d5-65244776d0ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:25:17.438639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f381a50-e129-467b-a6d5-65244776d0ac service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:25:17.447747 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 730/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:25:51.082571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d927-46d3-42ac-aef1-3fbe9777b3a8 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:51.083187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d927-46d3-42ac-aef1-3fbe9777b3a8 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:51.083187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d927-46d3-42ac-aef1-3fbe9777b3a8 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:51.084495 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 741/1471] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:25:51.090210 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebf703-32f5-4419-8674-a1488dad14c5 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:51.090626 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebf703-32f5-4419-8674-a1488dad14c5 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:51.090759 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebf703-32f5-4419-8674-a1488dad14c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:51.108316 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-edebf703-32f5-4419-8674-a1488dad14c5 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:25:51.109482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-edebf703-32f5-4419-8674-a1488dad14c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:25:51.116964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 731/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:25:51.162982 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584514e-c451-4553-9b1f-b1d7f584d89d None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:51.163271 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584514e-c451-4553-9b1f-b1d7f584d89d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:51.163551 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584514e-c451-4553-9b1f-b1d7f584d89d None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:51.164887 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 742/1473] 10.222.0.48 () {54 vars in 962 bytes} [Tue May 17 14:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:25:51.170408 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9bb57-73c8-4143-aef6-b98bb907430e None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:51.170695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9bb57-73c8-4143-aef6-b98bb907430e None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:51.170972 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9bb57-73c8-4143-aef6-b98bb907430e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:51.188684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-27a9bb57-73c8-4143-aef6-b98bb907430e None None] MFA Rules not processed for user `f34ff47d8c4f4d99955340ddbdc3d475`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:25:51.189846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-27a9bb57-73c8-4143-aef6-b98bb907430e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:25:51.196256 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 732/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Tue May 17 14:25:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:25:51.203720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584514e-c451-4553-9b1f-b1d7f584d89d None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:25:51.215146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584514e-c451-4553-9b1f-b1d7f584d89d None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:25:51.218693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea6f40-76a7-4e45-af7c-3c3c3cb6a754 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34ff47d8c4f4d99955340ddbdc3d475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:25:51.219318 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea6f40-76a7-4e45-af7c-3c3c3cb6a754 service glance] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:51.219598 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea6f40-76a7-4e45-af7c-3c3c3cb6a754 service glance] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:51.219870 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea6f40-76a7-4e45-af7c-3c3c3cb6a754 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:51.228513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea6f40-76a7-4e45-af7c-3c3c3cb6a754 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:25:51.231088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea6f40-76a7-4e45-af7c-3c3c3cb6a754 service glance] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:25:51.240305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 743/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:25:53.540989 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c27256-d18a-4c34-8efa-3bd10d58c31d None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:53.541544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c27256-d18a-4c34-8efa-3bd10d58c31d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:53.541544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c27256-d18a-4c34-8efa-3bd10d58c31d None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:53.543023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 733/1476] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:25:53.548249 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975d1ca-277e-4cbc-86fe-dfdaeb30829a None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:53.548656 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975d1ca-277e-4cbc-86fe-dfdaeb30829a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:53.548798 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975d1ca-277e-4cbc-86fe-dfdaeb30829a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:53.566925 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-f975d1ca-277e-4cbc-86fe-dfdaeb30829a None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:25:53.568151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f975d1ca-277e-4cbc-86fe-dfdaeb30829a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:25:53.576608 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 744/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:25:53.599587 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c27256-d18a-4c34-8efa-3bd10d58c31d None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:25:53.611694 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c27256-d18a-4c34-8efa-3bd10d58c31d None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:25:53.616071 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b85eda-054f-4fe2-9aec-41fe0202df18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:25:53.616714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b85eda-054f-4fe2-9aec-41fe0202df18 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:53.617000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b85eda-054f-4fe2-9aec-41fe0202df18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:53.617278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b85eda-054f-4fe2-9aec-41fe0202df18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:53.618016 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b85eda-054f-4fe2-9aec-41fe0202df18 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:25:53.619798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: WARNING py.warnings [None req-e9b85eda-054f-4fe2-9aec-41fe0202df18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 14:25:53.619798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: warnings.warn(msg) May 17 14:25:53.619798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: May 17 14:25:53.621636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b85eda-054f-4fe2-9aec-41fe0202df18 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:25:53.642009 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 734/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 17 14:25:53 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:25:55.886398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbff98-43ea-47c6-aa7f-2ecd4a10bbce None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:55.886963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbff98-43ea-47c6-aa7f-2ecd4a10bbce None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:55.886963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbff98-43ea-47c6-aa7f-2ecd4a10bbce None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:55.888295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 745/1479] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:25:55.893480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fce117-a307-42b0-ab10-402a0279f574 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:55.893915 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fce117-a307-42b0-ab10-402a0279f574 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:55.894051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fce117-a307-42b0-ab10-402a0279f574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:55.911504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-62fce117-a307-42b0-ab10-402a0279f574 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:25:55.912710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-62fce117-a307-42b0-ab10-402a0279f574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:25:55.920497 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 735/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:25:55.962676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbff98-43ea-47c6-aa7f-2ecd4a10bbce None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:25:55.977025 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbff98-43ea-47c6-aa7f-2ecd4a10bbce None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:25:55.983151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2548e-9ad8-489d-9fa9-c1667fc8144b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:25:55.983775 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2548e-9ad8-489d-9fa9-c1667fc8144b service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:55.984056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2548e-9ad8-489d-9fa9-c1667fc8144b service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:55.984333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2548e-9ad8-489d-9fa9-c1667fc8144b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:55.992187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2548e-9ad8-489d-9fa9-c1667fc8144b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:25:55.993764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2548e-9ad8-489d-9fa9-c1667fc8144b service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:25:56.003510 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 746/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:25:58.402476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3035f-3cf7-4701-b9bc-1bca41f48a1b None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:58.403000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3035f-3cf7-4701-b9bc-1bca41f48a1b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:58.403112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3035f-3cf7-4701-b9bc-1bca41f48a1b None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:58.404449 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 736/1482] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:25:58.409703 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da472686-2ed3-4d2b-bf88-91a8712fbd79 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:58.410135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da472686-2ed3-4d2b-bf88-91a8712fbd79 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:58.410308 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da472686-2ed3-4d2b-bf88-91a8712fbd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:58.428056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-da472686-2ed3-4d2b-bf88-91a8712fbd79 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:25:58.429226 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-da472686-2ed3-4d2b-bf88-91a8712fbd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:25:58.437642 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 747/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:25:58.474567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3035f-3cf7-4701-b9bc-1bca41f48a1b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:25:58.485105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3035f-3cf7-4701-b9bc-1bca41f48a1b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:25:58.488649 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ac4ba-c0cd-4895-b854-495f20048cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:25:58.489280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ac4ba-c0cd-4895-b854-495f20048cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:25:58.489585 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ac4ba-c0cd-4895-b854-495f20048cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:25:58.489843 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ac4ba-c0cd-4895-b854-495f20048cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:25:58.498936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ac4ba-c0cd-4895-b854-495f20048cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:25:58.500368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ac4ba-c0cd-4895-b854-495f20048cd4 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:25:58.509639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 737/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:26:00.770941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d706b-975f-4a0f-af55-c02978d17d9c None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:26:00.771552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d706b-975f-4a0f-af55-c02978d17d9c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:26:00.771552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d706b-975f-4a0f-af55-c02978d17d9c None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:26:00.772872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 748/1485] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:26:00.778860 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89961ee4-110d-4f66-9027-079b4133b425 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:26:00.779278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89961ee4-110d-4f66-9027-079b4133b425 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:26:00.779461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89961ee4-110d-4f66-9027-079b4133b425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:26:00.796811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-89961ee4-110d-4f66-9027-079b4133b425 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:26:00.797999 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-89961ee4-110d-4f66-9027-079b4133b425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:26:00.805813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 738/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:26:00.849447 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d706b-975f-4a0f-af55-c02978d17d9c None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:26:00.860165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d706b-975f-4a0f-af55-c02978d17d9c None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:26:00.863705 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac2b73-4ce5-4c7b-944e-310b20eb4795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:26:00.864341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2b73-4ce5-4c7b-944e-310b20eb4795 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:26:00.864625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2b73-4ce5-4c7b-944e-310b20eb4795 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:26:00.864903 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2b73-4ce5-4c7b-944e-310b20eb4795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:26:00.874486 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac2b73-4ce5-4c7b-944e-310b20eb4795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:26:00.875907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac2b73-4ce5-4c7b-944e-310b20eb4795 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:26:00.885394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 749/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:26:03.269136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652e3fd-61ec-4a26-b2f0-1ae0fb1440c2 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:26:03.269710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652e3fd-61ec-4a26-b2f0-1ae0fb1440c2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:26:03.269710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652e3fd-61ec-4a26-b2f0-1ae0fb1440c2 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:26:03.271163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 739/1488] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:26:03.276981 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6d9d7-1ae1-4f12-bd50-8e6d40f24305 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:26:03.277425 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6d9d7-1ae1-4f12-bd50-8e6d40f24305 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:26:03.277567 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6d9d7-1ae1-4f12-bd50-8e6d40f24305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:26:03.295306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-d1d6d9d7-1ae1-4f12-bd50-8e6d40f24305 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:26:03.296494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-d1d6d9d7-1ae1-4f12-bd50-8e6d40f24305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:26:03.304151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 750/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:26:03.351056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652e3fd-61ec-4a26-b2f0-1ae0fb1440c2 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:26:03.362333 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652e3fd-61ec-4a26-b2f0-1ae0fb1440c2 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:26:03.365786 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98045370-ecff-49cf-a15a-97beff033c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:26:03.366447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98045370-ecff-49cf-a15a-97beff033c68 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:26:03.366735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98045370-ecff-49cf-a15a-97beff033c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:26:03.367006 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98045370-ecff-49cf-a15a-97beff033c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:26:03.376325 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98045370-ecff-49cf-a15a-97beff033c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:26:03.377754 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98045370-ecff-49cf-a15a-97beff033c68 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:26:03.388303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 740/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:26:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:26:05.794950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca83fd-14f9-4ec0-b93f-03e1b8976cf7 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:26:05.795522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca83fd-14f9-4ec0-b93f-03e1b8976cf7 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:26:05.795522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca83fd-14f9-4ec0-b93f-03e1b8976cf7 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:26:05.796845 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 751/1491] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 17 14:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:26:05.802147 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91a1b4-fbe7-4885-b554-a86266f3da2c None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:26:05.802601 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91a1b4-fbe7-4885-b554-a86266f3da2c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:26:05.802748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91a1b4-fbe7-4885-b554-a86266f3da2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:26:05.820820 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-5f91a1b4-fbe7-4885-b554-a86266f3da2c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:26:05.822000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5f91a1b4-fbe7-4885-b554-a86266f3da2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:26:05.830165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 741/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 17 14:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:26:05.868818 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca83fd-14f9-4ec0-b93f-03e1b8976cf7 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:26:05.880134 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca83fd-14f9-4ec0-b93f-03e1b8976cf7 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:26:05.883623 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53ccbd-d165-4837-ae03-0d65cd58b57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:26:05.884250 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ccbd-d165-4837-ae03-0d65cd58b57b service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:26:05.884530 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ccbd-d165-4837-ae03-0d65cd58b57b service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:26:05.884803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ccbd-d165-4837-ae03-0d65cd58b57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:26:05.894026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53ccbd-d165-4837-ae03-0d65cd58b57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:26:05.895496 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53ccbd-d165-4837-ae03-0d65cd58b57b service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:26:05.905252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 752/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:27:39.640024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0878cb-f4d5-4b40-93eb-ddb743bd2d0f None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:39.640637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0878cb-f4d5-4b40-93eb-ddb743bd2d0f None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:39.640637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0878cb-f4d5-4b40-93eb-ddb743bd2d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:39.658081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-db0878cb-f4d5-4b40-93eb-ddb743bd2d0f None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:27:39.659286 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-db0878cb-f4d5-4b40-93eb-ddb743bd2d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:27:39.667494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 742/1494] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:27:39.676788 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61701c86-d604-4c34-b87d-c59d5f174228 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:39.677277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61701c86-d604-4c34-b87d-c59d5f174228 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:39.677380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61701c86-d604-4c34-b87d-c59d5f174228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:39.696191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-61701c86-d604-4c34-b87d-c59d5f174228 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:27:39.697377 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-61701c86-d604-4c34-b87d-c59d5f174228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:27:39.705384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 753/1495] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:27:39.710159 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0878cb-f4d5-4b40-93eb-ddb743bd2d0f None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:27:39.719778 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0878cb-f4d5-4b40-93eb-ddb743bd2d0f None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:27:39.724328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f1562-ae5b-4943-b37e-53a140f6acb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:27:39.724984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1562-ae5b-4943-b37e-53a140f6acb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:39.725265 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1562-ae5b-4943-b37e-53a140f6acb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:39.725539 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1562-ae5b-4943-b37e-53a140f6acb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:39.726386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f1562-ae5b-4943-b37e-53a140f6acb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:27:39.726632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f1562-ae5b-4943-b37e-53a140f6acb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:27:39.727794 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: WARNING py.warnings [None req-044f1562-ae5b-4943-b37e-53a140f6acb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 14:27:39.727794 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: warnings.warn(msg) May 17 14:27:39.727794 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: May 17 14:27:39.728677 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f1562-ae5b-4943-b37e-53a140f6acb7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:27:39.739906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 743/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:27:39.748945 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61701c86-d604-4c34-b87d-c59d5f174228 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:27:39.758693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61701c86-d604-4c34-b87d-c59d5f174228 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:27:39.763221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093418f3-86ed-4453-acd3-832a8fdd4b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:27:39.763864 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093418f3-86ed-4453-acd3-832a8fdd4b29 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:39.764142 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093418f3-86ed-4453-acd3-832a8fdd4b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:39.764413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093418f3-86ed-4453-acd3-832a8fdd4b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:39.765096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093418f3-86ed-4453-acd3-832a8fdd4b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:27:39.766950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: WARNING py.warnings [None req-093418f3-86ed-4453-acd3-832a8fdd4b29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 14:27:39.766950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: warnings.warn(msg) May 17 14:27:39.766950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: May 17 14:27:39.768146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093418f3-86ed-4453-acd3-832a8fdd4b29 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:27:39.803628 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 754/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:27:39 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:27:39.809160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f1562-ae5b-4943-b37e-53a140f6acb7 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:27:39.819052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f1562-ae5b-4943-b37e-53a140f6acb7 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:27:39.876735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ffe78-b805-4a9c-80c1-7180f7653c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:27:39.877407 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ffe78-b805-4a9c-80c1-7180f7653c77 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:39.877692 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ffe78-b805-4a9c-80c1-7180f7653c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:39.877970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ffe78-b805-4a9c-80c1-7180f7653c77 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:39.878710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ffe78-b805-4a9c-80c1-7180f7653c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:27:39.879728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: WARNING py.warnings [None req-631ffe78-b805-4a9c-80c1-7180f7653c77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 14:27:39.879728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: warnings.warn(msg) May 17 14:27:39.879728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: May 17 14:27:39.880941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ffe78-b805-4a9c-80c1-7180f7653c77 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:27:39.900510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 744/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:27:39 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:27:39.904562 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093418f3-86ed-4453-acd3-832a8fdd4b29 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:27:39.915417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093418f3-86ed-4453-acd3-832a8fdd4b29 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:27:39.920041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787c001-32c7-49d6-ad20-52e7203a235d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:27:39.920706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787c001-32c7-49d6-ad20-52e7203a235d admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:39.921008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787c001-32c7-49d6-ad20-52e7203a235d admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:39.921288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787c001-32c7-49d6-ad20-52e7203a235d admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:39.922011 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787c001-32c7-49d6-ad20-52e7203a235d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:27:39.923065 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: WARNING py.warnings [None req-9787c001-32c7-49d6-ad20-52e7203a235d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 14:27:39.923065 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: warnings.warn(msg) May 17 14:27:39.923065 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: May 17 14:27:39.923982 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787c001-32c7-49d6-ad20-52e7203a235d admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:27:39.937252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 755/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:27:39.941431 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ffe78-b805-4a9c-80c1-7180f7653c77 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:27:39.951307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ffe78-b805-4a9c-80c1-7180f7653c77 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:27:39.956444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8426c-8e32-4c1a-bea5-aa797ba0114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:27:39.957101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8426c-8e32-4c1a-bea5-aa797ba0114e admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:39.957413 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8426c-8e32-4c1a-bea5-aa797ba0114e admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:39.957732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8426c-8e32-4c1a-bea5-aa797ba0114e admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:39.958482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8426c-8e32-4c1a-bea5-aa797ba0114e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:27:39.959494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: WARNING py.warnings [None req-a7d8426c-8e32-4c1a-bea5-aa797ba0114e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 14:27:39.959494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: warnings.warn(msg) May 17 14:27:39.959494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: May 17 14:27:39.960419 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8426c-8e32-4c1a-bea5-aa797ba0114e admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:27:39.973447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 745/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:27:39.978287 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787c001-32c7-49d6-ad20-52e7203a235d admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:27:39.988027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787c001-32c7-49d6-ad20-52e7203a235d admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:27:39.993270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd725e0-447d-4b6d-94fe-505b26ecf88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:27:39.994136 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd725e0-447d-4b6d-94fe-505b26ecf88b admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:39.994450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd725e0-447d-4b6d-94fe-505b26ecf88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:39.994726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd725e0-447d-4b6d-94fe-505b26ecf88b admin admin] PATH_INFO: `/v3/projects/4bafa7f373014bdbb88e265bd7409665/users/ac44c9a56bd44fea9930c997b2622955/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:40.008897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd725e0-447d-4b6d-94fe-505b26ecf88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bafa7f373014bdbb88e265bd7409665, user_id=ac44c9a56bd44fea9930c997b2622955, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:27:40.009929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: WARNING py.warnings [None req-efd725e0-447d-4b6d-94fe-505b26ecf88b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 14:27:40.009929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: warnings.warn(msg) May 17 14:27:40.009929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: May 17 14:27:40.011901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd725e0-447d-4b6d-94fe-505b26ecf88b admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:27:40.025387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 756/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:27:39 2022] PUT /identity/v3/projects/4bafa7f373014bdbb88e265bd7409665/users/ac44c9a56bd44fea9930c997b2622955/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:27:40.036522 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652a33c-aea2-4429-9a26-77e4ae094f04 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:40.036814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652a33c-aea2-4429-9a26-77e4ae094f04 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:40.037098 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652a33c-aea2-4429-9a26-77e4ae094f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:40.064791 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-6652a33c-aea2-4429-9a26-77e4ae094f04 None None] MFA Rules not processed for user `ac44c9a56bd44fea9930c997b2622955`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:27:40.066015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6652a33c-aea2-4429-9a26-77e4ae094f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:27:40.128618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 746/1502] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:27:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:27:40.142570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142e560-6d13-4154-9147-22dcc1ca671c None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:40.142870 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142e560-6d13-4154-9147-22dcc1ca671c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:40.143151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142e560-6d13-4154-9147-22dcc1ca671c None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:40.144496 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 757/1503] 10.222.0.48 () {54 vars in 963 bytes} [Tue May 17 14:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:27:40.150046 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9ec09-4dbc-4fbd-9feb-02e02e50aceb None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:40.150378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9ec09-4dbc-4fbd-9feb-02e02e50aceb None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:40.150705 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9ec09-4dbc-4fbd-9feb-02e02e50aceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:40.167864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-31d9ec09-4dbc-4fbd-9feb-02e02e50aceb None None] MFA Rules not processed for user `f7fd6429fee94c89a6a29467b014ec5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:27:40.169025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-31d9ec09-4dbc-4fbd-9feb-02e02e50aceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:27:40.218507 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 747/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Tue May 17 14:27:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:27:40.226081 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142e560-6d13-4154-9147-22dcc1ca671c None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:27:40.236403 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142e560-6d13-4154-9147-22dcc1ca671c None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:27:40.239904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d81bf-f2f5-4e1c-8606-5037a55b0ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:27:40.240532 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d81bf-f2f5-4e1c-8606-5037a55b0ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:40.240817 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d81bf-f2f5-4e1c-8606-5037a55b0ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:40.241094 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d81bf-f2f5-4e1c-8606-5037a55b0ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:40.250129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d81bf-f2f5-4e1c-8606-5037a55b0ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:27:40.251596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d81bf-f2f5-4e1c-8606-5037a55b0ca4 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:27:40.261299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 758/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:27:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:27:40.302941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cf78a-b09c-41f0-a0fd-5efd3e369944 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:40.303232 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cf78a-b09c-41f0-a0fd-5efd3e369944 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:40.303512 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cf78a-b09c-41f0-a0fd-5efd3e369944 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:40.305733 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 748/1506] 10.222.0.48 () {52 vars in 829 bytes} [Tue May 17 14:27:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:27:40.309378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d81bf-f2f5-4e1c-8606-5037a55b0ca4 service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:27:40.369267 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d81bf-f2f5-4e1c-8606-5037a55b0ca4 service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:27:40.373738 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f4e56-578a-4171-bfb0-afac15e47a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:27:40.374663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f4e56-578a-4171-bfb0-afac15e47a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:40.374950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f4e56-578a-4171-bfb0-afac15e47a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:40.375253 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f4e56-578a-4171-bfb0-afac15e47a19 admin admin] PATH_INFO: `/v3/users/ac44c9a56bd44fea9930c997b2622955` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:40.376418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f4e56-578a-4171-bfb0-afac15e47a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac44c9a56bd44fea9930c997b2622955)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:27:40.377441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: WARNING py.warnings [None req-524f4e56-578a-4171-bfb0-afac15e47a19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 14:27:40.377441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: warnings.warn(msg) May 17 14:27:40.377441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: May 17 14:27:40.378705 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f4e56-578a-4171-bfb0-afac15e47a19 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:27:40.441709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-524f4e56-578a-4171-bfb0-afac15e47a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac44c9a56bd44fea9930c997b2622955'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:27:40.452007 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-524f4e56-578a-4171-bfb0-afac15e47a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac44c9a56bd44fea9930c997b2622955'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:27:40.452676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-524f4e56-578a-4171-bfb0-afac15e47a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac44c9a56bd44fea9930c997b2622955'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:27:40.470107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-524f4e56-578a-4171-bfb0-afac15e47a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac44c9a56bd44fea9930c997b2622955'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:27:40.483278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-524f4e56-578a-4171-bfb0-afac15e47a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac44c9a56bd44fea9930c997b2622955'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:27:40.489135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 759/1507] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:27:40 2022] DELETE /identity/v3/users/ac44c9a56bd44fea9930c997b2622955 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:27:40.494298 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe30bf4-4be6-42af-8e22-e8f7106e3296 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:40.494645 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe30bf4-4be6-42af-8e22-e8f7106e3296 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:40.494925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe30bf4-4be6-42af-8e22-e8f7106e3296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:40.512503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-bfe30bf4-4be6-42af-8e22-e8f7106e3296 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:27:40.513692 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bfe30bf4-4be6-42af-8e22-e8f7106e3296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:27:40.575414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 749/1508] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:27:40.586505 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f4e56-578a-4171-bfb0-afac15e47a19 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:27:40.588220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-524f4e56-578a-4171-bfb0-afac15e47a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:27:40.644774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f4e56-578a-4171-bfb0-afac15e47a19 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:27:40.648828 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea4b5d-995b-4943-9496-182caf555b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:27:40.649474 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea4b5d-995b-4943-9496-182caf555b10 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:40.649755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea4b5d-995b-4943-9496-182caf555b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:40.650031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea4b5d-995b-4943-9496-182caf555b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:40.658843 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea4b5d-995b-4943-9496-182caf555b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:27:40.660286 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea4b5d-995b-4943-9496-182caf555b10 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:27:40.670313 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 760/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:27:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:27:41.018091 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe30bf4-4be6-42af-8e22-e8f7106e3296 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:27:41.019602 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bfe30bf4-4be6-42af-8e22-e8f7106e3296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:27:41.031905 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe30bf4-4be6-42af-8e22-e8f7106e3296 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:27:41.036522 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:27:41.037338 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:27:41.037621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:27:41.037896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3 admin admin] PATH_INFO: `/v3/projects/4bafa7f373014bdbb88e265bd7409665` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:27:41.045471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bafa7f373014bdbb88e265bd7409665)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:27:41.045471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: WARNING py.warnings [None req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 14:27:41.045471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: warnings.warn(msg) May 17 14:27:41.045471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: May 17 14:27:41.045471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:27:41.101932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bafa7f373014bdbb88e265bd7409665', 'request_id': 'req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:27:41.114925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bafa7f373014bdbb88e265bd7409665', 'request_id': 'req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:27:41.124226 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bafa7f373014bdbb88e265bd7409665', 'request_id': 'req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:27:41.135538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3 admin admin] The token cache is being invalidate because project 4bafa7f373014bdbb88e265bd7409665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:27:41.135827 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:27:41.136464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6d88ddc1-7f08-4775-983c-1b36f1baf1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:27:41.138267 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 750/1510] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:27:41 2022] DELETE /identity/v3/projects/4bafa7f373014bdbb88e265bd7409665 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:29:20.883475 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b41e60-e9f4-4367-b8ba-06b454fb7843 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:20.884097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b41e60-e9f4-4367-b8ba-06b454fb7843 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:20.884097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b41e60-e9f4-4367-b8ba-06b454fb7843 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:20.885371 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 14:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:29:20.890160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d7b7d-b326-4e3e-bfd4-d86caa165e72 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:20.890664 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d7b7d-b326-4e3e-bfd4-d86caa165e72 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:20.890768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d7b7d-b326-4e3e-bfd4-d86caa165e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:20.909024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-898d7b7d-b326-4e3e-bfd4-d86caa165e72 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:29:20.910254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-898d7b7d-b326-4e3e-bfd4-d86caa165e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:29:20.967451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 14:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:29:21.138733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b41e60-e9f4-4367-b8ba-06b454fb7843 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:29:21.140314 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-64b41e60-e9f4-4367-b8ba-06b454fb7843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:29:21.213985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b41e60-e9f4-4367-b8ba-06b454fb7843 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:29:21.219441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd699f-6745-42fe-8f73-9057d6bca38d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:29:21.220086 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd699f-6745-42fe-8f73-9057d6bca38d service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:21.220372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd699f-6745-42fe-8f73-9057d6bca38d service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:21.220650 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd699f-6745-42fe-8f73-9057d6bca38d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:21.228782 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd699f-6745-42fe-8f73-9057d6bca38d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:29:21.230427 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd699f-6745-42fe-8f73-9057d6bca38d service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:29:21.239652 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 762/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:29:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:29:22.152320 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441ec5e-af3a-41d9-844d-c25e85f5a25f None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:22.152828 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441ec5e-af3a-41d9-844d-c25e85f5a25f None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:22.152943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441ec5e-af3a-41d9-844d-c25e85f5a25f None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:22.154316 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 14:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:29:22.159138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949d2c-8f16-494c-9770-afb5f3e33640 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:22.159583 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949d2c-8f16-494c-9770-afb5f3e33640 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:22.159689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949d2c-8f16-494c-9770-afb5f3e33640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:22.179152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-45949d2c-8f16-494c-9770-afb5f3e33640 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:29:22.180619 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-45949d2c-8f16-494c-9770-afb5f3e33640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:29:22.188888 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 14:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:29:22.216947 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab9aae-b4e6-4259-9bad-4989a6dc91ca None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:22.217345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab9aae-b4e6-4259-9bad-4989a6dc91ca None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:22.217626 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab9aae-b4e6-4259-9bad-4989a6dc91ca None None] PATH_INFO: `/v3` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:22.218960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 753/1516] 10.222.0.74 () {54 vars in 925 bytes} [Tue May 17 14:29:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:29:22.253599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f28169-406f-43d3-9d77-4e47900dc8e1 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:22.254101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f28169-406f-43d3-9d77-4e47900dc8e1 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:22.254637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f28169-406f-43d3-9d77-4e47900dc8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:22.274052 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-f7f28169-406f-43d3-9d77-4e47900dc8e1 None None] MFA Rules not processed for user `fad90f42ebfe43eb8256611a88df87ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:29:22.275415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f7f28169-406f-43d3-9d77-4e47900dc8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:29:22.336715 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 764/1517] 10.222.0.74 () {58 vars in 1015 bytes} [Tue May 17 14:29:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:29:22.341655 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab9aae-b4e6-4259-9bad-4989a6dc91ca None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:29:22.356603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab9aae-b4e6-4259-9bad-4989a6dc91ca None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:29:22.361928 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d720a-aeaa-4db2-a462-3e36f9240fc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:29:22.362588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d720a-aeaa-4db2-a462-3e36f9240fc9 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:22.362871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d720a-aeaa-4db2-a462-3e36f9240fc9 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:22.363144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d720a-aeaa-4db2-a462-3e36f9240fc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:22.371460 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d720a-aeaa-4db2-a462-3e36f9240fc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:29:22.373083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d720a-aeaa-4db2-a462-3e36f9240fc9 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:29:22.382287 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 754/1518] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:29:31.537741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62057fc5-91a3-4894-bc9f-297b717ea413 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:31.538295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62057fc5-91a3-4894-bc9f-297b717ea413 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:31.538295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62057fc5-91a3-4894-bc9f-297b717ea413 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:31.539942 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 765/1519] 10.222.0.48 () {54 vars in 960 bytes} [Tue May 17 14:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:29:31.545280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de4ce7-7f5e-477d-80ac-dfab057ab9f2 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:31.545757 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de4ce7-7f5e-477d-80ac-dfab057ab9f2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:31.546240 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de4ce7-7f5e-477d-80ac-dfab057ab9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:31.571767 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-96de4ce7-7f5e-477d-80ac-dfab057ab9f2 None None] MFA Rules not processed for user `fad90f42ebfe43eb8256611a88df87ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:29:31.573488 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-96de4ce7-7f5e-477d-80ac-dfab057ab9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:29:31.583557 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 755/1520] 10.222.0.48 () {58 vars in 1057 bytes} [Tue May 17 14:29:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:29:31.594476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62057fc5-91a3-4894-bc9f-297b717ea413 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:29:31.607853 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62057fc5-91a3-4894-bc9f-297b717ea413 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:29:31.612785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e71b1-2402-46d2-90b4-5f37354f9b66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fad90f42ebfe43eb8256611a88df87ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:29:31.613459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e71b1-2402-46d2-90b4-5f37354f9b66 service placement] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:31.613745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e71b1-2402-46d2-90b4-5f37354f9b66 service placement] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:31.614022 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e71b1-2402-46d2-90b4-5f37354f9b66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:31.622611 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e71b1-2402-46d2-90b4-5f37354f9b66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:29:31.624201 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e71b1-2402-46d2-90b4-5f37354f9b66 service placement] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:29:31.634451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 766/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:29:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:29:33.720695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279b092-265e-4a87-9e35-54c4581ef36b None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:33.721259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279b092-265e-4a87-9e35-54c4581ef36b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:33.721259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279b092-265e-4a87-9e35-54c4581ef36b None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:33.722699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 14:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:29:33.727751 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6259e3c-9183-4b1f-ad4a-2d9362343f43 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:33.728167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6259e3c-9183-4b1f-ad4a-2d9362343f43 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:33.728309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6259e3c-9183-4b1f-ad4a-2d9362343f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:33.746275 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-f6259e3c-9183-4b1f-ad4a-2d9362343f43 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:29:33.747498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f6259e3c-9183-4b1f-ad4a-2d9362343f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:29:33.755423 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 14:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:29:33.906253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279b092-265e-4a87-9e35-54c4581ef36b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:29:33.920776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279b092-265e-4a87-9e35-54c4581ef36b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:29:33.926093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc11206-f2bb-413c-a8c0-4cadcfa44b85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:29:33.926756 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc11206-f2bb-413c-a8c0-4cadcfa44b85 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:33.927037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc11206-f2bb-413c-a8c0-4cadcfa44b85 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:33.927309 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc11206-f2bb-413c-a8c0-4cadcfa44b85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:33.935739 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc11206-f2bb-413c-a8c0-4cadcfa44b85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:29:33.937340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc11206-f2bb-413c-a8c0-4cadcfa44b85 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:29:33.946573 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 757/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:29:34.835589 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d767e-eb92-49e9-89a5-4cfb4f1e928a None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:34.836902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d767e-eb92-49e9-89a5-4cfb4f1e928a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:34.836902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d767e-eb92-49e9-89a5-4cfb4f1e928a None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:34.837988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 14:29:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:29:34.842907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d15e1-cdd3-475c-b10a-ea1aff6d6d64 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:34.843387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d15e1-cdd3-475c-b10a-ea1aff6d6d64 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:34.843499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d15e1-cdd3-475c-b10a-ea1aff6d6d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:34.863327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-a07d15e1-cdd3-475c-b10a-ea1aff6d6d64 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:29:34.864542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a07d15e1-cdd3-475c-b10a-ea1aff6d6d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:29:34.872362 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 14:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:29:35.022783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d767e-eb92-49e9-89a5-4cfb4f1e928a None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:29:35.037386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d767e-eb92-49e9-89a5-4cfb4f1e928a None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:29:35.043627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fd205-79d5-4861-bbe1-2fda14df182a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:29:35.044254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fd205-79d5-4861-bbe1-2fda14df182a service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:35.044533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fd205-79d5-4861-bbe1-2fda14df182a service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:35.044813 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fd205-79d5-4861-bbe1-2fda14df182a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:35.052805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fd205-79d5-4861-bbe1-2fda14df182a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:29:35.054425 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fd205-79d5-4861-bbe1-2fda14df182a service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:29:35.064705 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 769/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:29:39.281492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167dc66-ea6b-4b2f-9f99-6f2a4c8e7a1c None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:39.282048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167dc66-ea6b-4b2f-9f99-6f2a4c8e7a1c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:39.282048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167dc66-ea6b-4b2f-9f99-6f2a4c8e7a1c None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:39.283432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 14:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:29:39.288490 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadd1ed-cecd-4962-ad51-b63eec1ed574 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:39.289541 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadd1ed-cecd-4962-ad51-b63eec1ed574 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:39.289665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadd1ed-cecd-4962-ad51-b63eec1ed574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:39.307570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-0cadd1ed-cecd-4962-ad51-b63eec1ed574 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:29:39.308737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-0cadd1ed-cecd-4962-ad51-b63eec1ed574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:29:39.316505 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 14:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:29:39.354100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167dc66-ea6b-4b2f-9f99-6f2a4c8e7a1c None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:29:39.355781 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c167dc66-ea6b-4b2f-9f99-6f2a4c8e7a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:29:39.410806 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167dc66-ea6b-4b2f-9f99-6f2a4c8e7a1c None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:29:39.414889 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99154f73-1bcc-42e4-b333-eb854f7cc021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:29:39.415527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99154f73-1bcc-42e4-b333-eb854f7cc021 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:39.415810 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99154f73-1bcc-42e4-b333-eb854f7cc021 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:39.416090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99154f73-1bcc-42e4-b333-eb854f7cc021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:39.425471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99154f73-1bcc-42e4-b333-eb854f7cc021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:29:39.426933 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99154f73-1bcc-42e4-b333-eb854f7cc021 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:29:39.436142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 760/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:29:41.700161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf78a9-ffbf-4a33-b608-db3cf0b80bbd None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:41.700742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf78a9-ffbf-4a33-b608-db3cf0b80bbd None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:41.700742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf78a9-ffbf-4a33-b608-db3cf0b80bbd None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:41.702068 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 14:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:29:41.707614 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9e717-6d20-4bc8-abf3-ade4aea00358 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:41.708043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9e717-6d20-4bc8-abf3-ade4aea00358 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:41.708174 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9e717-6d20-4bc8-abf3-ade4aea00358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:41.725650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-46d9e717-6d20-4bc8-abf3-ade4aea00358 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:29:41.727010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-46d9e717-6d20-4bc8-abf3-ade4aea00358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:29:41.734742 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 14:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:29:41.770290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf78a9-ffbf-4a33-b608-db3cf0b80bbd None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:29:41.781680 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf78a9-ffbf-4a33-b608-db3cf0b80bbd None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:29:41.785315 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff076e-9bfb-435b-bd4b-e230b26e6037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:29:41.785951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff076e-9bfb-435b-bd4b-e230b26e6037 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:41.786261 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff076e-9bfb-435b-bd4b-e230b26e6037 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:41.786539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff076e-9bfb-435b-bd4b-e230b26e6037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:41.796106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff076e-9bfb-435b-bd4b-e230b26e6037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:29:41.797540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff076e-9bfb-435b-bd4b-e230b26e6037 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:29:41.806982 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 772/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:29:45.516659 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37058439-5d5d-4c31-a912-fb9a808d25b1 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:45.517190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37058439-5d5d-4c31-a912-fb9a808d25b1 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:45.517190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37058439-5d5d-4c31-a912-fb9a808d25b1 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:45.518555 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 14:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:29:45.524461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368aeae-ee63-4a17-af99-25a51fbb2fae None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:45.524883 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368aeae-ee63-4a17-af99-25a51fbb2fae None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:45.525027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368aeae-ee63-4a17-af99-25a51fbb2fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:45.543153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-1368aeae-ee63-4a17-af99-25a51fbb2fae None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:29:45.544321 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-1368aeae-ee63-4a17-af99-25a51fbb2fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:29:45.551976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 14:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:29:45.832955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37058439-5d5d-4c31-a912-fb9a808d25b1 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:29:45.834692 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-37058439-5d5d-4c31-a912-fb9a808d25b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:29:45.891379 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37058439-5d5d-4c31-a912-fb9a808d25b1 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:29:45.894849 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace4e3c-2964-453c-ba6c-b0590f4666eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:29:45.895484 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace4e3c-2964-453c-ba6c-b0590f4666eb service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:45.895763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace4e3c-2964-453c-ba6c-b0590f4666eb service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:45.896034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace4e3c-2964-453c-ba6c-b0590f4666eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:45.905267 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace4e3c-2964-453c-ba6c-b0590f4666eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:29:45.906726 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace4e3c-2964-453c-ba6c-b0590f4666eb service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:29:45.915758 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 763/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:29:48.218732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead68c2e-a30c-4d76-af1b-41843aaceb8b None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:48.219170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead68c2e-a30c-4d76-af1b-41843aaceb8b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:48.219292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead68c2e-a30c-4d76-af1b-41843aaceb8b None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:48.220620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 14:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:29:48.225842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6984d-ef69-4d41-92ef-c2377c0110b2 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:48.226271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6984d-ef69-4d41-92ef-c2377c0110b2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:48.226428 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6984d-ef69-4d41-92ef-c2377c0110b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:48.245048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-9fa6984d-ef69-4d41-92ef-c2377c0110b2 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:29:48.246247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-9fa6984d-ef69-4d41-92ef-c2377c0110b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:29:48.254201 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 14:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:29:48.529190 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead68c2e-a30c-4d76-af1b-41843aaceb8b None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:29:48.530871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ead68c2e-a30c-4d76-af1b-41843aaceb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:29:48.544657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead68c2e-a30c-4d76-af1b-41843aaceb8b None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:29:48.548170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a6a8d-337f-41f9-b393-0e68515d4224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:29:48.548833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a6a8d-337f-41f9-b393-0e68515d4224 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:29:48.549119 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a6a8d-337f-41f9-b393-0e68515d4224 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:29:48.549398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a6a8d-337f-41f9-b393-0e68515d4224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:29:48.558283 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a6a8d-337f-41f9-b393-0e68515d4224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:29:48.559742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a6a8d-337f-41f9-b393-0e68515d4224 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:29:48.569879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 775/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:20.558575 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1100f2-a653-4e8a-ac1b-596ecbcc68de None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:20.559171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1100f2-a653-4e8a-ac1b-596ecbcc68de None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:20.559171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1100f2-a653-4e8a-ac1b-596ecbcc68de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:20.585939 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-bc1100f2-a653-4e8a-ac1b-596ecbcc68de None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:20.591852 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bc1100f2-a653-4e8a-ac1b-596ecbcc68de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:20.601369 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 765/1540] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:20.611982 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b943fdc-7eb4-46e5-ae18-58f14993ce36 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:20.613134 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b943fdc-7eb4-46e5-ae18-58f14993ce36 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:20.613636 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b943fdc-7eb4-46e5-ae18-58f14993ce36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:20.640122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-3b943fdc-7eb4-46e5-ae18-58f14993ce36 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:20.641386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-3b943fdc-7eb4-46e5-ae18-58f14993ce36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:20.660011 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 776/1541] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:20.671153 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1100f2-a653-4e8a-ac1b-596ecbcc68de None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:20.684033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1100f2-a653-4e8a-ac1b-596ecbcc68de None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:20.692090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065229ab-e8a6-4cdd-a17a-9aef7570beb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:20.692799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065229ab-e8a6-4cdd-a17a-9aef7570beb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:20.693385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065229ab-e8a6-4cdd-a17a-9aef7570beb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:20.693671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065229ab-e8a6-4cdd-a17a-9aef7570beb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:20.694497 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065229ab-e8a6-4cdd-a17a-9aef7570beb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:31:20.694809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065229ab-e8a6-4cdd-a17a-9aef7570beb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:20.697443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065229ab-e8a6-4cdd-a17a-9aef7570beb8 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:20.720488 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 766/1542] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:31:20.729284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b943fdc-7eb4-46e5-ae18-58f14993ce36 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:20.745467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b943fdc-7eb4-46e5-ae18-58f14993ce36 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:20.755147 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0e7ef-447e-46ca-a780-7bed86471772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:20.755833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0e7ef-447e-46ca-a780-7bed86471772 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:20.756122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0e7ef-447e-46ca-a780-7bed86471772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:20.756404 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0e7ef-447e-46ca-a780-7bed86471772 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:20.757458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0e7ef-447e-46ca-a780-7bed86471772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:20.759805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0e7ef-447e-46ca-a780-7bed86471772 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:20.789473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5b569-a9bb-4f2a-9884-3fb1136cdebc None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:20.789847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5b569-a9bb-4f2a-9884-3fb1136cdebc None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:20.790061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5b569-a9bb-4f2a-9884-3fb1136cdebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:20.806105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 777/1543] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:31:20 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:20.810592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0e7ef-447e-46ca-a780-7bed86471772 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:20.827682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-1cd5b569-a9bb-4f2a-9884-3fb1136cdebc None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:20.828905 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1cd5b569-a9bb-4f2a-9884-3fb1136cdebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:20.954841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0e7ef-447e-46ca-a780-7bed86471772 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:20.955291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 767/1544] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:20.956743 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b2e08-0921-4715-8207-3307fe5133fb None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:20.957039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b2e08-0921-4715-8207-3307fe5133fb None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:20.957317 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b2e08-0921-4715-8207-3307fe5133fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:20.971916 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e1fa4-1fe5-441a-b7fc-37925a874a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:20.972609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e1fa4-1fe5-441a-b7fc-37925a874a0f admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:20.972895 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e1fa4-1fe5-441a-b7fc-37925a874a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:20.973174 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e1fa4-1fe5-441a-b7fc-37925a874a0f admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:20.973885 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e1fa4-1fe5-441a-b7fc-37925a874a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:20.974941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: WARNING py.warnings [None req-3e1e1fa4-1fe5-441a-b7fc-37925a874a0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 14:31:20.974941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: warnings.warn(msg) May 17 14:31:20.974941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: May 17 14:31:20.976719 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e1fa4-1fe5-441a-b7fc-37925a874a0f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:20.988463 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-5d8b2e08-0921-4715-8207-3307fe5133fb None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:20.989680 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5d8b2e08-0921-4715-8207-3307fe5133fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:21.018266 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 778/1545] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:31:20 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:21.019793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 768/1546] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:21.021043 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d935ce-a8d3-4854-94d8-5772c05b9326 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.021345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d935ce-a8d3-4854-94d8-5772c05b9326 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.021620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d935ce-a8d3-4854-94d8-5772c05b9326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.022443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24ba7d-8351-4464-ac39-05376ec5d42a None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.023263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24ba7d-8351-4464-ac39-05376ec5d42a None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.023769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24ba7d-8351-4464-ac39-05376ec5d42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.043543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-8d24ba7d-8351-4464-ac39-05376ec5d42a None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:21.044733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-e3d935ce-a8d3-4854-94d8-5772c05b9326 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:21.044877 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-8d24ba7d-8351-4464-ac39-05376ec5d42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:21.046028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e3d935ce-a8d3-4854-94d8-5772c05b9326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:21.052750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 769/1547] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:21.054164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b1b5b-f061-4200-add8-5bfe30ce3fcd None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.057175 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 779/1548] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:21.057921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d935ce-a8d3-4854-94d8-5772c05b9326 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.058155 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b1b5b-f061-4200-add8-5bfe30ce3fcd None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.058479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b1b5b-f061-4200-add8-5bfe30ce3fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.068538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d935ce-a8d3-4854-94d8-5772c05b9326 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.073531 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad95ef5-03d8-4c05-bf06-c398b85ec6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.074355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad95ef5-03d8-4c05-bf06-c398b85ec6eb admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.074640 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad95ef5-03d8-4c05-bf06-c398b85ec6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.075110 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad95ef5-03d8-4c05-bf06-c398b85ec6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.075839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad95ef5-03d8-4c05-bf06-c398b85ec6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.076998 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-ae0b1b5b-f061-4200-add8-5bfe30ce3fcd None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:21.077719 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad95ef5-03d8-4c05-bf06-c398b85ec6eb admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.078220 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ae0b1b5b-f061-4200-add8-5bfe30ce3fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:21.087310 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 770/1549] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:21.088311 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 780/1550] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:21.089428 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd924ff-3565-47ae-8caa-bb11e826a433 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.089719 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd924ff-3565-47ae-8caa-bb11e826a433 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.089988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd924ff-3565-47ae-8caa-bb11e826a433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.091383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8134d5d-04f4-4a4b-bc8c-bf46dc425da5 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.091683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8134d5d-04f4-4a4b-bc8c-bf46dc425da5 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.091989 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8134d5d-04f4-4a4b-bc8c-bf46dc425da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.108290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-5fd924ff-3565-47ae-8caa-bb11e826a433 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:21.109462 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-f8134d5d-04f4-4a4b-bc8c-bf46dc425da5 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:21.109595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5fd924ff-3565-47ae-8caa-bb11e826a433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:21.110655 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f8134d5d-04f4-4a4b-bc8c-bf46dc425da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:21.118126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 781/1551] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:21.118660 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a809f7b-b184-47fb-a314-788a255032d1 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.118942 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a809f7b-b184-47fb-a314-788a255032d1 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.119215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a809f7b-b184-47fb-a314-788a255032d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.122315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 771/1552] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:21.123418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8134d5d-04f4-4a4b-bc8c-bf46dc425da5 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.134125 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8134d5d-04f4-4a4b-bc8c-bf46dc425da5 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.138008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-9a809f7b-b184-47fb-a314-788a255032d1 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:21.139084 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f5f41-44d9-40a8-9ebd-0f60a1159174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.139231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-9a809f7b-b184-47fb-a314-788a255032d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:21.139764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f5f41-44d9-40a8-9ebd-0f60a1159174 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.140050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f5f41-44d9-40a8-9ebd-0f60a1159174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.140322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f5f41-44d9-40a8-9ebd-0f60a1159174 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.141040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f5f41-44d9-40a8-9ebd-0f60a1159174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:31:21.141340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f5f41-44d9-40a8-9ebd-0f60a1159174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.142991 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f5f41-44d9-40a8-9ebd-0f60a1159174 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.147874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 782/1553] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:21.149139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d7642-6410-4315-925b-3123551e6e94 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.149432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d7642-6410-4315-925b-3123551e6e94 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.149712 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d7642-6410-4315-925b-3123551e6e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.155702 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 772/1554] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:31:21.157049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecf41e-6e32-420b-b901-092ad980a05b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.157339 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecf41e-6e32-420b-b901-092ad980a05b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.157616 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecf41e-6e32-420b-b901-092ad980a05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.170680 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-f05d7642-6410-4315-925b-3123551e6e94 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:21.171986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f05d7642-6410-4315-925b-3123551e6e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:21.176009 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-d9ecf41e-6e32-420b-b901-092ad980a05b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:21.177148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d9ecf41e-6e32-420b-b901-092ad980a05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:21.180395 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 783/1555] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:21.181174 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d7642-6410-4315-925b-3123551e6e94 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.188472 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 773/1556] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:21.188472 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375d1fd-4f8e-4350-b1b3-dc8309062701 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.188472 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375d1fd-4f8e-4350-b1b3-dc8309062701 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.188472 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375d1fd-4f8e-4350-b1b3-dc8309062701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.194730 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d7642-6410-4315-925b-3123551e6e94 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.202302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b97193-1692-44cc-9703-88dbc7e3cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.202955 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b97193-1692-44cc-9703-88dbc7e3cf9f admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.203235 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b97193-1692-44cc-9703-88dbc7e3cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.203505 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b97193-1692-44cc-9703-88dbc7e3cf9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.204220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b97193-1692-44cc-9703-88dbc7e3cf9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.205812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b97193-1692-44cc-9703-88dbc7e3cf9f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.206640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-f375d1fd-4f8e-4350-b1b3-dc8309062701 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:21.208107 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f375d1fd-4f8e-4350-b1b3-dc8309062701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:21.216342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 784/1557] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:21.216934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 774/1558] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:21.218013 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc17d65-bc0f-4856-ab2a-5c85aee592e1 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.218350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc17d65-bc0f-4856-ab2a-5c85aee592e1 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.218632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc17d65-bc0f-4856-ab2a-5c85aee592e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.220832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b97193-1692-44cc-9703-88dbc7e3cf9f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.230321 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b97193-1692-44cc-9703-88dbc7e3cf9f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.234880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1a4ed-cf85-4093-b558-8062f5bfb7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.235517 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1a4ed-cf85-4093-b558-8062f5bfb7fc admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.235795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1a4ed-cf85-4093-b558-8062f5bfb7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.236066 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1a4ed-cf85-4093-b558-8062f5bfb7fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.236248 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-1dc17d65-bc0f-4856-ab2a-5c85aee592e1 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:21.236771 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1a4ed-cf85-4093-b558-8062f5bfb7fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:31:21.237073 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1a4ed-cf85-4093-b558-8062f5bfb7fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.237440 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1dc17d65-bc0f-4856-ab2a-5c85aee592e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:21.238066 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: WARNING py.warnings [None req-c3b1a4ed-cf85-4093-b558-8062f5bfb7fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 14:31:21.238066 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: warnings.warn(msg) May 17 14:31:21.238066 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: May 17 14:31:21.238974 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1a4ed-cf85-4093-b558-8062f5bfb7fc admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.245525 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 775/1559] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:21.246780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad7183-63c3-4a94-a7a2-201ddb93acbb None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.247068 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad7183-63c3-4a94-a7a2-201ddb93acbb None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.247346 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad7183-63c3-4a94-a7a2-201ddb93acbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.251774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 785/1560] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:31:21.252588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1a4ed-cf85-4093-b558-8062f5bfb7fc admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.264138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1a4ed-cf85-4093-b558-8062f5bfb7fc admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.268852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69669e93-070d-4c70-9e58-a097e5ee3cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.269496 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69669e93-070d-4c70-9e58-a097e5ee3cbf admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.269783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69669e93-070d-4c70-9e58-a097e5ee3cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.270064 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69669e93-070d-4c70-9e58-a097e5ee3cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.270787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69669e93-070d-4c70-9e58-a097e5ee3cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.271174 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-0cad7183-63c3-4a94-a7a2-201ddb93acbb None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:21.272940 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0cad7183-63c3-4a94-a7a2-201ddb93acbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:21.273624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69669e93-070d-4c70-9e58-a097e5ee3cbf admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.280612 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 776/1561] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:21.284439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad7183-63c3-4a94-a7a2-201ddb93acbb None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.294076 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad7183-63c3-4a94-a7a2-201ddb93acbb None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.298555 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c60f35-8b94-485d-adfb-630f05b6cad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.298712 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 786/1562] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:21.299206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c60f35-8b94-485d-adfb-630f05b6cad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.299554 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c60f35-8b94-485d-adfb-630f05b6cad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.299834 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c60f35-8b94-485d-adfb-630f05b6cad9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.299972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735f75b-54f2-4ae3-8b4c-6fe82d1b250e None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.300263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735f75b-54f2-4ae3-8b4c-6fe82d1b250e None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.300539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735f75b-54f2-4ae3-8b4c-6fe82d1b250e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.300636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c60f35-8b94-485d-adfb-630f05b6cad9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:31:21.300843 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c60f35-8b94-485d-adfb-630f05b6cad9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.302707 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c60f35-8b94-485d-adfb-630f05b6cad9 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.318691 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 777/1563] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:31:21.318691 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c60f35-8b94-485d-adfb-630f05b6cad9 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.320876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-7735f75b-54f2-4ae3-8b4c-6fe82d1b250e None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:21.322082 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7735f75b-54f2-4ae3-8b4c-6fe82d1b250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:21.326696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c60f35-8b94-485d-adfb-630f05b6cad9 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.379783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 787/1564] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:21.380950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735f75b-54f2-4ae3-8b4c-6fe82d1b250e None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.383009 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080104a-ecee-41a8-bb24-339200dc9152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.384298 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080104a-ecee-41a8-bb24-339200dc9152 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.384298 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080104a-ecee-41a8-bb24-339200dc9152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.384513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080104a-ecee-41a8-bb24-339200dc9152 admin admin] PATH_INFO: `/v3/projects/75507feeb9a54014b6bda2075ea1e146/users/357500181e4a43de8b1326d3db0b6f7b/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.390910 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735f75b-54f2-4ae3-8b4c-6fe82d1b250e None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.395460 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816e6a8-faab-4385-ae7e-a3a883ea7385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.396138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816e6a8-faab-4385-ae7e-a3a883ea7385 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.396426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816e6a8-faab-4385-ae7e-a3a883ea7385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.396731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816e6a8-faab-4385-ae7e-a3a883ea7385 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.398250 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816e6a8-faab-4385-ae7e-a3a883ea7385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:31:21.398682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816e6a8-faab-4385-ae7e-a3a883ea7385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.399785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080104a-ecee-41a8-bb24-339200dc9152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75507feeb9a54014b6bda2075ea1e146, user_id=357500181e4a43de8b1326d3db0b6f7b, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.400428 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816e6a8-faab-4385-ae7e-a3a883ea7385 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.400908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: WARNING py.warnings [None req-f080104a-ecee-41a8-bb24-339200dc9152 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 14:31:21.400908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: warnings.warn(msg) May 17 14:31:21.400908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: May 17 14:31:21.402879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080104a-ecee-41a8-bb24-339200dc9152 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.412486 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 788/1565] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:31:21.414006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816e6a8-faab-4385-ae7e-a3a883ea7385 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.423647 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 778/1566] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:21 2022] PUT /identity/v3/projects/75507feeb9a54014b6bda2075ea1e146/users/357500181e4a43de8b1326d3db0b6f7b/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:21.423832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816e6a8-faab-4385-ae7e-a3a883ea7385 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.427003 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080104a-ecee-41a8-bb24-339200dc9152 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.482519 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b049f9-2f9f-4be9-99ae-c5ca84bb803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.483190 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b049f9-2f9f-4be9-99ae-c5ca84bb803f admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.483473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b049f9-2f9f-4be9-99ae-c5ca84bb803f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.483746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b049f9-2f9f-4be9-99ae-c5ca84bb803f admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.484464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b049f9-2f9f-4be9-99ae-c5ca84bb803f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:31:21.484787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b049f9-2f9f-4be9-99ae-c5ca84bb803f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.486401 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b049f9-2f9f-4be9-99ae-c5ca84bb803f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.486868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080104a-ecee-41a8-bb24-339200dc9152 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.491717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227205-f772-4a3a-b775-3c6f477b8208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.492377 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227205-f772-4a3a-b775-3c6f477b8208 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.492664 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227205-f772-4a3a-b775-3c6f477b8208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.492941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227205-f772-4a3a-b775-3c6f477b8208 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.493634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da227205-f772-4a3a-b775-3c6f477b8208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.494682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: WARNING py.warnings [None req-da227205-f772-4a3a-b775-3c6f477b8208 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 14:31:21.494682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: warnings.warn(msg) May 17 14:31:21.494682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: May 17 14:31:21.495860 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da227205-f772-4a3a-b775-3c6f477b8208 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.497795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 789/1567] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:31:21.498625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b049f9-2f9f-4be9-99ae-c5ca84bb803f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.508782 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b049f9-2f9f-4be9-99ae-c5ca84bb803f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.513467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e6e5e-5e48-4625-a993-3afcfe616a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.514115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e6e5e-5e48-4625-a993-3afcfe616a55 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.514428 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e6e5e-5e48-4625-a993-3afcfe616a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.514706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e6e5e-5e48-4625-a993-3afcfe616a55 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.515431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e6e5e-5e48-4625-a993-3afcfe616a55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:31:21.515734 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e6e5e-5e48-4625-a993-3afcfe616a55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.517335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e6e5e-5e48-4625-a993-3afcfe616a55 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.527711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 779/1568] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:21.528608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227205-f772-4a3a-b775-3c6f477b8208 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.530942 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 790/1569] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:31:21.531787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e6e5e-5e48-4625-a993-3afcfe616a55 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.545225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e6e5e-5e48-4625-a993-3afcfe616a55 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.601028 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227205-f772-4a3a-b775-3c6f477b8208 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.606241 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fc28f-dbe7-4d41-a4fd-c021efa665a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.606578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2487ec5-6aa1-484f-9f29-566876eb1e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.607048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fc28f-dbe7-4d41-a4fd-c021efa665a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.607404 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2487ec5-6aa1-484f-9f29-566876eb1e4f admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.607531 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fc28f-dbe7-4d41-a4fd-c021efa665a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.607725 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2487ec5-6aa1-484f-9f29-566876eb1e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.607837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fc28f-dbe7-4d41-a4fd-c021efa665a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.607995 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2487ec5-6aa1-484f-9f29-566876eb1e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.608642 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fc28f-dbe7-4d41-a4fd-c021efa665a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.608928 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2487ec5-6aa1-484f-9f29-566876eb1e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.610802 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fc28f-dbe7-4d41-a4fd-c021efa665a1 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.611727 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2487ec5-6aa1-484f-9f29-566876eb1e4f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.630460 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 780/1570] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:21.631368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fc28f-dbe7-4d41-a4fd-c021efa665a1 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.640694 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 791/1571] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:21.641453 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fc28f-dbe7-4d41-a4fd-c021efa665a1 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.642194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2487ec5-6aa1-484f-9f29-566876eb1e4f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.699947 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a1ad7-9239-40ff-806e-fdf2891fd2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.700619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1ad7-9239-40ff-806e-fdf2891fd2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.700909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1ad7-9239-40ff-806e-fdf2891fd2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.701186 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1ad7-9239-40ff-806e-fdf2891fd2e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.702232 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a1ad7-9239-40ff-806e-fdf2891fd2e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:31:21.702546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a1ad7-9239-40ff-806e-fdf2891fd2e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.704177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a1ad7-9239-40ff-806e-fdf2891fd2e7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.707789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2487ec5-6aa1-484f-9f29-566876eb1e4f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.713242 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c4d90-0206-45c9-a03c-78ab74f1d75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.713897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c4d90-0206-45c9-a03c-78ab74f1d75f admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.714199 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c4d90-0206-45c9-a03c-78ab74f1d75f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.714493 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c4d90-0206-45c9-a03c-78ab74f1d75f admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.715183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c4d90-0206-45c9-a03c-78ab74f1d75f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.716757 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 781/1572] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:31:21.723961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c4d90-0206-45c9-a03c-78ab74f1d75f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.724086 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d321e75-aaea-4ba1-ab2d-b00e84874426 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.724086 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d321e75-aaea-4ba1-ab2d-b00e84874426 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.724086 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d321e75-aaea-4ba1-ab2d-b00e84874426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.736333 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-0d321e75-aaea-4ba1-ab2d-b00e84874426 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:21.737559 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0d321e75-aaea-4ba1-ab2d-b00e84874426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:21.744052 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 792/1573] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:21.744987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c4d90-0206-45c9-a03c-78ab74f1d75f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.745980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 782/1574] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:21.746620 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d321e75-aaea-4ba1-ab2d-b00e84874426 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.756258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d321e75-aaea-4ba1-ab2d-b00e84874426 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.810877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c4d90-0206-45c9-a03c-78ab74f1d75f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.812692 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5f14c-f93e-4f7f-883e-8c420ad79746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.813362 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5f14c-f93e-4f7f-883e-8c420ad79746 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.813645 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5f14c-f93e-4f7f-883e-8c420ad79746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.813920 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5f14c-f93e-4f7f-883e-8c420ad79746 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.814647 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5f14c-f93e-4f7f-883e-8c420ad79746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.815458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7d70d-52e4-4368-9c96-ca3ad86cf628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.816105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7d70d-52e4-4368-9c96-ca3ad86cf628 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.816388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7d70d-52e4-4368-9c96-ca3ad86cf628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.816596 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5f14c-f93e-4f7f-883e-8c420ad79746 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.816714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7d70d-52e4-4368-9c96-ca3ad86cf628 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.817327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7d70d-52e4-4368-9c96-ca3ad86cf628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.819970 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7d70d-52e4-4368-9c96-ca3ad86cf628 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.839039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 783/1575] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:21.840204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5f14c-f93e-4f7f-883e-8c420ad79746 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.850380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 793/1576] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:21.850380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7d70d-52e4-4368-9c96-ca3ad86cf628 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.850661 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5f14c-f93e-4f7f-883e-8c420ad79746 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.909481 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef0574-4792-4586-8181-652cc4f57292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.910077 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7d70d-52e4-4368-9c96-ca3ad86cf628 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.910243 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef0574-4792-4586-8181-652cc4f57292 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.910446 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef0574-4792-4586-8181-652cc4f57292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.910729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef0574-4792-4586-8181-652cc4f57292 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.911445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef0574-4792-4586-8181-652cc4f57292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.913968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef0574-4792-4586-8181-652cc4f57292 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.914877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023fa99-2a74-4d02-970a-0bf434b43149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.915535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023fa99-2a74-4d02-970a-0bf434b43149 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.915823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023fa99-2a74-4d02-970a-0bf434b43149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.916104 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023fa99-2a74-4d02-970a-0bf434b43149 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.916832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023fa99-2a74-4d02-970a-0bf434b43149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.918494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023fa99-2a74-4d02-970a-0bf434b43149 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.928456 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 794/1577] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:21.929514 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023fa99-2a74-4d02-970a-0bf434b43149 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.939928 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023fa99-2a74-4d02-970a-0bf434b43149 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:21.944476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 784/1578] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:21.945307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef0574-4792-4586-8181-652cc4f57292 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.948473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf09736-c050-4995-b0b9-a2eec09d8daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:21.949127 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf09736-c050-4995-b0b9-a2eec09d8daa admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:21.949424 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf09736-c050-4995-b0b9-a2eec09d8daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:21.949677 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf09736-c050-4995-b0b9-a2eec09d8daa admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:21.950410 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf09736-c050-4995-b0b9-a2eec09d8daa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:21.952593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf09736-c050-4995-b0b9-a2eec09d8daa admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:21.973919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 795/1579] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:21.974650 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf09736-c050-4995-b0b9-a2eec09d8daa admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:21.985240 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf09736-c050-4995-b0b9-a2eec09d8daa admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.009432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef0574-4792-4586-8181-652cc4f57292 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.014268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b986d7-3805-4fbd-9e04-4f13eadbf2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.014925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b986d7-3805-4fbd-9e04-4f13eadbf2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.015204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b986d7-3805-4fbd-9e04-4f13eadbf2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.015475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b986d7-3805-4fbd-9e04-4f13eadbf2c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.016178 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b986d7-3805-4fbd-9e04-4f13eadbf2c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.018062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b986d7-3805-4fbd-9e04-4f13eadbf2c5 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.040012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838f340-0721-4f76-848e-396c12afa702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.040696 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838f340-0721-4f76-848e-396c12afa702 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.040980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838f340-0721-4f76-848e-396c12afa702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.041262 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838f340-0721-4f76-848e-396c12afa702 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.041956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838f340-0721-4f76-848e-396c12afa702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.043534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 785/1580] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:22.043945 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838f340-0721-4f76-848e-396c12afa702 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.044864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b986d7-3805-4fbd-9e04-4f13eadbf2c5 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.048012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-51b986d7-3805-4fbd-9e04-4f13eadbf2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:22.065857 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 796/1581] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:31:21 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:22.066866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838f340-0721-4f76-848e-396c12afa702 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.078288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838f340-0721-4f76-848e-396c12afa702 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.106146 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b986d7-3805-4fbd-9e04-4f13eadbf2c5 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.109785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21ad7-fe2f-4169-9e0b-f0aaa14fa806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.110465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21ad7-fe2f-4169-9e0b-f0aaa14fa806 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.110751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21ad7-fe2f-4169-9e0b-f0aaa14fa806 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.111027 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21ad7-fe2f-4169-9e0b-f0aaa14fa806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.135955 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2bbe4-d464-4f99-a63e-136569f51635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.137093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2bbe4-d464-4f99-a63e-136569f51635 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.137236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2bbe4-d464-4f99-a63e-136569f51635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.137575 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2bbe4-d464-4f99-a63e-136569f51635 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.138979 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2bbe4-d464-4f99-a63e-136569f51635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.140356 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2bbe4-d464-4f99-a63e-136569f51635 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.151458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 797/1582] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:22.152084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2bbe4-d464-4f99-a63e-136569f51635 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.161877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2bbe4-d464-4f99-a63e-136569f51635 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.166614 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ec9ba-be8a-42ae-8497-31bc823bb007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.167268 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ec9ba-be8a-42ae-8497-31bc823bb007 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.167553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ec9ba-be8a-42ae-8497-31bc823bb007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.167830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ec9ba-be8a-42ae-8497-31bc823bb007 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.168598 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ec9ba-be8a-42ae-8497-31bc823bb007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.170676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ec9ba-be8a-42ae-8497-31bc823bb007 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.174812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa21ad7-fe2f-4169-9e0b-f0aaa14fa806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.176836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa21ad7-fe2f-4169-9e0b-f0aaa14fa806 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.187620 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 786/1583] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:22.188435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21ad7-fe2f-4169-9e0b-f0aaa14fa806 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.191681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 798/1584] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:31:22 2022] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:22.192637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ec9ba-be8a-42ae-8497-31bc823bb007 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.198629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21ad7-fe2f-4169-9e0b-f0aaa14fa806 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.204043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3591a-0a0b-4085-b3a0-5f3f5296166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.204457 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3591a-0a0b-4085-b3a0-5f3f5296166e admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.204743 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3591a-0a0b-4085-b3a0-5f3f5296166e admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.205118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3591a-0a0b-4085-b3a0-5f3f5296166e admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.205841 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3591a-0a0b-4085-b3a0-5f3f5296166e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.206063 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ec9ba-be8a-42ae-8497-31bc823bb007 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.208284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3591a-0a0b-4085-b3a0-5f3f5296166e admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.211555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c3391-d019-4fc5-822b-8ac6316bce78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.212233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c3391-d019-4fc5-822b-8ac6316bce78 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.212515 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c3391-d019-4fc5-822b-8ac6316bce78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.212792 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c3391-d019-4fc5-822b-8ac6316bce78 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.213489 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c3391-d019-4fc5-822b-8ac6316bce78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.215626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c3391-d019-4fc5-822b-8ac6316bce78 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.223230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 787/1585] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:22.223230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3591a-0a0b-4085-b3a0-5f3f5296166e admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.233826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3591a-0a0b-4085-b3a0-5f3f5296166e admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.238957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 799/1586] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:31:22 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:22.238957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c3391-d019-4fc5-822b-8ac6316bce78 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.243872 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981cfd8-c23c-4d0e-822b-854bb89367b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.244551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981cfd8-c23c-4d0e-822b-854bb89367b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.244832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981cfd8-c23c-4d0e-822b-854bb89367b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.245105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981cfd8-c23c-4d0e-822b-854bb89367b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.245830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981cfd8-c23c-4d0e-822b-854bb89367b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.247808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981cfd8-c23c-4d0e-822b-854bb89367b5 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.251764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c3391-d019-4fc5-822b-8ac6316bce78 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.254646 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13d2ae-38aa-4e36-adb7-5405b8afba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.255309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13d2ae-38aa-4e36-adb7-5405b8afba18 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.255936 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13d2ae-38aa-4e36-adb7-5405b8afba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.255936 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13d2ae-38aa-4e36-adb7-5405b8afba18 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.257559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13d2ae-38aa-4e36-adb7-5405b8afba18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.259511 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13d2ae-38aa-4e36-adb7-5405b8afba18 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.265083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 788/1587] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:22.265889 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981cfd8-c23c-4d0e-822b-854bb89367b5 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.279946 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981cfd8-c23c-4d0e-822b-854bb89367b5 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.281563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 800/1588] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:31:22 2022] POST /identity/v3/users => generated 283 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:22.282672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13d2ae-38aa-4e36-adb7-5405b8afba18 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.288235 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71023c4f-a6b4-4631-b861-ddd8e5b195ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.289009 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71023c4f-a6b4-4631-b861-ddd8e5b195ba admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.289321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71023c4f-a6b4-4631-b861-ddd8e5b195ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.289600 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71023c4f-a6b4-4631-b861-ddd8e5b195ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.290371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71023c4f-a6b4-4631-b861-ddd8e5b195ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.292337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71023c4f-a6b4-4631-b861-ddd8e5b195ba admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.293124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13d2ae-38aa-4e36-adb7-5405b8afba18 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.298268 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7932016-ff6f-4d32-936f-d805aa04f724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.298933 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7932016-ff6f-4d32-936f-d805aa04f724 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.299656 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7932016-ff6f-4d32-936f-d805aa04f724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.299962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7932016-ff6f-4d32-936f-d805aa04f724 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.300777 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7932016-ff6f-4d32-936f-d805aa04f724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.302619 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7932016-ff6f-4d32-936f-d805aa04f724 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.308237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 789/1589] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:22.308237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71023c4f-a6b4-4631-b861-ddd8e5b195ba admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.316657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 801/1590] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:22.316657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7932016-ff6f-4d32-936f-d805aa04f724 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.322096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71023c4f-a6b4-4631-b861-ddd8e5b195ba admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.324840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7932016-ff6f-4d32-936f-d805aa04f724 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.327676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b6c2d-0c7f-4b8a-bf9e-82374e761291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.328060 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b6c2d-0c7f-4b8a-bf9e-82374e761291 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.328357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b6c2d-0c7f-4b8a-bf9e-82374e761291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.328633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b6c2d-0c7f-4b8a-bf9e-82374e761291 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.329470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b6c2d-0c7f-4b8a-bf9e-82374e761291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.330357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85980af8-066e-4a55-9b9d-5c526d59c42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.331171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b6c2d-0c7f-4b8a-bf9e-82374e761291 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.331489 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85980af8-066e-4a55-9b9d-5c526d59c42c admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.331880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85980af8-066e-4a55-9b9d-5c526d59c42c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.332190 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85980af8-066e-4a55-9b9d-5c526d59c42c admin admin] PATH_INFO: `/v3/projects/71557cd0787042da9b8b5fd1d0e93fcf/users/5b1ec83a7b7546db943a3c1af3bdd2d9/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.342425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 790/1591] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:22.343098 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b6c2d-0c7f-4b8a-bf9e-82374e761291 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.349885 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85980af8-066e-4a55-9b9d-5c526d59c42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=71557cd0787042da9b8b5fd1d0e93fcf, user_id=5b1ec83a7b7546db943a3c1af3bdd2d9, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.352883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b6c2d-0c7f-4b8a-bf9e-82374e761291 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.353150 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85980af8-066e-4a55-9b9d-5c526d59c42c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.358529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731341b-fc6d-466c-807d-089f90459dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.359221 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731341b-fc6d-466c-807d-089f90459dba admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.359487 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731341b-fc6d-466c-807d-089f90459dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.359783 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731341b-fc6d-466c-807d-089f90459dba admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.360484 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731341b-fc6d-466c-807d-089f90459dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.362101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731341b-fc6d-466c-807d-089f90459dba admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.369112 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 802/1592] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:22 2022] PUT /identity/v3/projects/71557cd0787042da9b8b5fd1d0e93fcf/users/5b1ec83a7b7546db943a3c1af3bdd2d9/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:22.372736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85980af8-066e-4a55-9b9d-5c526d59c42c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.377641 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 791/1593] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:22.377641 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731341b-fc6d-466c-807d-089f90459dba admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.387506 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731341b-fc6d-466c-807d-089f90459dba admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.453895 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11336d-3fb3-41c1-90ef-82727013750c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.455081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11336d-3fb3-41c1-90ef-82727013750c admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.455081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11336d-3fb3-41c1-90ef-82727013750c admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.455502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11336d-3fb3-41c1-90ef-82727013750c admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.456163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11336d-3fb3-41c1-90ef-82727013750c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.457641 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11336d-3fb3-41c1-90ef-82727013750c admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.468429 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 792/1594] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:22.469255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11336d-3fb3-41c1-90ef-82727013750c admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.474258 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85980af8-066e-4a55-9b9d-5c526d59c42c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.479748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763105eb-d4b1-4831-a532-449ab354979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.480508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763105eb-d4b1-4831-a532-449ab354979e admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.480935 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11336d-3fb3-41c1-90ef-82727013750c admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.481056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763105eb-d4b1-4831-a532-449ab354979e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.481391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763105eb-d4b1-4831-a532-449ab354979e admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.482439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763105eb-d4b1-4831-a532-449ab354979e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.484167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763105eb-d4b1-4831-a532-449ab354979e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.485828 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38197611-2186-43aa-ac23-6d4eae8742ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.486717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38197611-2186-43aa-ac23-6d4eae8742ee admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.486863 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38197611-2186-43aa-ac23-6d4eae8742ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.487073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38197611-2186-43aa-ac23-6d4eae8742ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.487798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38197611-2186-43aa-ac23-6d4eae8742ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.489407 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38197611-2186-43aa-ac23-6d4eae8742ee admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.497487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 803/1595] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:22.498188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763105eb-d4b1-4831-a532-449ab354979e admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.502510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 793/1596] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:22.503540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38197611-2186-43aa-ac23-6d4eae8742ee admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.513790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38197611-2186-43aa-ac23-6d4eae8742ee admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.514340 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763105eb-d4b1-4831-a532-449ab354979e admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.518446 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e48baf-312b-426f-906c-dae538c96b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.519112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e48baf-312b-426f-906c-dae538c96b93 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.519376 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187bf38-2ec5-4436-b35c-fc197f2e3cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.519509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e48baf-312b-426f-906c-dae538c96b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.519676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e48baf-312b-426f-906c-dae538c96b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.520407 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e48baf-312b-426f-906c-dae538c96b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.520530 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187bf38-2ec5-4436-b35c-fc197f2e3cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.520789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187bf38-2ec5-4436-b35c-fc197f2e3cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.521154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187bf38-2ec5-4436-b35c-fc197f2e3cdc admin admin] PATH_INFO: `/v3/projects/e902ff797e8041adbb09bf827093a45a/users/16e9a3607dd147f3a332d0f357d46ed4/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.522043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e48baf-312b-426f-906c-dae538c96b93 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.534062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 794/1597] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:22.535395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac7a7-de95-42ea-8431-c7b2204f0979 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.535686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac7a7-de95-42ea-8431-c7b2204f0979 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.535965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac7a7-de95-42ea-8431-c7b2204f0979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.540592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187bf38-2ec5-4436-b35c-fc197f2e3cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e902ff797e8041adbb09bf827093a45a, user_id=16e9a3607dd147f3a332d0f357d46ed4, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.543480 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187bf38-2ec5-4436-b35c-fc197f2e3cdc admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.555233 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-6b0ac7a7-de95-42ea-8431-c7b2204f0979 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:22.556574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6b0ac7a7-de95-42ea-8431-c7b2204f0979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:22.560995 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 804/1598] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:22 2022] PUT /identity/v3/projects/e902ff797e8041adbb09bf827093a45a/users/16e9a3607dd147f3a332d0f357d46ed4/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:22.563048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187bf38-2ec5-4436-b35c-fc197f2e3cdc admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.634073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 795/1599] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:22.637108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac7a7-de95-42ea-8431-c7b2204f0979 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.640472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187bf38-2ec5-4436-b35c-fc197f2e3cdc admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.648286 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ef477-a13e-4907-b479-5c727eb5310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.649032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ef477-a13e-4907-b479-5c727eb5310b admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.649321 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ef477-a13e-4907-b479-5c727eb5310b admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.649602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ef477-a13e-4907-b479-5c727eb5310b admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.650651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ef477-a13e-4907-b479-5c727eb5310b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.652340 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ef477-a13e-4907-b479-5c727eb5310b admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.652693 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac7a7-de95-42ea-8431-c7b2204f0979 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.658451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451ad8d-6689-4cb3-a284-53b550494055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.659087 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451ad8d-6689-4cb3-a284-53b550494055 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.659371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451ad8d-6689-4cb3-a284-53b550494055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.659645 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451ad8d-6689-4cb3-a284-53b550494055 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.660369 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451ad8d-6689-4cb3-a284-53b550494055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.662242 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451ad8d-6689-4cb3-a284-53b550494055 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.668965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 805/1600] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:22.670146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ef477-a13e-4907-b479-5c727eb5310b admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.677967 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 796/1601] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:22.682311 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ef477-a13e-4907-b479-5c727eb5310b admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.683658 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451ad8d-6689-4cb3-a284-53b550494055 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.687600 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf7107-584d-421b-a14b-2900fbb65454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.688691 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf7107-584d-421b-a14b-2900fbb65454 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.689177 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf7107-584d-421b-a14b-2900fbb65454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.689604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf7107-584d-421b-a14b-2900fbb65454 admin admin] PATH_INFO: `/v3/projects/26268a71a0194a27bde23a2e53fea008/users/3cee1920156344dd9a73fe68c8771778/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.700515 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451ad8d-6689-4cb3-a284-53b550494055 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.707778 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44391b1c-7dea-4f78-b2b3-88309ea5f894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.708871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44391b1c-7dea-4f78-b2b3-88309ea5f894 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.709640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44391b1c-7dea-4f78-b2b3-88309ea5f894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.709640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44391b1c-7dea-4f78-b2b3-88309ea5f894 admin admin] PATH_INFO: `/v3/projects/1c0f2b9b46fb405a834f6b1e179f8bf8/users/4716dd7e4131445c823cef63cae49308/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.715951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf7107-584d-421b-a14b-2900fbb65454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26268a71a0194a27bde23a2e53fea008, user_id=3cee1920156344dd9a73fe68c8771778, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.718837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf7107-584d-421b-a14b-2900fbb65454 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.728816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44391b1c-7dea-4f78-b2b3-88309ea5f894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0f2b9b46fb405a834f6b1e179f8bf8, user_id=4716dd7e4131445c823cef63cae49308, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.731639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44391b1c-7dea-4f78-b2b3-88309ea5f894 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.738464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 806/1602] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:22 2022] PUT /identity/v3/projects/26268a71a0194a27bde23a2e53fea008/users/3cee1920156344dd9a73fe68c8771778/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:22.739203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf7107-584d-421b-a14b-2900fbb65454 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.756197 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 797/1603] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:22 2022] PUT /identity/v3/projects/1c0f2b9b46fb405a834f6b1e179f8bf8/users/4716dd7e4131445c823cef63cae49308/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:22.758589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb07c80-eba8-458b-a413-b5015c2c006f None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.759033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb07c80-eba8-458b-a413-b5015c2c006f None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.759474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb07c80-eba8-458b-a413-b5015c2c006f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.787028 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-0eb07c80-eba8-458b-a413-b5015c2c006f None None] MFA Rules not processed for user `16e9a3607dd147f3a332d0f357d46ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:22.788613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0eb07c80-eba8-458b-a413-b5015c2c006f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:22.809568 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf7107-584d-421b-a14b-2900fbb65454 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.858324 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 798/1604] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:22.859449 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb07c80-eba8-458b-a413-b5015c2c006f None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.877471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53258162-a151-4b5e-ae88-bb85b63c1ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.878411 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53258162-a151-4b5e-ae88-bb85b63c1ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.878697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53258162-a151-4b5e-ae88-bb85b63c1ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.878978 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53258162-a151-4b5e-ae88-bb85b63c1ebb admin admin] PATH_INFO: `/v3/projects/8c90a3a91c33407880ad6020ca05f267/users/e486c10649534700bc59d220bd272b42/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:22.896038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53258162-a151-4b5e-ae88-bb85b63c1ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c90a3a91c33407880ad6020ca05f267, user_id=e486c10649534700bc59d220bd272b42, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:22.899763 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53258162-a151-4b5e-ae88-bb85b63c1ebb admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:22.918011 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 807/1605] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:22 2022] PUT /identity/v3/projects/8c90a3a91c33407880ad6020ca05f267/users/e486c10649534700bc59d220bd272b42/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:22.919084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53258162-a151-4b5e-ae88-bb85b63c1ebb admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:22.932741 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb07c80-eba8-458b-a413-b5015c2c006f None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.986067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53258162-a151-4b5e-ae88-bb85b63c1ebb admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:22.991543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff719a-3e99-4b79-844c-8ab483895e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:22.993704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff719a-3e99-4b79-844c-8ab483895e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:22.993996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff719a-3e99-4b79-844c-8ab483895e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:22.994310 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff719a-3e99-4b79-844c-8ab483895e96 admin admin] PATH_INFO: `/v3/projects/bac3eb4351a74cebb3814d3cbb754f56/users/5998f94809ee4001b031b901a8fc39c2/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.009818 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff719a-3e99-4b79-844c-8ab483895e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac3eb4351a74cebb3814d3cbb754f56, user_id=5998f94809ee4001b031b901a8fc39c2, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:23.012897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff719a-3e99-4b79-844c-8ab483895e96 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:23.015455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be5ba9-c9db-4857-95f3-b3b0440efd1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:23.016187 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be5ba9-c9db-4857-95f3-b3b0440efd1c service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:23.016475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be5ba9-c9db-4857-95f3-b3b0440efd1c service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:23.017141 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be5ba9-c9db-4857-95f3-b3b0440efd1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.029439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be5ba9-c9db-4857-95f3-b3b0440efd1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:23.029827 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 808/1606] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:22 2022] PUT /identity/v3/projects/bac3eb4351a74cebb3814d3cbb754f56/users/5998f94809ee4001b031b901a8fc39c2/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:23.031422 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be5ba9-c9db-4857-95f3-b3b0440efd1c service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:23.034335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff719a-3e99-4b79-844c-8ab483895e96 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:23.044440 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 799/1607] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:23.045792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e356a6-fd08-4d04-b782-995aa5e5ec24 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:23.046148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e356a6-fd08-4d04-b782-995aa5e5ec24 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:23.046458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e356a6-fd08-4d04-b782-995aa5e5ec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.075328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-69e356a6-fd08-4d04-b782-995aa5e5ec24 None None] MFA Rules not processed for user `3cee1920156344dd9a73fe68c8771778`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:23.077030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-69e356a6-fd08-4d04-b782-995aa5e5ec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:23.130544 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff719a-3e99-4b79-844c-8ab483895e96 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:23.135852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72785980-f268-493a-8601-ffca03e5ac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:23.136862 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72785980-f268-493a-8601-ffca03e5ac6d admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:23.137254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72785980-f268-493a-8601-ffca03e5ac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:23.137597 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72785980-f268-493a-8601-ffca03e5ac6d admin admin] PATH_INFO: `/v3/projects/141b5a41e56a4c8c98b086d16ff1fcc2/users/9c41c380d48f4fa38aa6e8b4005ce3f2/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.154280 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72785980-f268-493a-8601-ffca03e5ac6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=141b5a41e56a4c8c98b086d16ff1fcc2, user_id=9c41c380d48f4fa38aa6e8b4005ce3f2, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:23.155221 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 800/1608] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:23.157099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72785980-f268-493a-8601-ffca03e5ac6d admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:23.160178 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124462-9413-4087-adb7-8d3c10cce184 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:23.160681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124462-9413-4087-adb7-8d3c10cce184 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:23.161036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124462-9413-4087-adb7-8d3c10cce184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.186586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 809/1609] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:23 2022] PUT /identity/v3/projects/141b5a41e56a4c8c98b086d16ff1fcc2/users/9c41c380d48f4fa38aa6e8b4005ce3f2/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:23.190336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b52b35-b6ff-4d16-93f3-504193abc106 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:23.190901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b52b35-b6ff-4d16-93f3-504193abc106 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:23.195361 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b52b35-b6ff-4d16-93f3-504193abc106 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.197294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 810/1610] 10.222.0.48 () {54 vars in 961 bytes} [Tue May 17 14:31:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:31:23.201993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-13124462-9413-4087-adb7-8d3c10cce184 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:23.203119 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968fb44-7a88-49ed-8551-37d899684b93 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:23.203510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-13124462-9413-4087-adb7-8d3c10cce184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:23.203762 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968fb44-7a88-49ed-8551-37d899684b93 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:23.204221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968fb44-7a88-49ed-8551-37d899684b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.239527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-6968fb44-7a88-49ed-8551-37d899684b93 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:23.244795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6968fb44-7a88-49ed-8551-37d899684b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:23.352724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 801/1611] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:23.354500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d79297-3a43-4cf8-8b89-44e8003bb5af None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:23.355128 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d79297-3a43-4cf8-8b89-44e8003bb5af None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:23.356225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d79297-3a43-4cf8-8b89-44e8003bb5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.372607 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 811/1612] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:23.373551 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968fb44-7a88-49ed-8551-37d899684b93 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:23.383700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968fb44-7a88-49ed-8551-37d899684b93 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:23.389019 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89758489-2f55-499f-bc60-ce539471ea8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:23.389884 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89758489-2f55-499f-bc60-ce539471ea8b admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:23.390290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89758489-2f55-499f-bc60-ce539471ea8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:23.390641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89758489-2f55-499f-bc60-ce539471ea8b admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.391460 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89758489-2f55-499f-bc60-ce539471ea8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:23.393773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89758489-2f55-499f-bc60-ce539471ea8b admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:23.407421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b3d79297-3a43-4cf8-8b89-44e8003bb5af None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:23.414801 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b3d79297-3a43-4cf8-8b89-44e8003bb5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:23.427664 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 802/1613] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:23.429248 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b7f67-8f9a-4f7b-80fa-0cd3ff44c40b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:23.429544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b7f67-8f9a-4f7b-80fa-0cd3ff44c40b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:23.429837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b7f67-8f9a-4f7b-80fa-0cd3ff44c40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.456567 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 812/1614] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:31:23 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:23.460372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0429b40-bd87-4822-9d69-4a08c63c1b93 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:23.462989 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0429b40-bd87-4822-9d69-4a08c63c1b93 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:23.463349 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0429b40-bd87-4822-9d69-4a08c63c1b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.502325 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-b0429b40-bd87-4822-9d69-4a08c63c1b93 None None] MFA Rules not processed for user `1f443d2ca1534249bb2c4096300ddffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:23.503857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-442b7f67-8f9a-4f7b-80fa-0cd3ff44c40b None None] MFA Rules not processed for user `9c41c380d48f4fa38aa6e8b4005ce3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:23.504583 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-442b7f67-8f9a-4f7b-80fa-0cd3ff44c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:23.508459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b0429b40-bd87-4822-9d69-4a08c63c1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:23.641449 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 813/1615] 10.222.0.48 () {58 vars in 1058 bytes} [Tue May 17 14:31:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:23.642439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0429b40-bd87-4822-9d69-4a08c63c1b93 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:23.681233 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 803/1616] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:23.694449 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b7f67-8f9a-4f7b-80fa-0cd3ff44c40b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:23.706362 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0429b40-bd87-4822-9d69-4a08c63c1b93 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:23.710891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a30cd-3ca7-4726-ab74-1adaebafde0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:23.711633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a30cd-3ca7-4726-ab74-1adaebafde0c service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:23.711992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a30cd-3ca7-4726-ab74-1adaebafde0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:23.712386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a30cd-3ca7-4726-ab74-1adaebafde0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.790586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b7f67-8f9a-4f7b-80fa-0cd3ff44c40b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:23.809296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a30cd-3ca7-4726-ab74-1adaebafde0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:23.810878 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a30cd-3ca7-4726-ab74-1adaebafde0c service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:23.821986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 814/1617] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:23.822910 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a30cd-3ca7-4726-ab74-1adaebafde0c service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:23.832732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a30cd-3ca7-4726-ab74-1adaebafde0c service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:23.836137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9f96b-64d7-40d4-b407-31101d565f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:23.837036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9f96b-64d7-40d4-b407-31101d565f8f service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:23.837548 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9f96b-64d7-40d4-b407-31101d565f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:23.837877 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9f96b-64d7-40d4-b407-31101d565f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.838004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162ffef-b392-4698-b21c-a46d36e8a59b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:23.838585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162ffef-b392-4698-b21c-a46d36e8a59b service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:23.838873 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162ffef-b392-4698-b21c-a46d36e8a59b service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:23.839154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162ffef-b392-4698-b21c-a46d36e8a59b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.849483 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162ffef-b392-4698-b21c-a46d36e8a59b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:23.851042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162ffef-b392-4698-b21c-a46d36e8a59b service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:23.860684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9f96b-64d7-40d4-b407-31101d565f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:23.862162 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9f96b-64d7-40d4-b407-31101d565f8f service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:23.862457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 815/1618] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:23.863291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162ffef-b392-4698-b21c-a46d36e8a59b service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:23.873800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162ffef-b392-4698-b21c-a46d36e8a59b service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:23.879806 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095fb33-4ca6-4db1-9dd4-c75c3d9fb7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:23.880708 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095fb33-4ca6-4db1-9dd4-c75c3d9fb7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:23.881002 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095fb33-4ca6-4db1-9dd4-c75c3d9fb7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:23.881755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095fb33-4ca6-4db1-9dd4-c75c3d9fb7e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.882277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095fb33-4ca6-4db1-9dd4-c75c3d9fb7e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:23.884322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095fb33-4ca6-4db1-9dd4-c75c3d9fb7e2 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:23.888176 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 804/1619] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:23.889271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9f96b-64d7-40d4-b407-31101d565f8f service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:23.904986 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9f96b-64d7-40d4-b407-31101d565f8f service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:23.909792 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 816/1620] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:31:23 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:23.910989 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095fb33-4ca6-4db1-9dd4-c75c3d9fb7e2 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:23.914766 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc57ef-9a0d-4336-83a1-c09361277bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:23.915859 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc57ef-9a0d-4336-83a1-c09361277bde service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:23.916365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc57ef-9a0d-4336-83a1-c09361277bde service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:23.916660 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc57ef-9a0d-4336-83a1-c09361277bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:23.997823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095fb33-4ca6-4db1-9dd4-c75c3d9fb7e2 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:24.007965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c867a34-bcdc-4393-b84a-6155099beb0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:24.008648 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c867a34-bcdc-4393-b84a-6155099beb0d service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:24.009848 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc57ef-9a0d-4336-83a1-c09361277bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:24.010502 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c867a34-bcdc-4393-b84a-6155099beb0d service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:24.010791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c867a34-bcdc-4393-b84a-6155099beb0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:24.012457 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc57ef-9a0d-4336-83a1-c09361277bde service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:24.026198 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 805/1621] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:24.027469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc57ef-9a0d-4336-83a1-c09361277bde service nova] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:24.036113 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c867a34-bcdc-4393-b84a-6155099beb0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:24.041229 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c867a34-bcdc-4393-b84a-6155099beb0d service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:24.042929 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc57ef-9a0d-4336-83a1-c09361277bde service nova] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:24.049997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09961dfa-e4a2-4233-95cc-1291317ff1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:24.051193 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09961dfa-e4a2-4233-95cc-1291317ff1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:24.052729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09961dfa-e4a2-4233-95cc-1291317ff1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:24.053303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09961dfa-e4a2-4233-95cc-1291317ff1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:24.054774 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09961dfa-e4a2-4233-95cc-1291317ff1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:24.054954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 817/1622] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:24.056919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09961dfa-e4a2-4233-95cc-1291317ff1c7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:24.075852 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 806/1623] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:24.079948 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c867a34-bcdc-4393-b84a-6155099beb0d service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:24.096118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c867a34-bcdc-4393-b84a-6155099beb0d service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:24.114427 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae09c0-4f35-4cf7-a913-96053427811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:24.117747 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae09c0-4f35-4cf7-a913-96053427811c admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:24.117985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae09c0-4f35-4cf7-a913-96053427811c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:24.119487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae09c0-4f35-4cf7-a913-96053427811c admin admin] PATH_INFO: `/v3/projects/deb54e14df24431ba279fc3490f1448c/users/0e237565dc074c87a17c76c0934f0381/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:24.155756 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae09c0-4f35-4cf7-a913-96053427811c admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb54e14df24431ba279fc3490f1448c, user_id=0e237565dc074c87a17c76c0934f0381, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:24.160329 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae09c0-4f35-4cf7-a913-96053427811c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:24.200459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 818/1624] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:24 2022] PUT /identity/v3/projects/deb54e14df24431ba279fc3490f1448c/users/0e237565dc074c87a17c76c0934f0381/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:24.201653 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09961dfa-e4a2-4233-95cc-1291317ff1c7 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:24.215602 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09961dfa-e4a2-4233-95cc-1291317ff1c7 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:24.341823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919f76f-8669-4ca2-961d-c41e3354689e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:24.343296 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919f76f-8669-4ca2-961d-c41e3354689e admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:24.343888 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919f76f-8669-4ca2-961d-c41e3354689e admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:24.344371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919f76f-8669-4ca2-961d-c41e3354689e admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:24.345490 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919f76f-8669-4ca2-961d-c41e3354689e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:24.347587 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919f76f-8669-4ca2-961d-c41e3354689e admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:24.379441 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 807/1625] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:31:24.384248 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae09c0-4f35-4cf7-a913-96053427811c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:24.400090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae09c0-4f35-4cf7-a913-96053427811c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:24.405922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a721f5c-44bb-4d96-80c2-6f40e029157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:24.407118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a721f5c-44bb-4d96-80c2-6f40e029157a admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:24.407589 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a721f5c-44bb-4d96-80c2-6f40e029157a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:24.408140 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a721f5c-44bb-4d96-80c2-6f40e029157a admin admin] PATH_INFO: `/v3/projects/deb54e14df24431ba279fc3490f1448c/users/0e237565dc074c87a17c76c0934f0381/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:24.414218 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a721f5c-44bb-4d96-80c2-6f40e029157a admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb54e14df24431ba279fc3490f1448c, user_id=0e237565dc074c87a17c76c0934f0381, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:24.418075 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a721f5c-44bb-4d96-80c2-6f40e029157a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:24.454728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821efdca-81ee-4930-96e0-a2e1b929c05e None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:24.455163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821efdca-81ee-4930-96e0-a2e1b929c05e None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:24.455571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821efdca-81ee-4930-96e0-a2e1b929c05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:24.467675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 819/1626] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:24 2022] PUT /identity/v3/projects/deb54e14df24431ba279fc3490f1448c/users/0e237565dc074c87a17c76c0934f0381/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:24.511569 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-821efdca-81ee-4930-96e0-a2e1b929c05e None None] MFA Rules not processed for user `0e237565dc074c87a17c76c0934f0381`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:24.513886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-821efdca-81ee-4930-96e0-a2e1b929c05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:24.550151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9996cb-b08a-4d4f-ba9b-fe365b2ee600 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:24.550491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9996cb-b08a-4d4f-ba9b-fe365b2ee600 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:24.550824 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9996cb-b08a-4d4f-ba9b-fe365b2ee600 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:24.552871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 820/1627] 10.222.0.48 () {54 vars in 912 bytes} [Tue May 17 14:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:31:24.560725 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f2b12-69df-456d-bea1-8f29ce25d60c None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:24.561033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f2b12-69df-456d-bea1-8f29ce25d60c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:24.561319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f2b12-69df-456d-bea1-8f29ce25d60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:24.595293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-008f2b12-69df-456d-bea1-8f29ce25d60c None None] MFA Rules not processed for user `1f443d2ca1534249bb2c4096300ddffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:24.596803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-008f2b12-69df-456d-bea1-8f29ce25d60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:24.645557 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 808/1628] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:31:24.655821 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821efdca-81ee-4930-96e0-a2e1b929c05e None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:24.734255 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 821/1629] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:31:24.846740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821efdca-81ee-4930-96e0-a2e1b929c05e None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:24.851504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec42220-c355-42bf-8262-22b92d8320ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:24.852530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec42220-c355-42bf-8262-22b92d8320ed service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:24.852951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec42220-c355-42bf-8262-22b92d8320ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:24.853384 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec42220-c355-42bf-8262-22b92d8320ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:24.865420 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec42220-c355-42bf-8262-22b92d8320ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:24.868239 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec42220-c355-42bf-8262-22b92d8320ed service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:24.917100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 809/1630] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:31:25.032041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f2b12-69df-456d-bea1-8f29ce25d60c None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:25.043304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f2b12-69df-456d-bea1-8f29ce25d60c None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:25.049318 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487df0c-d6ec-4c57-bbae-73e6c16f22a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:25.050596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487df0c-d6ec-4c57-bbae-73e6c16f22a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:25.050942 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487df0c-d6ec-4c57-bbae-73e6c16f22a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:25.051481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487df0c-d6ec-4c57-bbae-73e6c16f22a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:25.096665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487df0c-d6ec-4c57-bbae-73e6c16f22a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:25.099435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487df0c-d6ec-4c57-bbae-73e6c16f22a2 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:25.130603 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 822/1631] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:25.263023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec42220-c355-42bf-8262-22b92d8320ed service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:25.273499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec42220-c355-42bf-8262-22b92d8320ed service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:25.279759 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2302808-5c9a-4dd5-b1f8-f6bd9c7ec3b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:25.280488 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2302808-5c9a-4dd5-b1f8-f6bd9c7ec3b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:25.280772 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2302808-5c9a-4dd5-b1f8-f6bd9c7ec3b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:25.281043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2302808-5c9a-4dd5-b1f8-f6bd9c7ec3b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:25.384324 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2302808-5c9a-4dd5-b1f8-f6bd9c7ec3b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:25.386001 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2302808-5c9a-4dd5-b1f8-f6bd9c7ec3b2 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:25.405397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 810/1632] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:26.782955 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983087fb-7852-46cc-a686-33e9372b6b28 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:26.784047 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983087fb-7852-46cc-a686-33e9372b6b28 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:26.784534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983087fb-7852-46cc-a686-33e9372b6b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:26.824907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7cc99-63d8-48f9-b2a9-c8bf0513963d None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:26.825544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7cc99-63d8-48f9-b2a9-c8bf0513963d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:26.825544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7cc99-63d8-48f9-b2a9-c8bf0513963d None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:26.827599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 811/1633] 10.222.0.48 () {54 vars in 961 bytes} [Tue May 17 14:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:31:26.833137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbc06a-8ffc-49a1-ab20-c3b114584611 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:26.833359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbc06a-8ffc-49a1-ab20-c3b114584611 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:26.833479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbc06a-8ffc-49a1-ab20-c3b114584611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:26.838348 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-983087fb-7852-46cc-a686-33e9372b6b28 None None] MFA Rules not processed for user `e486c10649534700bc59d220bd272b42`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:26.843136 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-983087fb-7852-46cc-a686-33e9372b6b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:26.854333 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-45fbc06a-8ffc-49a1-ab20-c3b114584611 None None] MFA Rules not processed for user `1f443d2ca1534249bb2c4096300ddffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:26.855626 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-45fbc06a-8ffc-49a1-ab20-c3b114584611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:26.871118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 812/1634] 10.222.0.48 () {58 vars in 1058 bytes} [Tue May 17 14:31:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:26.872847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220db0d-4114-4335-a504-4b6045b2944c None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:26.872966 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220db0d-4114-4335-a504-4b6045b2944c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:26.873498 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220db0d-4114-4335-a504-4b6045b2944c None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:26.874957 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 813/1635] 10.222.0.48 () {54 vars in 912 bytes} [Tue May 17 14:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:31:26.880716 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7553a2-3847-48a2-a87c-34bae9c78b53 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:26.881669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7553a2-3847-48a2-a87c-34bae9c78b53 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:26.881669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7553a2-3847-48a2-a87c-34bae9c78b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:26.924941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-ae7553a2-3847-48a2-a87c-34bae9c78b53 None None] MFA Rules not processed for user `1f443d2ca1534249bb2c4096300ddffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:26.926330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ae7553a2-3847-48a2-a87c-34bae9c78b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:26.952531 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 814/1636] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 14:31:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:26.967464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7553a2-3847-48a2-a87c-34bae9c78b53 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:26.990588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7553a2-3847-48a2-a87c-34bae9c78b53 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:27.012649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 823/1637] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:27.013316 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f219cc-464d-49e9-819f-ef2a83f150b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:27.014240 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f219cc-464d-49e9-819f-ef2a83f150b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:27.014683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f219cc-464d-49e9-819f-ef2a83f150b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:27.015115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f219cc-464d-49e9-819f-ef2a83f150b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:27.025360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2753bb-2690-4aae-9b68-0037b62465ff None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:27.025911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2753bb-2690-4aae-9b68-0037b62465ff None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:27.026386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2753bb-2690-4aae-9b68-0037b62465ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:27.051048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f219cc-464d-49e9-819f-ef2a83f150b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:27.052712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f219cc-464d-49e9-819f-ef2a83f150b5 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:27.062959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-2b2753bb-2690-4aae-9b68-0037b62465ff None None] MFA Rules not processed for user `e486c10649534700bc59d220bd272b42`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:27.064195 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2b2753bb-2690-4aae-9b68-0037b62465ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:27.081447 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 824/1638] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:27.086059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 815/1639] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:31:27.102684 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2753bb-2690-4aae-9b68-0037b62465ff None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:27.123839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2753bb-2690-4aae-9b68-0037b62465ff None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:27.139500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ac05c-598c-4f6a-b965-bc128034999a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:27.140445 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ac05c-598c-4f6a-b965-bc128034999a service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:27.140881 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ac05c-598c-4f6a-b965-bc128034999a service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:27.141303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ac05c-598c-4f6a-b965-bc128034999a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:27.157251 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ac05c-598c-4f6a-b965-bc128034999a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:27.159187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ac05c-598c-4f6a-b965-bc128034999a service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:27.190042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 825/1640] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:28.280830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf981c-be97-451e-b470-83cc2fd99ccb None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:28.281813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf981c-be97-451e-b470-83cc2fd99ccb None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:28.282308 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf981c-be97-451e-b470-83cc2fd99ccb None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:28.284437 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 816/1641] 10.222.0.48 () {54 vars in 912 bytes} [Tue May 17 14:31:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:31:28.290630 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350e90b-4011-4609-8ed4-a6b1c00e5f40 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:28.291180 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350e90b-4011-4609-8ed4-a6b1c00e5f40 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:28.291180 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350e90b-4011-4609-8ed4-a6b1c00e5f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:28.348206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-1350e90b-4011-4609-8ed4-a6b1c00e5f40 None None] MFA Rules not processed for user `7b03ca44da654c3a9a5d9762b8eee189`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:28.352115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-1350e90b-4011-4609-8ed4-a6b1c00e5f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:28.439335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 826/1642] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:28.466242 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf981c-be97-451e-b470-83cc2fd99ccb None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:28.484373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf981c-be97-451e-b470-83cc2fd99ccb None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:28.497887 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f4bd6-febe-4d78-b44d-d9e5a87c7ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:28.498592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f4bd6-febe-4d78-b44d-d9e5a87c7ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:28.499105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f4bd6-febe-4d78-b44d-d9e5a87c7ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:28.499557 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f4bd6-febe-4d78-b44d-d9e5a87c7ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:28.516148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f4bd6-febe-4d78-b44d-d9e5a87c7ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:28.517960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f4bd6-febe-4d78-b44d-d9e5a87c7ef5 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:28.532998 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 817/1643] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:30.026112 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16966b6a-4f8e-4aed-a548-24b335f93e69 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:30.027179 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16966b6a-4f8e-4aed-a548-24b335f93e69 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:30.027626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16966b6a-4f8e-4aed-a548-24b335f93e69 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:30.029378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 827/1644] 10.222.0.48 () {54 vars in 960 bytes} [Tue May 17 14:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:31:30.054128 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3e964-1541-4669-bad0-053a992686b0 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:30.054678 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3e964-1541-4669-bad0-053a992686b0 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:30.054779 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3e964-1541-4669-bad0-053a992686b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:30.124284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-8ea3e964-1541-4669-bad0-053a992686b0 None None] MFA Rules not processed for user `fad90f42ebfe43eb8256611a88df87ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:30.129286 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-8ea3e964-1541-4669-bad0-053a992686b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:30.361729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 818/1645] 10.222.0.48 () {58 vars in 1057 bytes} [Tue May 17 14:31:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:30.370983 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16966b6a-4f8e-4aed-a548-24b335f93e69 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:30.389178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16966b6a-4f8e-4aed-a548-24b335f93e69 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:30.431820 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022b552-ddf4-46b4-b5e4-4e67e298c6a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fad90f42ebfe43eb8256611a88df87ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:30.435035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022b552-ddf4-46b4-b5e4-4e67e298c6a4 service placement] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:30.437327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022b552-ddf4-46b4-b5e4-4e67e298c6a4 service placement] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:30.437902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022b552-ddf4-46b4-b5e4-4e67e298c6a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:30.441747 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-d022b552-ddf4-46b4-b5e4-4e67e298c6a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:30.474608 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022b552-ddf4-46b4-b5e4-4e67e298c6a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:30.476532 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022b552-ddf4-46b4-b5e4-4e67e298c6a4 service placement] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:30.497529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 828/1646] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:31:32.537957 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311045c3-269c-4311-bbe3-1f6f3c6d0c63 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:32.539119 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311045c3-269c-4311-bbe3-1f6f3c6d0c63 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:32.539613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311045c3-269c-4311-bbe3-1f6f3c6d0c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:32.618507 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-311045c3-269c-4311-bbe3-1f6f3c6d0c63 None None] MFA Rules not processed for user `357500181e4a43de8b1326d3db0b6f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:32.619782 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-311045c3-269c-4311-bbe3-1f6f3c6d0c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:32.803734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 819/1647] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:32.821333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022b552-ddf4-46b4-b5e4-4e67e298c6a4 service placement] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:32.852933 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022b552-ddf4-46b4-b5e4-4e67e298c6a4 service placement] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:32.877310 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e1772-0f4f-425a-93f4-1c6f2604e38a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:32.877974 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e1772-0f4f-425a-93f4-1c6f2604e38a service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:32.878585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e1772-0f4f-425a-93f4-1c6f2604e38a service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:32.878899 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e1772-0f4f-425a-93f4-1c6f2604e38a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:32.918216 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e1772-0f4f-425a-93f4-1c6f2604e38a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:32.921888 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e1772-0f4f-425a-93f4-1c6f2604e38a service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:32.943141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 829/1648] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:36.308642 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d5c01-6f69-4346-a233-fb9ffb4dd568 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:36.309153 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d5c01-6f69-4346-a233-fb9ffb4dd568 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:36.309516 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d5c01-6f69-4346-a233-fb9ffb4dd568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:36.395071 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-d27d5c01-6f69-4346-a233-fb9ffb4dd568 None None] MFA Rules not processed for user `5b1ec83a7b7546db943a3c1af3bdd2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:36.397034 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d27d5c01-6f69-4346-a233-fb9ffb4dd568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:36.644211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 820/1649] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:36.655724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b46c4-59f6-4a09-8561-0182ae28d50c None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:36.656264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b46c4-59f6-4a09-8561-0182ae28d50c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:36.656333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b46c4-59f6-4a09-8561-0182ae28d50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:36.707435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-447b46c4-59f6-4a09-8561-0182ae28d50c None None] MFA Rules not processed for user `5b1ec83a7b7546db943a3c1af3bdd2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:36.708929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-447b46c4-59f6-4a09-8561-0182ae28d50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:36.724155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 830/1650] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:36.732521 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d5c01-6f69-4346-a233-fb9ffb4dd568 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:36.761332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d5c01-6f69-4346-a233-fb9ffb4dd568 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:36.774194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297f1f5-0a32-4bbe-b543-0662e71c99c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:36.775037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297f1f5-0a32-4bbe-b543-0662e71c99c2 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:36.776618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297f1f5-0a32-4bbe-b543-0662e71c99c2 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:36.777102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297f1f5-0a32-4bbe-b543-0662e71c99c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:36.811340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297f1f5-0a32-4bbe-b543-0662e71c99c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:36.813868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297f1f5-0a32-4bbe-b543-0662e71c99c2 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:36.861392 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 821/1651] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:37.566788 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecda485-bb2f-42a0-bf66-7356a0eb1025 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:37.567024 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecda485-bb2f-42a0-bf66-7356a0eb1025 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:37.567304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecda485-bb2f-42a0-bf66-7356a0eb1025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:37.629108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-8ecda485-bb2f-42a0-bf66-7356a0eb1025 None None] MFA Rules not processed for user `5998f94809ee4001b031b901a8fc39c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:37.633069 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-8ecda485-bb2f-42a0-bf66-7356a0eb1025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:37.760015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a06e43-ea7e-40de-adad-9aa789139884 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:37.760502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a06e43-ea7e-40de-adad-9aa789139884 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:37.760574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a06e43-ea7e-40de-adad-9aa789139884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:37.783470 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 831/1652] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:37.799289 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecda485-bb2f-42a0-bf66-7356a0eb1025 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:37.823361 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecda485-bb2f-42a0-bf66-7356a0eb1025 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:37.848240 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-d6a06e43-ea7e-40de-adad-9aa789139884 None None] MFA Rules not processed for user `4716dd7e4131445c823cef63cae49308`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:37.849641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e928410-112e-48f5-bce8-5109ff8acfb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:37.850732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e928410-112e-48f5-bce8-5109ff8acfb0 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:37.851569 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e928410-112e-48f5-bce8-5109ff8acfb0 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:37.851569 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e928410-112e-48f5-bce8-5109ff8acfb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:37.856551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d6a06e43-ea7e-40de-adad-9aa789139884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:37.868517 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e928410-112e-48f5-bce8-5109ff8acfb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:37.870266 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e928410-112e-48f5-bce8-5109ff8acfb0 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:37.894937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 832/1653] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:37.897019 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa8a94-edc2-41f2-a58d-6219d854d8c4 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:37.897532 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa8a94-edc2-41f2-a58d-6219d854d8c4 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:37.897532 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa8a94-edc2-41f2-a58d-6219d854d8c4 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:37.899408 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 833/1654] 10.222.0.48 () {54 vars in 912 bytes} [Tue May 17 14:31:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:31:37.905346 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab3244-fc55-4e81-92ba-d56a3025d98d None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:37.906077 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab3244-fc55-4e81-92ba-d56a3025d98d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:37.906701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab3244-fc55-4e81-92ba-d56a3025d98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:37.979005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-f7ab3244-fc55-4e81-92ba-d56a3025d98d None None] MFA Rules not processed for user `7b03ca44da654c3a9a5d9762b8eee189`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:37.980361 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f7ab3244-fc55-4e81-92ba-d56a3025d98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:38.011756 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 822/1655] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:38.015375 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 834/1656] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 14:31:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:38.038494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a06e43-ea7e-40de-adad-9aa789139884 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:38.056556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a06e43-ea7e-40de-adad-9aa789139884 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:38.064956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f017ab1-38f3-4d8c-90ef-119bb4cb03a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:38.068974 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f017ab1-38f3-4d8c-90ef-119bb4cb03a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:38.069706 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f017ab1-38f3-4d8c-90ef-119bb4cb03a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:38.074055 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f017ab1-38f3-4d8c-90ef-119bb4cb03a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:38.111540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f017ab1-38f3-4d8c-90ef-119bb4cb03a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:38.117514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f017ab1-38f3-4d8c-90ef-119bb4cb03a8 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:38.157956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 823/1657] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:38.183199 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab3244-fc55-4e81-92ba-d56a3025d98d None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:38.215115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab3244-fc55-4e81-92ba-d56a3025d98d None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:38.236553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93389f-a1e3-43bf-a334-981d56270e26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:38.237588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93389f-a1e3-43bf-a334-981d56270e26 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:38.238053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93389f-a1e3-43bf-a334-981d56270e26 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:38.238562 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93389f-a1e3-43bf-a334-981d56270e26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:38.259003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93389f-a1e3-43bf-a334-981d56270e26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:38.260940 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93389f-a1e3-43bf-a334-981d56270e26 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:38.284390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 835/1658] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:39.145993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be1b15-40aa-459b-82c6-62b604fff40d None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:39.147298 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be1b15-40aa-459b-82c6-62b604fff40d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:39.147821 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be1b15-40aa-459b-82c6-62b604fff40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:39.195372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-25be1b15-40aa-459b-82c6-62b604fff40d None None] MFA Rules not processed for user `357500181e4a43de8b1326d3db0b6f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:39.207579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-25be1b15-40aa-459b-82c6-62b604fff40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:39.235302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 824/1659] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:39.401661 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19e520-b07d-4f57-a7ea-e40a9295acdb None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:39.402658 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19e520-b07d-4f57-a7ea-e40a9295acdb None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:39.403148 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19e520-b07d-4f57-a7ea-e40a9295acdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:39.433400 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-7a19e520-b07d-4f57-a7ea-e40a9295acdb None None] MFA Rules not processed for user `5b1ec83a7b7546db943a3c1af3bdd2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:39.442093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7a19e520-b07d-4f57-a7ea-e40a9295acdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:39.461264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 836/1660] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:40.164589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0f030-6d53-447c-ab4f-309c55a6531f None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:40.165464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0f030-6d53-447c-ab4f-309c55a6531f None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:40.165898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0f030-6d53-447c-ab4f-309c55a6531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:40.229000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-e1c0f030-6d53-447c-ab4f-309c55a6531f None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:40.230271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e1c0f030-6d53-447c-ab4f-309c55a6531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:40.407033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 825/1661] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 14:31:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:31:40.574091 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19e520-b07d-4f57-a7ea-e40a9295acdb None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:40.581036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7a19e520-b07d-4f57-a7ea-e40a9295acdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:40.765389 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19e520-b07d-4f57-a7ea-e40a9295acdb None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:40.780277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f871fd-b6bd-4d8e-824f-ab68dad80ab9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:40.780959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f871fd-b6bd-4d8e-824f-ab68dad80ab9 service swift] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:40.781228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f871fd-b6bd-4d8e-824f-ab68dad80ab9 service swift] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:40.783685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f871fd-b6bd-4d8e-824f-ab68dad80ab9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:40.811166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f871fd-b6bd-4d8e-824f-ab68dad80ab9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:40.813981 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f871fd-b6bd-4d8e-824f-ab68dad80ab9 service swift] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:40.838843 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 837/1662] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:31:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:31:44.287357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0f030-6d53-447c-ab4f-309c55a6531f None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:44.508370 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0f030-6d53-447c-ab4f-309c55a6531f None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:44.518229 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2434f-fec1-4fda-896d-ce62df6660a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:44.520979 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2434f-fec1-4fda-896d-ce62df6660a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:44.521597 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2434f-fec1-4fda-896d-ce62df6660a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:44.522518 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2434f-fec1-4fda-896d-ce62df6660a1 admin admin] PATH_INFO: `/v3/users/16e9a3607dd147f3a332d0f357d46ed4` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:44.525312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2434f-fec1-4fda-896d-ce62df6660a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e9a3607dd147f3a332d0f357d46ed4)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:44.526388 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: WARNING py.warnings [None req-daa2434f-fec1-4fda-896d-ce62df6660a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 14:31:44.526388 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: warnings.warn(msg) May 17 14:31:44.526388 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: May 17 14:31:44.527621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2434f-fec1-4fda-896d-ce62df6660a1 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:44.744315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-daa2434f-fec1-4fda-896d-ce62df6660a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e9a3607dd147f3a332d0f357d46ed4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:44.855390 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-daa2434f-fec1-4fda-896d-ce62df6660a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e9a3607dd147f3a332d0f357d46ed4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:44.859536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-daa2434f-fec1-4fda-896d-ce62df6660a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e9a3607dd147f3a332d0f357d46ed4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:44.938408 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-daa2434f-fec1-4fda-896d-ce62df6660a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e9a3607dd147f3a332d0f357d46ed4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:44.956974 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-daa2434f-fec1-4fda-896d-ce62df6660a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e9a3607dd147f3a332d0f357d46ed4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:45.014589 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e12dd-0814-47c6-89d9-714ec9d86af1 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:45.015164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e12dd-0814-47c6-89d9-714ec9d86af1 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:45.015164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e12dd-0814-47c6-89d9-714ec9d86af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:45.022309 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 826/1663] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:31:44 2022] DELETE /identity/v3/users/16e9a3607dd147f3a332d0f357d46ed4 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:45.029069 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37dd2a-d3e7-489d-8448-deaaf7ac25ac None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:45.033708 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37dd2a-d3e7-489d-8448-deaaf7ac25ac None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:45.035057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37dd2a-d3e7-489d-8448-deaaf7ac25ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:45.097845 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-995e12dd-0814-47c6-89d9-714ec9d86af1 None None] MFA Rules not processed for user `7b03ca44da654c3a9a5d9762b8eee189`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:45.100748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-995e12dd-0814-47c6-89d9-714ec9d86af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:45.150701 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-cc37dd2a-d3e7-489d-8448-deaaf7ac25ac None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:45.174084 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-cc37dd2a-d3e7-489d-8448-deaaf7ac25ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:45.317018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 838/1664] 10.222.0.74 () {58 vars in 1015 bytes} [Tue May 17 14:31:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:45.511132 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 827/1665] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:45.541818 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e12dd-0814-47c6-89d9-714ec9d86af1 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:45.543319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-995e12dd-0814-47c6-89d9-714ec9d86af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:45.565136 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e12dd-0814-47c6-89d9-714ec9d86af1 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:45.578197 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b3e5d-e951-4bfc-8d05-7f06cff8c629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:45.578794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b3e5d-e951-4bfc-8d05-7f06cff8c629 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:45.579082 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b3e5d-e951-4bfc-8d05-7f06cff8c629 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:45.579359 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b3e5d-e951-4bfc-8d05-7f06cff8c629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:45.606815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b3e5d-e951-4bfc-8d05-7f06cff8c629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:45.608318 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b3e5d-e951-4bfc-8d05-7f06cff8c629 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:45.615813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37dd2a-d3e7-489d-8448-deaaf7ac25ac None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:45.627927 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37dd2a-d3e7-489d-8448-deaaf7ac25ac None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:45.639659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 839/1666] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:45.640558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b209e-e685-4253-b362-bb70e84cabcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:45.641210 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b209e-e685-4253-b362-bb70e84cabcd service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:45.641503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b209e-e685-4253-b362-bb70e84cabcd service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:45.641780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b209e-e685-4253-b362-bb70e84cabcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:45.666686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b209e-e685-4253-b362-bb70e84cabcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:45.668219 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b209e-e685-4253-b362-bb70e84cabcd service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:45.705111 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 828/1667] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:48.505071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3dd41-025d-4f55-986a-e0e087ac91db None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:48.506566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3dd41-025d-4f55-986a-e0e087ac91db None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:48.507131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3dd41-025d-4f55-986a-e0e087ac91db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:48.535103 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c1c3dd41-025d-4f55-986a-e0e087ac91db None None] MFA Rules not processed for user `5998f94809ee4001b031b901a8fc39c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:48.536767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c1c3dd41-025d-4f55-986a-e0e087ac91db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:48.729387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 840/1668] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:50.504015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b209e-e685-4253-b362-bb70e84cabcd service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:50.506790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ba4b209e-e685-4253-b362-bb70e84cabcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:50.569358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b209e-e685-4253-b362-bb70e84cabcd service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:50.610432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314c30d-ebd4-4e9c-bc43-e55d5616a56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:50.611390 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314c30d-ebd4-4e9c-bc43-e55d5616a56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:50.611707 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314c30d-ebd4-4e9c-bc43-e55d5616a56f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:50.612018 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314c30d-ebd4-4e9c-bc43-e55d5616a56f admin admin] PATH_INFO: `/v3/users/9c41c380d48f4fa38aa6e8b4005ce3f2` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:50.623959 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314c30d-ebd4-4e9c-bc43-e55d5616a56f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c41c380d48f4fa38aa6e8b4005ce3f2)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:50.650282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314c30d-ebd4-4e9c-bc43-e55d5616a56f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:50.880730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f314c30d-ebd4-4e9c-bc43-e55d5616a56f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c41c380d48f4fa38aa6e8b4005ce3f2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:50.910429 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f314c30d-ebd4-4e9c-bc43-e55d5616a56f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c41c380d48f4fa38aa6e8b4005ce3f2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:50.915291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f314c30d-ebd4-4e9c-bc43-e55d5616a56f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c41c380d48f4fa38aa6e8b4005ce3f2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:50.965320 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f314c30d-ebd4-4e9c-bc43-e55d5616a56f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c41c380d48f4fa38aa6e8b4005ce3f2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:50.994464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f314c30d-ebd4-4e9c-bc43-e55d5616a56f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c41c380d48f4fa38aa6e8b4005ce3f2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:51.016999 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 829/1669] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:31:50 2022] DELETE /identity/v3/users/9c41c380d48f4fa38aa6e8b4005ce3f2 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:51.022211 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428250-b836-4403-862c-9108f72e783b None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:51.022711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428250-b836-4403-862c-9108f72e783b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:51.022888 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428250-b836-4403-862c-9108f72e783b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:51.072192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-7a428250-b836-4403-862c-9108f72e783b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:51.073530 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7a428250-b836-4403-862c-9108f72e783b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:51.155988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe877e-2407-4717-98b6-62618758c1c7 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:51.156271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe877e-2407-4717-98b6-62618758c1c7 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:51.156768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe877e-2407-4717-98b6-62618758c1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:51.255023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-19fe877e-2407-4717-98b6-62618758c1c7 None None] MFA Rules not processed for user `4716dd7e4131445c823cef63cae49308`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:51.271597 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-19fe877e-2407-4717-98b6-62618758c1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:51.496677 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 841/1670] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:51.656754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a428250-b836-4403-862c-9108f72e783b None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:51.664812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7a428250-b836-4403-862c-9108f72e783b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:51.692265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a428250-b836-4403-862c-9108f72e783b None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:51.718966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:51.722218 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:51.722802 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:51.724604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] PATH_INFO: `/v3/projects/e902ff797e8041adbb09bf827093a45a` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:51.729270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e902ff797e8041adbb09bf827093a45a)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:51.730701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: WARNING py.warnings [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 14:31:51.730701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: warnings.warn(msg) May 17 14:31:51.730701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: May 17 14:31:51.734378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:51.900784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e902ff797e8041adbb09bf827093a45a', 'request_id': 'req-f443a6cf-3084-45ab-bc3b-43466cef8c02'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:51.945090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e902ff797e8041adbb09bf827093a45a', 'request_id': 'req-f443a6cf-3084-45ab-bc3b-43466cef8c02'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:51.970432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e902ff797e8041adbb09bf827093a45a', 'request_id': 'req-f443a6cf-3084-45ab-bc3b-43466cef8c02'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:52.013323 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] The token cache is being invalidate because project e902ff797e8041adbb09bf827093a45a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:31:52.013323 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:52.018985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:52.031262 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 842/1671] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:31:51 2022] DELETE /identity/v3/projects/e902ff797e8041adbb09bf827093a45a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:31:52.031262 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:52.032296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:52.131235 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 830/1672] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 977 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:31:52.139741 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc66c0-5a17-46d7-99ee-10f389f58b8d None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:52.140438 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc66c0-5a17-46d7-99ee-10f389f58b8d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:52.142543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc66c0-5a17-46d7-99ee-10f389f58b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:52.212209 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-3dfc66c0-5a17-46d7-99ee-10f389f58b8d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:52.216022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3dfc66c0-5a17-46d7-99ee-10f389f58b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:52.241969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443a6cf-3084-45ab-bc3b-43466cef8c02 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:52.255115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ccbe9-ba87-4ff7-b7d5-0c9db22580db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:52.256415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ccbe9-ba87-4ff7-b7d5-0c9db22580db service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:52.256858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ccbe9-ba87-4ff7-b7d5-0c9db22580db service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:52.257302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ccbe9-ba87-4ff7-b7d5-0c9db22580db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:52.260288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e97ccbe9-ba87-4ff7-b7d5-0c9db22580db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:52.372166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 831/1673] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:52.381106 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4362f9-6591-47b8-abc8-3e97d117a6bd None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:52.381567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4362f9-6591-47b8-abc8-3e97d117a6bd None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:52.381882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4362f9-6591-47b8-abc8-3e97d117a6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:52.388321 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ccbe9-ba87-4ff7-b7d5-0c9db22580db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:52.397942 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ccbe9-ba87-4ff7-b7d5-0c9db22580db service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:52.425792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-cc4362f9-6591-47b8-abc8-3e97d117a6bd None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:52.429978 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-cc4362f9-6591-47b8-abc8-3e97d117a6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:52.455149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 832/1674] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:31:52.459975 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4362f9-6591-47b8-abc8-3e97d117a6bd None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:52.461237 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 843/1675] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:52.481088 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4362f9-6591-47b8-abc8-3e97d117a6bd None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:52.497250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd36f7-07e3-4673-a319-27b8278c51b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:52.497952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd36f7-07e3-4673-a319-27b8278c51b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:52.498673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd36f7-07e3-4673-a319-27b8278c51b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:52.498871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd36f7-07e3-4673-a319-27b8278c51b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:52.499621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd36f7-07e3-4673-a319-27b8278c51b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:31:52.500066 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd36f7-07e3-4673-a319-27b8278c51b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:52.502037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd36f7-07e3-4673-a319-27b8278c51b9 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:52.537624 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 833/1676] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:31:52.541755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ccbe9-ba87-4ff7-b7d5-0c9db22580db service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:52.555010 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ccbe9-ba87-4ff7-b7d5-0c9db22580db service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:52.587047 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9dd3d2-ed6c-4809-a3b7-aba19dbac5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:52.587758 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dd3d2-ed6c-4809-a3b7-aba19dbac5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:52.588047 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dd3d2-ed6c-4809-a3b7-aba19dbac5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:52.588332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dd3d2-ed6c-4809-a3b7-aba19dbac5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:52.604301 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9dd3d2-ed6c-4809-a3b7-aba19dbac5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:52.608439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9dd3d2-ed6c-4809-a3b7-aba19dbac5b9 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:52.690466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 844/1677] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:31:52 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:52.691572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd36f7-07e3-4673-a319-27b8278c51b9 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:52.735574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd36f7-07e3-4673-a319-27b8278c51b9 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:52.925981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f6b17-da03-47ba-8780-cc53770800de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:52.926797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f6b17-da03-47ba-8780-cc53770800de admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:52.928377 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f6b17-da03-47ba-8780-cc53770800de admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:52.929017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f6b17-da03-47ba-8780-cc53770800de admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:52.929926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f6b17-da03-47ba-8780-cc53770800de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:52.937009 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f6b17-da03-47ba-8780-cc53770800de admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:52.999783 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 834/1678] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:31:52 2022] POST /identity/v3/users => generated 290 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:53.002251 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9dd3d2-ed6c-4809-a3b7-aba19dbac5b9 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:53.020001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9dd3d2-ed6c-4809-a3b7-aba19dbac5b9 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:53.040053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d8ee1-aa05-4f70-9c89-ea7dce8aa52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:53.045045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d8ee1-aa05-4f70-9c89-ea7dce8aa52f admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:53.045413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d8ee1-aa05-4f70-9c89-ea7dce8aa52f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:53.046167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d8ee1-aa05-4f70-9c89-ea7dce8aa52f admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:53.051125 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d8ee1-aa05-4f70-9c89-ea7dce8aa52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:53.055494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d8ee1-aa05-4f70-9c89-ea7dce8aa52f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:53.092322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 845/1679] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:53.096952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f6b17-da03-47ba-8780-cc53770800de admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:53.116438 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f6b17-da03-47ba-8780-cc53770800de admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:53.127846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3330678-5411-4e25-abc8-670cdad3332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:53.128588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3330678-5411-4e25-abc8-670cdad3332f admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:53.128903 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3330678-5411-4e25-abc8-670cdad3332f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:53.129188 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3330678-5411-4e25-abc8-670cdad3332f admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:53.130110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3330678-5411-4e25-abc8-670cdad3332f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:53.132660 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3330678-5411-4e25-abc8-670cdad3332f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:53.169341 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 835/1680] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:53.170922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d8ee1-aa05-4f70-9c89-ea7dce8aa52f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:53.185238 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d8ee1-aa05-4f70-9c89-ea7dce8aa52f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:53.207911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f0fb4-3724-4eae-9625-500249106b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:53.209389 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f0fb4-3724-4eae-9625-500249106b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:53.209903 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f0fb4-3724-4eae-9625-500249106b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:53.210539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f0fb4-3724-4eae-9625-500249106b26 admin admin] PATH_INFO: `/v3/projects/eed06257772147bcb65f3912cb4394b6/users/e407e6fa087044d9a32bceb067dd6bf3/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:53.246893 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f0fb4-3724-4eae-9625-500249106b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed06257772147bcb65f3912cb4394b6, user_id=e407e6fa087044d9a32bceb067dd6bf3, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:53.256553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f0fb4-3724-4eae-9625-500249106b26 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:53.297757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 846/1681] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:53 2022] PUT /identity/v3/projects/eed06257772147bcb65f3912cb4394b6/users/e407e6fa087044d9a32bceb067dd6bf3/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:53.311069 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955b187-f6d5-4452-8221-10ea53651806 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:53.311737 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955b187-f6d5-4452-8221-10ea53651806 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:53.312089 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955b187-f6d5-4452-8221-10ea53651806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:53.434050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-c955b187-f6d5-4452-8221-10ea53651806 None None] MFA Rules not processed for user `e407e6fa087044d9a32bceb067dd6bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:53.438050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c955b187-f6d5-4452-8221-10ea53651806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:53.755208 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f0fb4-3724-4eae-9625-500249106b26 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:53.755523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 836/1682] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:53.940712 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f0fb4-3724-4eae-9625-500249106b26 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:53.958827 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889e9e8-3e21-4d72-85dc-83337c579fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:53.960050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889e9e8-3e21-4d72-85dc-83337c579fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:53.960366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889e9e8-3e21-4d72-85dc-83337c579fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:53.961194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889e9e8-3e21-4d72-85dc-83337c579fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:53.962043 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889e9e8-3e21-4d72-85dc-83337c579fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:53.970485 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889e9e8-3e21-4d72-85dc-83337c579fc5 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:54.033048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 847/1683] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:31:53 2022] POST /identity/v3/projects => generated 381 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:31:54.034504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955b187-f6d5-4452-8221-10ea53651806 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:54.050877 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955b187-f6d5-4452-8221-10ea53651806 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:54.162193 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b6853-93fa-4460-b8cf-6a520d3c167a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:54.163249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b6853-93fa-4460-b8cf-6a520d3c167a admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:54.163592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b6853-93fa-4460-b8cf-6a520d3c167a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:54.163986 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b6853-93fa-4460-b8cf-6a520d3c167a admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:54.167363 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b6853-93fa-4460-b8cf-6a520d3c167a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:54.172095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b6853-93fa-4460-b8cf-6a520d3c167a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:54.240998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889e9e8-3e21-4d72-85dc-83337c579fc5 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:54.253274 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 837/1684] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:31:54 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:54.256807 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889e9e8-3e21-4d72-85dc-83337c579fc5 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:54.264285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294575ac-1d1e-422e-9110-ecc3ce83dbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:54.266053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294575ac-1d1e-422e-9110-ecc3ce83dbff admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:54.266578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294575ac-1d1e-422e-9110-ecc3ce83dbff admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:54.267062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294575ac-1d1e-422e-9110-ecc3ce83dbff admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:54.268253 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294575ac-1d1e-422e-9110-ecc3ce83dbff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:54.270544 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294575ac-1d1e-422e-9110-ecc3ce83dbff admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:54.299415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b6853-93fa-4460-b8cf-6a520d3c167a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:54.325381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b6853-93fa-4460-b8cf-6a520d3c167a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:54.325850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 848/1685] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:54.332443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098c360-e61b-4179-902b-006c8640756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:54.334588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098c360-e61b-4179-902b-006c8640756b admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:54.337432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098c360-e61b-4179-902b-006c8640756b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:54.338001 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098c360-e61b-4179-902b-006c8640756b admin admin] PATH_INFO: `/v3/projects/6a827e20174741a5880beb85cde8f6e2/users/992bf9e2464e4b29887f1b3169e031d0/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:54.401707 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098c360-e61b-4179-902b-006c8640756b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a827e20174741a5880beb85cde8f6e2, user_id=992bf9e2464e4b29887f1b3169e031d0, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:54.401707 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098c360-e61b-4179-902b-006c8640756b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:54.443511 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294575ac-1d1e-422e-9110-ecc3ce83dbff admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:54.453667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 838/1686] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:54 2022] PUT /identity/v3/projects/6a827e20174741a5880beb85cde8f6e2/users/992bf9e2464e4b29887f1b3169e031d0/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:54.457952 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294575ac-1d1e-422e-9110-ecc3ce83dbff admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:54.553188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1174aa8-8343-4765-bfa6-9dde28a77c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:54.554122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1174aa8-8343-4765-bfa6-9dde28a77c0e admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:54.554772 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1174aa8-8343-4765-bfa6-9dde28a77c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:54.555220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1174aa8-8343-4765-bfa6-9dde28a77c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:54.556135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1174aa8-8343-4765-bfa6-9dde28a77c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:54.558349 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1174aa8-8343-4765-bfa6-9dde28a77c0e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:54.588424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098c360-e61b-4179-902b-006c8640756b admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:54.600101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 849/1687] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:54.612165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098c360-e61b-4179-902b-006c8640756b admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:54.639898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50df87-f0fa-4670-99b1-1e92c7b22157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:54.641191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50df87-f0fa-4670-99b1-1e92c7b22157 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:54.641776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50df87-f0fa-4670-99b1-1e92c7b22157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:54.642271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50df87-f0fa-4670-99b1-1e92c7b22157 admin admin] PATH_INFO: `/v3/projects/6a827e20174741a5880beb85cde8f6e2/users/992bf9e2464e4b29887f1b3169e031d0/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:54.645562 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50df87-f0fa-4670-99b1-1e92c7b22157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a827e20174741a5880beb85cde8f6e2, user_id=992bf9e2464e4b29887f1b3169e031d0, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:54.652731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50df87-f0fa-4670-99b1-1e92c7b22157 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:54.714871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 839/1688] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:54 2022] PUT /identity/v3/projects/6a827e20174741a5880beb85cde8f6e2/users/992bf9e2464e4b29887f1b3169e031d0/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:54.726368 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e29ce-1e72-4fac-9092-1e4a5c67cb27 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:54.727286 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e29ce-1e72-4fac-9092-1e4a5c67cb27 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:54.727584 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e29ce-1e72-4fac-9092-1e4a5c67cb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:54.839192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8220a54-a767-4346-8fe1-45fc905fe0d8 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:54.839725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8220a54-a767-4346-8fe1-45fc905fe0d8 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:54.840145 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8220a54-a767-4346-8fe1-45fc905fe0d8 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:54.841963 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 840/1689] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 14:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:31:54.862001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-fa9e29ce-1e72-4fac-9092-1e4a5c67cb27 None None] MFA Rules not processed for user `992bf9e2464e4b29887f1b3169e031d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:54.863598 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-fa9e29ce-1e72-4fac-9092-1e4a5c67cb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:54.874483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4145d6-7d31-4bf5-b3c4-6deb530d10ff None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:54.875014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4145d6-7d31-4bf5-b3c4-6deb530d10ff None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:54.875437 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4145d6-7d31-4bf5-b3c4-6deb530d10ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:54.949632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-6c4145d6-7d31-4bf5-b3c4-6deb530d10ff None None] MFA Rules not processed for user `1f443d2ca1534249bb2c4096300ddffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:54.950924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6c4145d6-7d31-4bf5-b3c4-6deb530d10ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:55.101358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 850/1690] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:55.103372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed08e90-bb60-449b-90a1-8d61fd0d043a None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:55.103897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed08e90-bb60-449b-90a1-8d61fd0d043a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:55.104753 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed08e90-bb60-449b-90a1-8d61fd0d043a None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:55.109492 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 851/1691] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 14:31:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:31:55.111585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed08e90-bb60-449b-90a1-8d61fd0d043a None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:55.116858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-8ed08e90-bb60-449b-90a1-8d61fd0d043a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:55.226816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 841/1692] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 14:31:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:31:55.269433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed08e90-bb60-449b-90a1-8d61fd0d043a None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:55.281917 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092910bf-982a-4ecd-8d40-1af7a16b5df9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:55.286255 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092910bf-982a-4ecd-8d40-1af7a16b5df9 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:55.286721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092910bf-982a-4ecd-8d40-1af7a16b5df9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:55.287109 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092910bf-982a-4ecd-8d40-1af7a16b5df9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:55.300686 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092910bf-982a-4ecd-8d40-1af7a16b5df9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:55.302987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092910bf-982a-4ecd-8d40-1af7a16b5df9 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:55.316961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 852/1693] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:55.362991 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2085-aa3b-478b-9b1e-d4e28497b9e3 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:55.363280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2085-aa3b-478b-9b1e-d4e28497b9e3 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:55.363554 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2085-aa3b-478b-9b1e-d4e28497b9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:55.399311 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-70ee2085-aa3b-478b-9b1e-d4e28497b9e3 None None] MFA Rules not processed for user `1f443d2ca1534249bb2c4096300ddffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:55.400526 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-70ee2085-aa3b-478b-9b1e-d4e28497b9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:55.418502 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092910bf-982a-4ecd-8d40-1af7a16b5df9 service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:55.428691 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 842/1694] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 14:31:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:55.430456 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092910bf-982a-4ecd-8d40-1af7a16b5df9 service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:55.436946 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523f1e7-6870-4540-a45a-ce2f37671772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:55.439963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523f1e7-6870-4540-a45a-ce2f37671772 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:55.440459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523f1e7-6870-4540-a45a-ce2f37671772 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:55.440842 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523f1e7-6870-4540-a45a-ce2f37671772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:55.564137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523f1e7-6870-4540-a45a-ce2f37671772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:55.577237 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523f1e7-6870-4540-a45a-ce2f37671772 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:55.608654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 853/1695] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:31:56.064676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee2085-aa3b-478b-9b1e-d4e28497b9e3 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:56.066518 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-70ee2085-aa3b-478b-9b1e-d4e28497b9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:56.151609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523f1e7-6870-4540-a45a-ce2f37671772 service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:56.153366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-0523f1e7-6870-4540-a45a-ce2f37671772 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:56.182132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523f1e7-6870-4540-a45a-ce2f37671772 service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:56.198139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee2085-aa3b-478b-9b1e-d4e28497b9e3 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:56.205892 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6c7c1-690c-4baf-a4bd-6c16a85a77b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:56.206045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ceb58-e941-4487-941f-dc0b60a1bad1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:56.206566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ceb58-e941-4487-941f-dc0b60a1bad1 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:56.206749 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6c7c1-690c-4baf-a4bd-6c16a85a77b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:56.206893 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ceb58-e941-4487-941f-dc0b60a1bad1 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:56.207118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ceb58-e941-4487-941f-dc0b60a1bad1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:56.208063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6c7c1-690c-4baf-a4bd-6c16a85a77b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:56.208612 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6c7c1-690c-4baf-a4bd-6c16a85a77b5 admin admin] PATH_INFO: `/v3/projects/141b5a41e56a4c8c98b086d16ff1fcc2` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:56.210279 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6c7c1-690c-4baf-a4bd-6c16a85a77b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=141b5a41e56a4c8c98b086d16ff1fcc2)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:56.212387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6c7c1-690c-4baf-a4bd-6c16a85a77b5 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:56.231420 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ceb58-e941-4487-941f-dc0b60a1bad1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:56.242309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ceb58-e941-4487-941f-dc0b60a1bad1 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:56.274064 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 854/1696] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:56.316560 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7ed6c7c1-690c-4baf-a4bd-6c16a85a77b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141b5a41e56a4c8c98b086d16ff1fcc2', 'request_id': 'req-7ed6c7c1-690c-4baf-a4bd-6c16a85a77b5'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:56.329011 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7ed6c7c1-690c-4baf-a4bd-6c16a85a77b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141b5a41e56a4c8c98b086d16ff1fcc2', 'request_id': 'req-7ed6c7c1-690c-4baf-a4bd-6c16a85a77b5'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:56.354272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7ed6c7c1-690c-4baf-a4bd-6c16a85a77b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141b5a41e56a4c8c98b086d16ff1fcc2', 'request_id': 'req-7ed6c7c1-690c-4baf-a4bd-6c16a85a77b5'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:56.401965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7ed6c7c1-690c-4baf-a4bd-6c16a85a77b5 admin admin] The token cache is being invalidate because project 141b5a41e56a4c8c98b086d16ff1fcc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:31:56.404584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7ed6c7c1-690c-4baf-a4bd-6c16a85a77b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:56.408039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7ed6c7c1-690c-4baf-a4bd-6c16a85a77b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:56.415608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 843/1697] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:31:56 2022] DELETE /identity/v3/projects/141b5a41e56a4c8c98b086d16ff1fcc2 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:56.417203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61206cad-b2f1-4b42-9c78-cbed2ce94ecc None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:56.417496 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61206cad-b2f1-4b42-9c78-cbed2ce94ecc None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:56.417861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61206cad-b2f1-4b42-9c78-cbed2ce94ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:56.476902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-61206cad-b2f1-4b42-9c78-cbed2ce94ecc None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:56.478379 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-61206cad-b2f1-4b42-9c78-cbed2ce94ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:56.619082 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 855/1698] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:31:56.628744 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a84e6-21a1-4d43-b244-447d777ccff0 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:56.629041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a84e6-21a1-4d43-b244-447d777ccff0 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:56.629327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a84e6-21a1-4d43-b244-447d777ccff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:56.665086 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-706a84e6-21a1-4d43-b244-447d777ccff0 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:56.667276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-706a84e6-21a1-4d43-b244-447d777ccff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:56.711442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 844/1699] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:56.715757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61206cad-b2f1-4b42-9c78-cbed2ce94ecc None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:56.730306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61206cad-b2f1-4b42-9c78-cbed2ce94ecc None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:56.742991 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077dfb3-27b0-4ba4-8aa8-45de4294a0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:56.743770 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077dfb3-27b0-4ba4-8aa8-45de4294a0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:56.744067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077dfb3-27b0-4ba4-8aa8-45de4294a0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:56.744328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077dfb3-27b0-4ba4-8aa8-45de4294a0e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:56.745179 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077dfb3-27b0-4ba4-8aa8-45de4294a0e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:31:56.745557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077dfb3-27b0-4ba4-8aa8-45de4294a0e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:56.747291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077dfb3-27b0-4ba4-8aa8-45de4294a0e2 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:56.766998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 856/1700] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:31:56.771373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a84e6-21a1-4d43-b244-447d777ccff0 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:56.784521 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a84e6-21a1-4d43-b244-447d777ccff0 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:56.794732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb7d59-0690-4e8d-a996-78acafe036ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:56.795130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb7d59-0690-4e8d-a996-78acafe036ea admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:56.795415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb7d59-0690-4e8d-a996-78acafe036ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:56.795691 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb7d59-0690-4e8d-a996-78acafe036ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:56.796406 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb7d59-0690-4e8d-a996-78acafe036ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:56.801557 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb7d59-0690-4e8d-a996-78acafe036ea admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:56.871743 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 845/1701] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:31:56 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:56.875924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077dfb3-27b0-4ba4-8aa8-45de4294a0e2 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:56.900242 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077dfb3-27b0-4ba4-8aa8-45de4294a0e2 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:57.067212 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19aad3-e07c-45ec-bd44-d221bfeec29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:57.069563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19aad3-e07c-45ec-bd44-d221bfeec29b admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:57.070245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19aad3-e07c-45ec-bd44-d221bfeec29b admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:57.073101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19aad3-e07c-45ec-bd44-d221bfeec29b admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:57.075842 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19aad3-e07c-45ec-bd44-d221bfeec29b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:57.080400 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19aad3-e07c-45ec-bd44-d221bfeec29b admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:57.123476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 857/1702] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:31:56 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:57.127413 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb7d59-0690-4e8d-a996-78acafe036ea admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:57.139288 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb7d59-0690-4e8d-a996-78acafe036ea admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:57.145191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9642f-e6c2-46bb-a145-440b59b320ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:57.146634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9642f-e6c2-46bb-a145-440b59b320ee admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:57.147074 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9642f-e6c2-46bb-a145-440b59b320ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:57.147549 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9642f-e6c2-46bb-a145-440b59b320ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:57.148439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9642f-e6c2-46bb-a145-440b59b320ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:57.150334 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9642f-e6c2-46bb-a145-440b59b320ee admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:57.183839 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 846/1703] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:57.188112 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19aad3-e07c-45ec-bd44-d221bfeec29b admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:57.205434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19aad3-e07c-45ec-bd44-d221bfeec29b admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:57.211688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd41c7-7ba8-4c8c-87a6-325ebc7a8a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:57.212732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd41c7-7ba8-4c8c-87a6-325ebc7a8a56 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:57.213167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd41c7-7ba8-4c8c-87a6-325ebc7a8a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:57.213592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd41c7-7ba8-4c8c-87a6-325ebc7a8a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:57.214525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd41c7-7ba8-4c8c-87a6-325ebc7a8a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:57.217032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd41c7-7ba8-4c8c-87a6-325ebc7a8a56 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:57.240346 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 858/1704] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:31:57.245006 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9642f-e6c2-46bb-a145-440b59b320ee admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:57.257271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9642f-e6c2-46bb-a145-440b59b320ee admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:57.277726 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a0ecc-d13c-477e-b31f-62801a573788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:57.281091 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a0ecc-d13c-477e-b31f-62801a573788 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:57.281356 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a0ecc-d13c-477e-b31f-62801a573788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:57.281759 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a0ecc-d13c-477e-b31f-62801a573788 admin admin] PATH_INFO: `/v3/projects/dd5fe719e9494d52a9d880f6c31910ac/users/00597da90f6a4a6f938e17345fa76ff5/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:57.309873 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a0ecc-d13c-477e-b31f-62801a573788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5fe719e9494d52a9d880f6c31910ac, user_id=00597da90f6a4a6f938e17345fa76ff5, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:57.311425 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd41c7-7ba8-4c8c-87a6-325ebc7a8a56 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:57.313169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-becd41c7-7ba8-4c8c-87a6-325ebc7a8a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:57.314293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a0ecc-d13c-477e-b31f-62801a573788 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:57.361335 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 847/1705] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:57 2022] PUT /identity/v3/projects/dd5fe719e9494d52a9d880f6c31910ac/users/00597da90f6a4a6f938e17345fa76ff5/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:57.363228 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fcc55-d128-4ad9-9804-184da8e1a632 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:57.363789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fcc55-d128-4ad9-9804-184da8e1a632 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:57.364309 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fcc55-d128-4ad9-9804-184da8e1a632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:57.417249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b80fcc55-d128-4ad9-9804-184da8e1a632 None None] MFA Rules not processed for user `00597da90f6a4a6f938e17345fa76ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:57.419011 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b80fcc55-d128-4ad9-9804-184da8e1a632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:57.427160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd41c7-7ba8-4c8c-87a6-325ebc7a8a56 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:57.549382 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfd49d-95f7-4789-87ee-75ebcaa0efcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:57.549924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfd49d-95f7-4789-87ee-75ebcaa0efcb service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:57.550569 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfd49d-95f7-4789-87ee-75ebcaa0efcb service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:57.551030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfd49d-95f7-4789-87ee-75ebcaa0efcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:57.555922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-00dfd49d-95f7-4789-87ee-75ebcaa0efcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:57.585451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfd49d-95f7-4789-87ee-75ebcaa0efcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:57.587952 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfd49d-95f7-4789-87ee-75ebcaa0efcb service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:57.612105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 848/1706] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:57.613135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fcc55-d128-4ad9-9804-184da8e1a632 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:57.614147 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 859/1707] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:57.825021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fcc55-d128-4ad9-9804-184da8e1a632 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:57.846069 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90e077-40fb-48c5-b86b-2c85bf53af17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:57.846804 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90e077-40fb-48c5-b86b-2c85bf53af17 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:57.847091 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90e077-40fb-48c5-b86b-2c85bf53af17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:57.847369 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90e077-40fb-48c5-b86b-2c85bf53af17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:57.848142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90e077-40fb-48c5-b86b-2c85bf53af17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:57.850265 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90e077-40fb-48c5-b86b-2c85bf53af17 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:57.936393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 849/1708] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:31:57 2022] POST /identity/v3/projects => generated 387 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:31:57.937527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfd49d-95f7-4789-87ee-75ebcaa0efcb service nova] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:57.956885 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfd49d-95f7-4789-87ee-75ebcaa0efcb service nova] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:58.084069 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab406da-5b51-4505-95a2-27960b755e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:58.085119 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab406da-5b51-4505-95a2-27960b755e79 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:58.085727 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab406da-5b51-4505-95a2-27960b755e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:58.086155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab406da-5b51-4505-95a2-27960b755e79 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:58.087215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab406da-5b51-4505-95a2-27960b755e79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:58.089663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab406da-5b51-4505-95a2-27960b755e79 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:58.120929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 860/1709] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:31:57 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:31:58.124662 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90e077-40fb-48c5-b86b-2c85bf53af17 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:58.139458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90e077-40fb-48c5-b86b-2c85bf53af17 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:58.159307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b924b6-174f-4f1e-82c1-1ece1b350315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:58.160277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b924b6-174f-4f1e-82c1-1ece1b350315 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:58.161064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b924b6-174f-4f1e-82c1-1ece1b350315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:58.162122 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b924b6-174f-4f1e-82c1-1ece1b350315 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:58.163168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b924b6-174f-4f1e-82c1-1ece1b350315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:58.165749 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b924b6-174f-4f1e-82c1-1ece1b350315 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:58.180054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 850/1710] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:58.184423 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab406da-5b51-4505-95a2-27960b755e79 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:58.196770 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab406da-5b51-4505-95a2-27960b755e79 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:58.203322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd59a0-3efd-46dc-b7f9-6c61db523476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:58.204688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd59a0-3efd-46dc-b7f9-6c61db523476 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:58.205351 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd59a0-3efd-46dc-b7f9-6c61db523476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:58.206138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd59a0-3efd-46dc-b7f9-6c61db523476 admin admin] PATH_INFO: `/v3/projects/fd70a99c92054ab792cfb6203b44c759/users/75194bd5f97c420e82aa002f627cffec/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:58.228829 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd59a0-3efd-46dc-b7f9-6c61db523476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd70a99c92054ab792cfb6203b44c759, user_id=75194bd5f97c420e82aa002f627cffec, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:58.231766 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd59a0-3efd-46dc-b7f9-6c61db523476 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:58.246144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 861/1711] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:58 2022] PUT /identity/v3/projects/fd70a99c92054ab792cfb6203b44c759/users/75194bd5f97c420e82aa002f627cffec/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:58.251919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b924b6-174f-4f1e-82c1-1ece1b350315 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:58.274533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b924b6-174f-4f1e-82c1-1ece1b350315 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:58.386984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776308ec-9f23-42d3-b6cf-985d24e9425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:58.388822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776308ec-9f23-42d3-b6cf-985d24e9425c admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:58.389248 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776308ec-9f23-42d3-b6cf-985d24e9425c admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:58.389940 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776308ec-9f23-42d3-b6cf-985d24e9425c admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:58.390880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776308ec-9f23-42d3-b6cf-985d24e9425c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:58.393082 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776308ec-9f23-42d3-b6cf-985d24e9425c admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:58.411737 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 851/1712] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:31:58.412020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd59a0-3efd-46dc-b7f9-6c61db523476 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:58.426123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd59a0-3efd-46dc-b7f9-6c61db523476 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:58.435491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186f0c1-5d8b-4738-8d41-5542f1789d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:58.436848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186f0c1-5d8b-4738-8d41-5542f1789d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:58.440572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186f0c1-5d8b-4738-8d41-5542f1789d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:58.441096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186f0c1-5d8b-4738-8d41-5542f1789d6a admin admin] PATH_INFO: `/v3/projects/fd70a99c92054ab792cfb6203b44c759/users/75194bd5f97c420e82aa002f627cffec/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:58.445352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186f0c1-5d8b-4738-8d41-5542f1789d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd70a99c92054ab792cfb6203b44c759, user_id=75194bd5f97c420e82aa002f627cffec, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:58.455311 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186f0c1-5d8b-4738-8d41-5542f1789d6a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:58.467757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 862/1713] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:31:58 2022] PUT /identity/v3/projects/fd70a99c92054ab792cfb6203b44c759/users/75194bd5f97c420e82aa002f627cffec/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:58.478510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb1139-d412-4450-8258-7f62ea559f88 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:58.478811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb1139-d412-4450-8258-7f62ea559f88 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:58.479096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb1139-d412-4450-8258-7f62ea559f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:58.508317 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-ecfb1139-d412-4450-8258-7f62ea559f88 None None] MFA Rules not processed for user `75194bd5f97c420e82aa002f627cffec`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:58.509452 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ecfb1139-d412-4450-8258-7f62ea559f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:58.587316 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 852/1714] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:58.598657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186f0c1-5d8b-4738-8d41-5542f1789d6a admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:58.600657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-1186f0c1-5d8b-4738-8d41-5542f1789d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:58.658721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186f0c1-5d8b-4738-8d41-5542f1789d6a admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:58.663025 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0aaac-02b5-4525-8c13-7078c6e4a073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:58.663673 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0aaac-02b5-4525-8c13-7078c6e4a073 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:58.663960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0aaac-02b5-4525-8c13-7078c6e4a073 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:58.664240 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0aaac-02b5-4525-8c13-7078c6e4a073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:58.673667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0aaac-02b5-4525-8c13-7078c6e4a073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:58.675159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0aaac-02b5-4525-8c13-7078c6e4a073 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:58.685513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 863/1715] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:31:58.714775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb1139-d412-4450-8258-7f62ea559f88 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:58.783222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb1139-d412-4450-8258-7f62ea559f88 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:58.788035 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867ed7f-170c-4bc9-8784-c6eb14cf9f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:58.788919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ed7f-170c-4bc9-8784-c6eb14cf9f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:58.789250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ed7f-170c-4bc9-8784-c6eb14cf9f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:58.789529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ed7f-170c-4bc9-8784-c6eb14cf9f54 admin admin] PATH_INFO: `/v3/users/00597da90f6a4a6f938e17345fa76ff5` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:58.790757 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867ed7f-170c-4bc9-8784-c6eb14cf9f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00597da90f6a4a6f938e17345fa76ff5)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:58.792668 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867ed7f-170c-4bc9-8784-c6eb14cf9f54 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:58.841344 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e867ed7f-170c-4bc9-8784-c6eb14cf9f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00597da90f6a4a6f938e17345fa76ff5'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:58.848751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e867ed7f-170c-4bc9-8784-c6eb14cf9f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00597da90f6a4a6f938e17345fa76ff5'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:58.849959 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e867ed7f-170c-4bc9-8784-c6eb14cf9f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00597da90f6a4a6f938e17345fa76ff5'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:58.861758 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e867ed7f-170c-4bc9-8784-c6eb14cf9f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00597da90f6a4a6f938e17345fa76ff5'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:58.870486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e867ed7f-170c-4bc9-8784-c6eb14cf9f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00597da90f6a4a6f938e17345fa76ff5'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:58.877105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 853/1716] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:31:58 2022] DELETE /identity/v3/users/00597da90f6a4a6f938e17345fa76ff5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:58.884331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21686c5b-dbcf-402b-8ed5-7c0fed069e4e None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:58.884744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21686c5b-dbcf-402b-8ed5-7c0fed069e4e None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:58.885156 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21686c5b-dbcf-402b-8ed5-7c0fed069e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:58.903249 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-21686c5b-dbcf-402b-8ed5-7c0fed069e4e None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:31:58.904483 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-21686c5b-dbcf-402b-8ed5-7c0fed069e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:58.965335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 864/1717] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:31:58.976489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867ed7f-170c-4bc9-8784-c6eb14cf9f54 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:58.978767 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e867ed7f-170c-4bc9-8784-c6eb14cf9f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:59.053455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867ed7f-170c-4bc9-8784-c6eb14cf9f54 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:59.057905 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692feb79-f9dd-462f-8baf-0795de0dcb61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:59.058163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692feb79-f9dd-462f-8baf-0795de0dcb61 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:59.058624 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692feb79-f9dd-462f-8baf-0795de0dcb61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:59.058910 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692feb79-f9dd-462f-8baf-0795de0dcb61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:59.069624 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692feb79-f9dd-462f-8baf-0795de0dcb61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:59.071203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692feb79-f9dd-462f-8baf-0795de0dcb61 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:59.082776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 854/1718] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:31:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:31:59.426743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21686c5b-dbcf-402b-8ed5-7c0fed069e4e None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:59.429874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-21686c5b-dbcf-402b-8ed5-7c0fed069e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:31:59.443787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21686c5b-dbcf-402b-8ed5-7c0fed069e4e None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:59.450792 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:59.451979 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:59.452171 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:59.452419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3 admin admin] PATH_INFO: `/v3/projects/dd5fe719e9494d52a9d880f6c31910ac` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:59.459813 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5fe719e9494d52a9d880f6c31910ac)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:59.462033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:59.521491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5fe719e9494d52a9d880f6c31910ac', 'request_id': 'req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:59.527848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5fe719e9494d52a9d880f6c31910ac', 'request_id': 'req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:59.535696 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5fe719e9494d52a9d880f6c31910ac', 'request_id': 'req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:59.546825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3 admin admin] The token cache is being invalidate because project dd5fe719e9494d52a9d880f6c31910ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:31:59.547120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:59.547797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:59.550272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 865/1719] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:31:59 2022] DELETE /identity/v3/projects/dd5fe719e9494d52a9d880f6c31910ac => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:59.553843 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692feb79-f9dd-462f-8baf-0795de0dcb61 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:59.563443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692feb79-f9dd-462f-8baf-0795de0dcb61 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:31:59.622274 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04799e7-c797-4dde-a1e4-4fa5216072c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:31:59.623168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04799e7-c797-4dde-a1e4-4fa5216072c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:31:59.623450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04799e7-c797-4dde-a1e4-4fa5216072c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:31:59.623728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04799e7-c797-4dde-a1e4-4fa5216072c4 admin admin] PATH_INFO: `/v3/users/75194bd5f97c420e82aa002f627cffec` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:31:59.624927 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04799e7-c797-4dde-a1e4-4fa5216072c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75194bd5f97c420e82aa002f627cffec)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:31:59.626874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04799e7-c797-4dde-a1e4-4fa5216072c4 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:31:59.673779 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d04799e7-c797-4dde-a1e4-4fa5216072c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75194bd5f97c420e82aa002f627cffec'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:59.680773 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d04799e7-c797-4dde-a1e4-4fa5216072c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75194bd5f97c420e82aa002f627cffec'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:59.681467 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d04799e7-c797-4dde-a1e4-4fa5216072c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75194bd5f97c420e82aa002f627cffec'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:59.693701 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d04799e7-c797-4dde-a1e4-4fa5216072c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75194bd5f97c420e82aa002f627cffec'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:59.702944 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d04799e7-c797-4dde-a1e4-4fa5216072c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75194bd5f97c420e82aa002f627cffec'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:31:59.710128 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 855/1720] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:31:59 2022] DELETE /identity/v3/users/75194bd5f97c420e82aa002f627cffec => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:31:59.989780 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:31:59.991284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:00.004579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc3df9-5d1b-4094-8ab8-fc1a38dc9ca3 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:00.081947 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4961d-b8bf-440b-8768-a34a525212d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:00.082966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4961d-b8bf-440b-8768-a34a525212d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:00.083825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4961d-b8bf-440b-8768-a34a525212d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:00.084165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4961d-b8bf-440b-8768-a34a525212d2 admin admin] PATH_INFO: `/v3/projects/fd70a99c92054ab792cfb6203b44c759` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:00.085386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4961d-b8bf-440b-8768-a34a525212d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd70a99c92054ab792cfb6203b44c759)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:00.087440 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4961d-b8bf-440b-8768-a34a525212d2 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:00.132094 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-48e4961d-b8bf-440b-8768-a34a525212d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd70a99c92054ab792cfb6203b44c759', 'request_id': 'req-48e4961d-b8bf-440b-8768-a34a525212d2'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:00.144968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-48e4961d-b8bf-440b-8768-a34a525212d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd70a99c92054ab792cfb6203b44c759', 'request_id': 'req-48e4961d-b8bf-440b-8768-a34a525212d2'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:00.176024 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-48e4961d-b8bf-440b-8768-a34a525212d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd70a99c92054ab792cfb6203b44c759', 'request_id': 'req-48e4961d-b8bf-440b-8768-a34a525212d2'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:00.224296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-48e4961d-b8bf-440b-8768-a34a525212d2 admin admin] The token cache is being invalidate because project fd70a99c92054ab792cfb6203b44c759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:00.224296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-48e4961d-b8bf-440b-8768-a34a525212d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:00.225441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-48e4961d-b8bf-440b-8768-a34a525212d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:00.232605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 866/1721] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:31:59 2022] DELETE /identity/v3/projects/fd70a99c92054ab792cfb6203b44c759 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:00.238786 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ff9d8-f799-4b0c-8067-580e09a2fe3f None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:00.239414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ff9d8-f799-4b0c-8067-580e09a2fe3f None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:00.240525 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ff9d8-f799-4b0c-8067-580e09a2fe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:00.268684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-c22ff9d8-f799-4b0c-8067-580e09a2fe3f None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:00.269957 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c22ff9d8-f799-4b0c-8067-580e09a2fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:00.334525 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 856/1722] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:00.343334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba547bb-5852-42fe-a458-8bf0c5ee8147 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:00.343699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba547bb-5852-42fe-a458-8bf0c5ee8147 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:00.344043 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba547bb-5852-42fe-a458-8bf0c5ee8147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:00.363772 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-eba547bb-5852-42fe-a458-8bf0c5ee8147 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:00.365892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-eba547bb-5852-42fe-a458-8bf0c5ee8147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:00.373584 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 867/1723] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:00.377851 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ff9d8-f799-4b0c-8067-580e09a2fe3f None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:00.388116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ff9d8-f799-4b0c-8067-580e09a2fe3f None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:00.392965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8661c-9cdd-48d7-b89b-d44dad141dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:00.393632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8661c-9cdd-48d7-b89b-d44dad141dda admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:00.393918 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8661c-9cdd-48d7-b89b-d44dad141dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:00.394288 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8661c-9cdd-48d7-b89b-d44dad141dda admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:00.395022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8661c-9cdd-48d7-b89b-d44dad141dda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:32:00.395338 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8661c-9cdd-48d7-b89b-d44dad141dda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:00.397082 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8661c-9cdd-48d7-b89b-d44dad141dda admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:00.409202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 857/1724] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:32:00.413967 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba547bb-5852-42fe-a458-8bf0c5ee8147 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:00.423028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba547bb-5852-42fe-a458-8bf0c5ee8147 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:00.428978 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef40889-9c09-4f24-8c03-86b28dc77b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:00.429619 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef40889-9c09-4f24-8c03-86b28dc77b4c admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:00.429994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef40889-9c09-4f24-8c03-86b28dc77b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:00.430301 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef40889-9c09-4f24-8c03-86b28dc77b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:00.430998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef40889-9c09-4f24-8c03-86b28dc77b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:00.433044 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef40889-9c09-4f24-8c03-86b28dc77b4c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:00.474919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 868/1725] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:00 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:00.477287 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8661c-9cdd-48d7-b89b-d44dad141dda admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:00.487942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8661c-9cdd-48d7-b89b-d44dad141dda admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:00.553695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1afcd-714b-4c79-bf7c-d8accab83486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:00.554574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1afcd-714b-4c79-bf7c-d8accab83486 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:00.555122 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1afcd-714b-4c79-bf7c-d8accab83486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:00.555122 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1afcd-714b-4c79-bf7c-d8accab83486 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:00.555898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1afcd-714b-4c79-bf7c-d8accab83486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:00.557821 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1afcd-714b-4c79-bf7c-d8accab83486 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:00.585426 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 858/1726] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:00 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:00.589771 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef40889-9c09-4f24-8c03-86b28dc77b4c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:00.601072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef40889-9c09-4f24-8c03-86b28dc77b4c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:00.610507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbae58-d8a0-46d7-99d5-0c049261f31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:00.611416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbae58-d8a0-46d7-99d5-0c049261f31b admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:00.611701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbae58-d8a0-46d7-99d5-0c049261f31b admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:00.612005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbae58-d8a0-46d7-99d5-0c049261f31b admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:00.613013 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbae58-d8a0-46d7-99d5-0c049261f31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:00.615443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbae58-d8a0-46d7-99d5-0c049261f31b admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:00.627868 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 869/1727] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:00.631881 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1afcd-714b-4c79-bf7c-d8accab83486 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:00.642090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1afcd-714b-4c79-bf7c-d8accab83486 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:00.647699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc2c34-721e-4731-a3c3-2c4173cc6bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:00.648463 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc2c34-721e-4731-a3c3-2c4173cc6bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:00.648824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc2c34-721e-4731-a3c3-2c4173cc6bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:00.649182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc2c34-721e-4731-a3c3-2c4173cc6bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:00.649924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc2c34-721e-4731-a3c3-2c4173cc6bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:00.651904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc2c34-721e-4731-a3c3-2c4173cc6bf3 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:00.664065 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 859/1728] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:00.674081 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbae58-d8a0-46d7-99d5-0c049261f31b admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:00.678487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbae58-d8a0-46d7-99d5-0c049261f31b admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:00.683544 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d322d-4919-4649-a076-100774139cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:00.684561 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d322d-4919-4649-a076-100774139cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:00.684849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d322d-4919-4649-a076-100774139cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:00.685127 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d322d-4919-4649-a076-100774139cf6 admin admin] PATH_INFO: `/v3/projects/e12c214a392a4fe28103b09f4bd68cb8/users/05eb5ada22904b2b899515dcb5c839af/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:00.700284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d322d-4919-4649-a076-100774139cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e12c214a392a4fe28103b09f4bd68cb8, user_id=05eb5ada22904b2b899515dcb5c839af, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:00.703339 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d322d-4919-4649-a076-100774139cf6 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:00.717182 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 870/1729] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:00 2022] PUT /identity/v3/projects/e12c214a392a4fe28103b09f4bd68cb8/users/05eb5ada22904b2b899515dcb5c839af/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:00.727755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fccda-98ef-4279-86c3-4304492c43a9 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:00.728051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fccda-98ef-4279-86c3-4304492c43a9 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:00.728381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fccda-98ef-4279-86c3-4304492c43a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:00.762153 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b05fccda-98ef-4279-86c3-4304492c43a9 None None] MFA Rules not processed for user `05eb5ada22904b2b899515dcb5c839af`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:00.763386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b05fccda-98ef-4279-86c3-4304492c43a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:00.832634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 860/1730] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:00.838114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d322d-4919-4649-a076-100774139cf6 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:00.899856 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d322d-4919-4649-a076-100774139cf6 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:00.904511 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985aa4e-aebb-4580-b2e2-813c949367b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:00.905170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985aa4e-aebb-4580-b2e2-813c949367b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:00.905455 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985aa4e-aebb-4580-b2e2-813c949367b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:00.905728 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985aa4e-aebb-4580-b2e2-813c949367b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:00.906478 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985aa4e-aebb-4580-b2e2-813c949367b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:00.908388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985aa4e-aebb-4580-b2e2-813c949367b0 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:00.934209 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 871/1731] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:00 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:00.940896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fccda-98ef-4279-86c3-4304492c43a9 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:00.952642 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fccda-98ef-4279-86c3-4304492c43a9 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:01.008046 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b02ffa-979f-415f-9b2e-9c0086891541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:01.008713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b02ffa-979f-415f-9b2e-9c0086891541 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:01.008989 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b02ffa-979f-415f-9b2e-9c0086891541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:01.009268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b02ffa-979f-415f-9b2e-9c0086891541 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:01.009951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b02ffa-979f-415f-9b2e-9c0086891541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:01.011892 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b02ffa-979f-415f-9b2e-9c0086891541 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:01.033937 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 861/1732] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:00 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:32:01.038742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985aa4e-aebb-4580-b2e2-813c949367b0 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:01.054410 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985aa4e-aebb-4580-b2e2-813c949367b0 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:01.061076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b0bb8-7486-4cdc-b906-cc74365e0d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:01.062046 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b0bb8-7486-4cdc-b906-cc74365e0d8b admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:01.062491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b0bb8-7486-4cdc-b906-cc74365e0d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:01.062766 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b0bb8-7486-4cdc-b906-cc74365e0d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:01.063535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b0bb8-7486-4cdc-b906-cc74365e0d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:01.065142 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b0bb8-7486-4cdc-b906-cc74365e0d8b admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:01.079025 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 872/1733] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:01.082934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b02ffa-979f-415f-9b2e-9c0086891541 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:01.093210 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b02ffa-979f-415f-9b2e-9c0086891541 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:01.098032 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54c4bd-80d9-43eb-bc83-e1ab80e33c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:01.099189 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54c4bd-80d9-43eb-bc83-e1ab80e33c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:01.099473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54c4bd-80d9-43eb-bc83-e1ab80e33c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:01.099748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54c4bd-80d9-43eb-bc83-e1ab80e33c7a admin admin] PATH_INFO: `/v3/projects/ab45b60acdea44c78456aa535f2f137d/users/460e5c22a2a348e094bb6f6447e1d10d/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:01.116125 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54c4bd-80d9-43eb-bc83-e1ab80e33c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab45b60acdea44c78456aa535f2f137d, user_id=460e5c22a2a348e094bb6f6447e1d10d, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:01.118850 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54c4bd-80d9-43eb-bc83-e1ab80e33c7a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:01.133737 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 862/1734] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:01 2022] PUT /identity/v3/projects/ab45b60acdea44c78456aa535f2f137d/users/460e5c22a2a348e094bb6f6447e1d10d/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:01.139672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b0bb8-7486-4cdc-b906-cc74365e0d8b admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:01.150450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b0bb8-7486-4cdc-b906-cc74365e0d8b admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:01.210610 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6befa2c-b15f-4e63-b67c-bc12d35b4c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:01.211290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6befa2c-b15f-4e63-b67c-bc12d35b4c20 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:01.211571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6befa2c-b15f-4e63-b67c-bc12d35b4c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:01.211842 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6befa2c-b15f-4e63-b67c-bc12d35b4c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:01.212572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6befa2c-b15f-4e63-b67c-bc12d35b4c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:01.214200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6befa2c-b15f-4e63-b67c-bc12d35b4c20 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:01.225289 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 873/1735] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:01.229383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54c4bd-80d9-43eb-bc83-e1ab80e33c7a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:01.241424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54c4bd-80d9-43eb-bc83-e1ab80e33c7a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:01.246335 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897d333-3f7d-44f6-a010-2d9b8a87f5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:01.247179 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897d333-3f7d-44f6-a010-2d9b8a87f5df admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:01.247458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897d333-3f7d-44f6-a010-2d9b8a87f5df admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:01.247724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897d333-3f7d-44f6-a010-2d9b8a87f5df admin admin] PATH_INFO: `/v3/projects/ab45b60acdea44c78456aa535f2f137d/users/460e5c22a2a348e094bb6f6447e1d10d/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:01.249735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897d333-3f7d-44f6-a010-2d9b8a87f5df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab45b60acdea44c78456aa535f2f137d, user_id=460e5c22a2a348e094bb6f6447e1d10d, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:01.252538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897d333-3f7d-44f6-a010-2d9b8a87f5df admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:01.264148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 863/1736] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:01 2022] PUT /identity/v3/projects/ab45b60acdea44c78456aa535f2f137d/users/460e5c22a2a348e094bb6f6447e1d10d/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:01.274507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39396a2a-c01c-45fa-a2a8-a0170d71e5f1 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:01.274801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39396a2a-c01c-45fa-a2a8-a0170d71e5f1 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:01.275084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39396a2a-c01c-45fa-a2a8-a0170d71e5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:01.301045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-39396a2a-c01c-45fa-a2a8-a0170d71e5f1 None None] MFA Rules not processed for user `460e5c22a2a348e094bb6f6447e1d10d`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:01.303003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-39396a2a-c01c-45fa-a2a8-a0170d71e5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:01.369386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 874/1737] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:01.381186 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897d333-3f7d-44f6-a010-2d9b8a87f5df admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:01.382919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0897d333-3f7d-44f6-a010-2d9b8a87f5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:01.440916 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897d333-3f7d-44f6-a010-2d9b8a87f5df admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:01.444847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d024b3-2fd5-4c02-a8ee-068f7d158841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:01.445493 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d024b3-2fd5-4c02-a8ee-068f7d158841 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:01.445774 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d024b3-2fd5-4c02-a8ee-068f7d158841 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:01.446049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d024b3-2fd5-4c02-a8ee-068f7d158841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:01.455209 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d024b3-2fd5-4c02-a8ee-068f7d158841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:01.456696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d024b3-2fd5-4c02-a8ee-068f7d158841 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:01.467304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 864/1738] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:01.541588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39396a2a-c01c-45fa-a2a8-a0170d71e5f1 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:01.604169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39396a2a-c01c-45fa-a2a8-a0170d71e5f1 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:01.612626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c21dc4-acd1-46c1-86f7-b80cac45ed79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:01.613562 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c21dc4-acd1-46c1-86f7-b80cac45ed79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:01.614366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c21dc4-acd1-46c1-86f7-b80cac45ed79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:01.614366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c21dc4-acd1-46c1-86f7-b80cac45ed79 admin admin] PATH_INFO: `/v3/users/05eb5ada22904b2b899515dcb5c839af` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:01.616576 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c21dc4-acd1-46c1-86f7-b80cac45ed79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05eb5ada22904b2b899515dcb5c839af)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:01.618602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c21dc4-acd1-46c1-86f7-b80cac45ed79 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:01.666402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-02c21dc4-acd1-46c1-86f7-b80cac45ed79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05eb5ada22904b2b899515dcb5c839af'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:01.674153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-02c21dc4-acd1-46c1-86f7-b80cac45ed79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05eb5ada22904b2b899515dcb5c839af'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:01.676248 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-02c21dc4-acd1-46c1-86f7-b80cac45ed79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05eb5ada22904b2b899515dcb5c839af'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:01.689700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-02c21dc4-acd1-46c1-86f7-b80cac45ed79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05eb5ada22904b2b899515dcb5c839af'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:01.697911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-02c21dc4-acd1-46c1-86f7-b80cac45ed79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05eb5ada22904b2b899515dcb5c839af'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:01.706975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 875/1739] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:01 2022] DELETE /identity/v3/users/05eb5ada22904b2b899515dcb5c839af => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:01.709115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882587a-f0f6-47e7-924e-55114def8cf2 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:01.709115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882587a-f0f6-47e7-924e-55114def8cf2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:01.709656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882587a-f0f6-47e7-924e-55114def8cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:01.729626 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-8882587a-f0f6-47e7-924e-55114def8cf2 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:01.731119 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-8882587a-f0f6-47e7-924e-55114def8cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:01.798807 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 865/1740] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:01.808527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c21dc4-acd1-46c1-86f7-b80cac45ed79 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:01.810364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-02c21dc4-acd1-46c1-86f7-b80cac45ed79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:01.869856 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c21dc4-acd1-46c1-86f7-b80cac45ed79 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:01.873560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9b76-0330-47c8-82ea-7e842038d968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:01.874142 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9b76-0330-47c8-82ea-7e842038d968 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:01.874479 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9b76-0330-47c8-82ea-7e842038d968 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:01.874728 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9b76-0330-47c8-82ea-7e842038d968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:01.884322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b9b76-0330-47c8-82ea-7e842038d968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:01.885763 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b9b76-0330-47c8-82ea-7e842038d968 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:01.896398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 876/1741] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:02.215852 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882587a-f0f6-47e7-924e-55114def8cf2 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:02.217262 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-8882587a-f0f6-47e7-924e-55114def8cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:02.230557 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882587a-f0f6-47e7-924e-55114def8cf2 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:02.236352 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a58047-74e1-4799-8aaa-df12cbb94bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:02.237234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a58047-74e1-4799-8aaa-df12cbb94bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:02.237527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a58047-74e1-4799-8aaa-df12cbb94bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:02.237807 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a58047-74e1-4799-8aaa-df12cbb94bfc admin admin] PATH_INFO: `/v3/projects/e12c214a392a4fe28103b09f4bd68cb8` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:02.239068 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a58047-74e1-4799-8aaa-df12cbb94bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e12c214a392a4fe28103b09f4bd68cb8)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:02.241048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a58047-74e1-4799-8aaa-df12cbb94bfc admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:02.295656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b5a58047-74e1-4799-8aaa-df12cbb94bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e12c214a392a4fe28103b09f4bd68cb8', 'request_id': 'req-b5a58047-74e1-4799-8aaa-df12cbb94bfc'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:02.301826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b5a58047-74e1-4799-8aaa-df12cbb94bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e12c214a392a4fe28103b09f4bd68cb8', 'request_id': 'req-b5a58047-74e1-4799-8aaa-df12cbb94bfc'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:02.310447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b5a58047-74e1-4799-8aaa-df12cbb94bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e12c214a392a4fe28103b09f4bd68cb8', 'request_id': 'req-b5a58047-74e1-4799-8aaa-df12cbb94bfc'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:02.322065 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b5a58047-74e1-4799-8aaa-df12cbb94bfc admin admin] The token cache is being invalidate because project e12c214a392a4fe28103b09f4bd68cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:02.322390 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b5a58047-74e1-4799-8aaa-df12cbb94bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:02.323046 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b5a58047-74e1-4799-8aaa-df12cbb94bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:02.324608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 866/1742] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:02 2022] DELETE /identity/v3/projects/e12c214a392a4fe28103b09f4bd68cb8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:02.328943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9b76-0330-47c8-82ea-7e842038d968 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:02.338670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9b76-0330-47c8-82ea-7e842038d968 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:02.398592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f13877-4274-4ba2-999b-a16d92c27c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:02.399504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f13877-4274-4ba2-999b-a16d92c27c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:02.399782 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f13877-4274-4ba2-999b-a16d92c27c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:02.400113 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f13877-4274-4ba2-999b-a16d92c27c47 admin admin] PATH_INFO: `/v3/users/460e5c22a2a348e094bb6f6447e1d10d` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:02.401446 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f13877-4274-4ba2-999b-a16d92c27c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=460e5c22a2a348e094bb6f6447e1d10d)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:02.403431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f13877-4274-4ba2-999b-a16d92c27c47 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:02.453357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-57f13877-4274-4ba2-999b-a16d92c27c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460e5c22a2a348e094bb6f6447e1d10d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:02.460797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-57f13877-4274-4ba2-999b-a16d92c27c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460e5c22a2a348e094bb6f6447e1d10d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:02.461377 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-57f13877-4274-4ba2-999b-a16d92c27c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460e5c22a2a348e094bb6f6447e1d10d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:02.473077 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-57f13877-4274-4ba2-999b-a16d92c27c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460e5c22a2a348e094bb6f6447e1d10d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:02.480195 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-57f13877-4274-4ba2-999b-a16d92c27c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460e5c22a2a348e094bb6f6447e1d10d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:02.486319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 877/1743] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:02 2022] DELETE /identity/v3/users/460e5c22a2a348e094bb6f6447e1d10d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:02.758350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a58047-74e1-4799-8aaa-df12cbb94bfc admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:02.759905 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b5a58047-74e1-4799-8aaa-df12cbb94bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:02.772724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a58047-74e1-4799-8aaa-df12cbb94bfc admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:02.840472 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb62999-1b73-44da-bcec-e24549457bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:02.841339 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb62999-1b73-44da-bcec-e24549457bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:02.841621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb62999-1b73-44da-bcec-e24549457bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:02.841910 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb62999-1b73-44da-bcec-e24549457bff admin admin] PATH_INFO: `/v3/projects/ab45b60acdea44c78456aa535f2f137d` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:02.843134 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb62999-1b73-44da-bcec-e24549457bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab45b60acdea44c78456aa535f2f137d)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:02.845048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb62999-1b73-44da-bcec-e24549457bff admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:02.901273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4eb62999-1b73-44da-bcec-e24549457bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab45b60acdea44c78456aa535f2f137d', 'request_id': 'req-4eb62999-1b73-44da-bcec-e24549457bff'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:02.907848 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4eb62999-1b73-44da-bcec-e24549457bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab45b60acdea44c78456aa535f2f137d', 'request_id': 'req-4eb62999-1b73-44da-bcec-e24549457bff'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:02.919963 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4eb62999-1b73-44da-bcec-e24549457bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab45b60acdea44c78456aa535f2f137d', 'request_id': 'req-4eb62999-1b73-44da-bcec-e24549457bff'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:02.932035 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4eb62999-1b73-44da-bcec-e24549457bff admin admin] The token cache is being invalidate because project ab45b60acdea44c78456aa535f2f137d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:02.932327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4eb62999-1b73-44da-bcec-e24549457bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:02.932968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4eb62999-1b73-44da-bcec-e24549457bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:02.934561 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 867/1744] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:02 2022] DELETE /identity/v3/projects/ab45b60acdea44c78456aa535f2f137d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:02.939474 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ad4c2-b2fe-49a4-a153-e6709d146fa6 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:02.939960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ad4c2-b2fe-49a4-a153-e6709d146fa6 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:02.940045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ad4c2-b2fe-49a4-a153-e6709d146fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:02.961504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-b34ad4c2-b2fe-49a4-a153-e6709d146fa6 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:02.962827 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b34ad4c2-b2fe-49a4-a153-e6709d146fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:03.022879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 878/1745] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:03.031487 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14cb05-c929-4ecb-81f7-e21741913d45 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:03.031826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14cb05-c929-4ecb-81f7-e21741913d45 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:03.032110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14cb05-c929-4ecb-81f7-e21741913d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:03.050805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-1a14cb05-c929-4ecb-81f7-e21741913d45 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:03.052638 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1a14cb05-c929-4ecb-81f7-e21741913d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:03.060530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 868/1746] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:03.064734 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ad4c2-b2fe-49a4-a153-e6709d146fa6 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:03.074565 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ad4c2-b2fe-49a4-a153-e6709d146fa6 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:03.079448 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a671273-13c7-43b1-9fd6-48af39243016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:03.080118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671273-13c7-43b1-9fd6-48af39243016 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:03.080402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671273-13c7-43b1-9fd6-48af39243016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:03.080676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671273-13c7-43b1-9fd6-48af39243016 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:03.081396 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a671273-13c7-43b1-9fd6-48af39243016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:32:03.081707 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a671273-13c7-43b1-9fd6-48af39243016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:03.083373 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a671273-13c7-43b1-9fd6-48af39243016 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:03.094658 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 879/1747] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:32:03.099419 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14cb05-c929-4ecb-81f7-e21741913d45 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:03.108662 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14cb05-c929-4ecb-81f7-e21741913d45 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:03.113447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db110b1f-580c-4b81-9320-874d9f8fb713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:03.114094 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db110b1f-580c-4b81-9320-874d9f8fb713 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:03.115114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db110b1f-580c-4b81-9320-874d9f8fb713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:03.115469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db110b1f-580c-4b81-9320-874d9f8fb713 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:03.116176 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db110b1f-580c-4b81-9320-874d9f8fb713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:03.118076 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db110b1f-580c-4b81-9320-874d9f8fb713 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:03.142716 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 869/1748] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:03 2022] POST /identity/v3/projects => generated 407 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:03.147041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a671273-13c7-43b1-9fd6-48af39243016 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:03.157406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a671273-13c7-43b1-9fd6-48af39243016 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:03.214294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6626e-34a7-4b4b-bfac-a99ddcf8be4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:03.214972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6626e-34a7-4b4b-bfac-a99ddcf8be4f admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:03.215259 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6626e-34a7-4b4b-bfac-a99ddcf8be4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:03.215539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6626e-34a7-4b4b-bfac-a99ddcf8be4f admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:03.216244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6626e-34a7-4b4b-bfac-a99ddcf8be4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:03.218236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6626e-34a7-4b4b-bfac-a99ddcf8be4f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:03.238269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 880/1749] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:03 2022] POST /identity/v3/users => generated 304 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:03.242293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db110b1f-580c-4b81-9320-874d9f8fb713 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:03.255565 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db110b1f-580c-4b81-9320-874d9f8fb713 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:03.260803 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed241c-ba22-4851-b646-75330771f5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:03.261474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed241c-ba22-4851-b646-75330771f5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:03.261908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed241c-ba22-4851-b646-75330771f5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:03.262220 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed241c-ba22-4851-b646-75330771f5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:03.263078 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed241c-ba22-4851-b646-75330771f5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:03.264560 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed241c-ba22-4851-b646-75330771f5a1 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:03.278244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 870/1750] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:03.283771 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6626e-34a7-4b4b-bfac-a99ddcf8be4f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:03.295933 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6626e-34a7-4b4b-bfac-a99ddcf8be4f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:03.303455 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad47a8-b134-457c-abca-c43a55ec8c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:03.304286 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad47a8-b134-457c-abca-c43a55ec8c48 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:03.304646 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad47a8-b134-457c-abca-c43a55ec8c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:03.305058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad47a8-b134-457c-abca-c43a55ec8c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:03.307079 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad47a8-b134-457c-abca-c43a55ec8c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:03.307620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad47a8-b134-457c-abca-c43a55ec8c48 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:03.318977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 881/1751] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:32:03.324215 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed241c-ba22-4851-b646-75330771f5a1 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:03.350425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed241c-ba22-4851-b646-75330771f5a1 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:03.357114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b761b-2a85-4f7a-b0a2-5015749f469c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:03.358332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b761b-2a85-4f7a-b0a2-5015749f469c admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:03.358771 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b761b-2a85-4f7a-b0a2-5015749f469c admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:03.359108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b761b-2a85-4f7a-b0a2-5015749f469c admin admin] PATH_INFO: `/v3/projects/4571561a4f6b4bdbb914a8a3e96fd875/users/8e050c8fffa84c62bc6f0b6b87f8a025/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:03.375502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b761b-2a85-4f7a-b0a2-5015749f469c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4571561a4f6b4bdbb914a8a3e96fd875, user_id=8e050c8fffa84c62bc6f0b6b87f8a025, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:03.378377 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b761b-2a85-4f7a-b0a2-5015749f469c admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:03.391669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 871/1752] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:03 2022] PUT /identity/v3/projects/4571561a4f6b4bdbb914a8a3e96fd875/users/8e050c8fffa84c62bc6f0b6b87f8a025/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:03.402905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758c577-3472-4faf-9180-75f1b01c9626 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:03.403207 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758c577-3472-4faf-9180-75f1b01c9626 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:03.403578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758c577-3472-4faf-9180-75f1b01c9626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:03.432922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-6758c577-3472-4faf-9180-75f1b01c9626 None None] MFA Rules not processed for user `8e050c8fffa84c62bc6f0b6b87f8a025`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:03.434377 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6758c577-3472-4faf-9180-75f1b01c9626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:03.511071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 882/1753] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:03.515808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b761b-2a85-4f7a-b0a2-5015749f469c admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:03.592085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b761b-2a85-4f7a-b0a2-5015749f469c admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:03.597619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a086e1-a15e-4d83-bb59-79c0da0ab635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:03.598432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a086e1-a15e-4d83-bb59-79c0da0ab635 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:03.599090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a086e1-a15e-4d83-bb59-79c0da0ab635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:03.602461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a086e1-a15e-4d83-bb59-79c0da0ab635 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:03.603416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a086e1-a15e-4d83-bb59-79c0da0ab635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:03.605811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a086e1-a15e-4d83-bb59-79c0da0ab635 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:03.633719 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 872/1754] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:03 2022] POST /identity/v3/projects => generated 409 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:03.637854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758c577-3472-4faf-9180-75f1b01c9626 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:03.649422 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758c577-3472-4faf-9180-75f1b01c9626 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:03.711997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1485864-2773-4fc1-b440-9149560c5778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:03.712683 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485864-2773-4fc1-b440-9149560c5778 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:03.712968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485864-2773-4fc1-b440-9149560c5778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:03.713312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485864-2773-4fc1-b440-9149560c5778 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:03.713972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1485864-2773-4fc1-b440-9149560c5778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:03.715882 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1485864-2773-4fc1-b440-9149560c5778 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:03.738247 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 883/1755] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:03 2022] POST /identity/v3/users => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:32:03.741418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a086e1-a15e-4d83-bb59-79c0da0ab635 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:03.751631 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a086e1-a15e-4d83-bb59-79c0da0ab635 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:03.756498 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49ceb9-8657-4b2c-90a0-4fbcf42442db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:03.757167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49ceb9-8657-4b2c-90a0-4fbcf42442db admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:03.757451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49ceb9-8657-4b2c-90a0-4fbcf42442db admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:03.757730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49ceb9-8657-4b2c-90a0-4fbcf42442db admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:03.758494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49ceb9-8657-4b2c-90a0-4fbcf42442db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:03.760102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49ceb9-8657-4b2c-90a0-4fbcf42442db admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:03.771751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 873/1756] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:03.776146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1485864-2773-4fc1-b440-9149560c5778 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:03.786688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1485864-2773-4fc1-b440-9149560c5778 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:03.791550 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c7dc1-1171-480a-a1c9-53fc83e6d6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:03.792429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c7dc1-1171-480a-a1c9-53fc83e6d6c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:03.792711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c7dc1-1171-480a-a1c9-53fc83e6d6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:03.792987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c7dc1-1171-480a-a1c9-53fc83e6d6c0 admin admin] PATH_INFO: `/v3/projects/e2b9cc4a21494a6baba0dc390c87b58a/users/e94975626e2342b29396dc1c1a23d260/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:03.808496 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c7dc1-1171-480a-a1c9-53fc83e6d6c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b9cc4a21494a6baba0dc390c87b58a, user_id=e94975626e2342b29396dc1c1a23d260, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:03.811244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c7dc1-1171-480a-a1c9-53fc83e6d6c0 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:03.825896 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 884/1757] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:03 2022] PUT /identity/v3/projects/e2b9cc4a21494a6baba0dc390c87b58a/users/e94975626e2342b29396dc1c1a23d260/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:03.830089 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49ceb9-8657-4b2c-90a0-4fbcf42442db admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:03.841874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49ceb9-8657-4b2c-90a0-4fbcf42442db admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:03.901666 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94d39f-9979-4c84-9455-0e66bcde0b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:03.902364 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94d39f-9979-4c84-9455-0e66bcde0b52 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:03.902648 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94d39f-9979-4c84-9455-0e66bcde0b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:03.902922 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94d39f-9979-4c84-9455-0e66bcde0b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:03.903636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94d39f-9979-4c84-9455-0e66bcde0b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:03.905225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94d39f-9979-4c84-9455-0e66bcde0b52 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:03.920028 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 874/1758] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:03.923914 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c7dc1-1171-480a-a1c9-53fc83e6d6c0 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:03.934781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c7dc1-1171-480a-a1c9-53fc83e6d6c0 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:03.939781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cb89b-f5ba-4156-8852-28fc1906a648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:03.940659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cb89b-f5ba-4156-8852-28fc1906a648 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:03.940941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cb89b-f5ba-4156-8852-28fc1906a648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:03.941218 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cb89b-f5ba-4156-8852-28fc1906a648 admin admin] PATH_INFO: `/v3/projects/e2b9cc4a21494a6baba0dc390c87b58a/users/e94975626e2342b29396dc1c1a23d260/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:03.943839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cb89b-f5ba-4156-8852-28fc1906a648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b9cc4a21494a6baba0dc390c87b58a, user_id=e94975626e2342b29396dc1c1a23d260, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:03.946528 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cb89b-f5ba-4156-8852-28fc1906a648 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:03.957094 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 885/1759] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:03 2022] PUT /identity/v3/projects/e2b9cc4a21494a6baba0dc390c87b58a/users/e94975626e2342b29396dc1c1a23d260/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:03.969016 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c390d-09d3-4859-b9bb-c9ef4505d514 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:03.969303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c390d-09d3-4859-b9bb-c9ef4505d514 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:03.969581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c390d-09d3-4859-b9bb-c9ef4505d514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:03.997506 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-1c1c390d-09d3-4859-b9bb-c9ef4505d514 None None] MFA Rules not processed for user `e94975626e2342b29396dc1c1a23d260`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:03.998754 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1c1c390d-09d3-4859-b9bb-c9ef4505d514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:04.066344 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 875/1760] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:03 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:04.078054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cb89b-f5ba-4156-8852-28fc1906a648 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:04.079773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-cd5cb89b-f5ba-4156-8852-28fc1906a648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:04.137802 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cb89b-f5ba-4156-8852-28fc1906a648 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:04.141484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d05110-a840-4171-bfb0-8318880e007b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:04.142126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d05110-a840-4171-bfb0-8318880e007b service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:04.142445 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d05110-a840-4171-bfb0-8318880e007b service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:04.142722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d05110-a840-4171-bfb0-8318880e007b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:04.152956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d05110-a840-4171-bfb0-8318880e007b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:04.154433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d05110-a840-4171-bfb0-8318880e007b service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:04.165322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 886/1761] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:04 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:04.332412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c390d-09d3-4859-b9bb-c9ef4505d514 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:04.342101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c390d-09d3-4859-b9bb-c9ef4505d514 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:04.345632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc589d-0293-459b-a110-db0e0e11d92a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:04.346307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc589d-0293-459b-a110-db0e0e11d92a service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:04.346588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc589d-0293-459b-a110-db0e0e11d92a service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:04.346864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc589d-0293-459b-a110-db0e0e11d92a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:04.408215 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc589d-0293-459b-a110-db0e0e11d92a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:04.409667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc589d-0293-459b-a110-db0e0e11d92a service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:04.419572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 876/1762] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:04 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:13.579908 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708c252-9f88-4005-a7c6-65d7cb6ec504 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:13.580534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708c252-9f88-4005-a7c6-65d7cb6ec504 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:13.580643 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708c252-9f88-4005-a7c6-65d7cb6ec504 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:13.582037 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 887/1763] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 14:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 14:32:13.591694 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad1d89-94cf-40b6-b81e-5ae21e254ca4 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:13.592204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad1d89-94cf-40b6-b81e-5ae21e254ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:13.592393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad1d89-94cf-40b6-b81e-5ae21e254ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:13.609927 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-c6ad1d89-94cf-40b6-b81e-5ae21e254ca4 None None] MFA Rules not processed for user `1f443d2ca1534249bb2c4096300ddffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:13.611286 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c6ad1d89-94cf-40b6-b81e-5ae21e254ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:13.681863 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 877/1764] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 14:32:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:13.696658 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708c252-9f88-4005-a7c6-65d7cb6ec504 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:13.698650 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5708c252-9f88-4005-a7c6-65d7cb6ec504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:13.717969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708c252-9f88-4005-a7c6-65d7cb6ec504 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:13.723980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d90b55-1f51-422c-84e8-ff7d6da6c531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:13.724631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d90b55-1f51-422c-84e8-ff7d6da6c531 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:13.724917 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d90b55-1f51-422c-84e8-ff7d6da6c531 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:13.725197 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d90b55-1f51-422c-84e8-ff7d6da6c531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:13.734988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d90b55-1f51-422c-84e8-ff7d6da6c531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:13.736592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d90b55-1f51-422c-84e8-ff7d6da6c531 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:13.747158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 888/1765] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:13.827791 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad1d89-94cf-40b6-b81e-5ae21e254ca4 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:13.829319 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c6ad1d89-94cf-40b6-b81e-5ae21e254ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:13.905549 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad1d89-94cf-40b6-b81e-5ae21e254ca4 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:13.911701 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad9550-f9e3-43e8-a047-07051dd6bf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:13.912009 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9550-f9e3-43e8-a047-07051dd6bf7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:13.912213 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9550-f9e3-43e8-a047-07051dd6bf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:13.912490 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9550-f9e3-43e8-a047-07051dd6bf7a admin admin] PATH_INFO: `/v3/users/e407e6fa087044d9a32bceb067dd6bf3` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:13.913718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad9550-f9e3-43e8-a047-07051dd6bf7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e407e6fa087044d9a32bceb067dd6bf3)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:13.915679 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad9550-f9e3-43e8-a047-07051dd6bf7a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:13.963268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-42ad9550-f9e3-43e8-a047-07051dd6bf7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e407e6fa087044d9a32bceb067dd6bf3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:13.969940 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-42ad9550-f9e3-43e8-a047-07051dd6bf7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e407e6fa087044d9a32bceb067dd6bf3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:13.970644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-42ad9550-f9e3-43e8-a047-07051dd6bf7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e407e6fa087044d9a32bceb067dd6bf3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:13.982890 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-42ad9550-f9e3-43e8-a047-07051dd6bf7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e407e6fa087044d9a32bceb067dd6bf3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:13.991207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-42ad9550-f9e3-43e8-a047-07051dd6bf7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e407e6fa087044d9a32bceb067dd6bf3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:13.997195 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 878/1766] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:13 2022] DELETE /identity/v3/users/e407e6fa087044d9a32bceb067dd6bf3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:14.001827 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d021aa-30f1-49b3-b978-472395d78601 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:14.002355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d021aa-30f1-49b3-b978-472395d78601 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:14.002623 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d021aa-30f1-49b3-b978-472395d78601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:14.022046 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-50d021aa-30f1-49b3-b978-472395d78601 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:14.023256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-50d021aa-30f1-49b3-b978-472395d78601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:14.082109 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 889/1767] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:14.092454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad9550-f9e3-43e8-a047-07051dd6bf7a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:14.093851 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-42ad9550-f9e3-43e8-a047-07051dd6bf7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:14.156818 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad9550-f9e3-43e8-a047-07051dd6bf7a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:14.162265 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e5b75-91c1-4014-93eb-4bfb2117ee49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:14.162969 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e5b75-91c1-4014-93eb-4bfb2117ee49 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:14.163302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e5b75-91c1-4014-93eb-4bfb2117ee49 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:14.163693 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e5b75-91c1-4014-93eb-4bfb2117ee49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:14.173447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e5b75-91c1-4014-93eb-4bfb2117ee49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:14.174917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e5b75-91c1-4014-93eb-4bfb2117ee49 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:14.184150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 879/1768] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:14.499884 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d021aa-30f1-49b3-b978-472395d78601 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:14.501285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-50d021aa-30f1-49b3-b978-472395d78601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:14.513295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d021aa-30f1-49b3-b978-472395d78601 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:14.518309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:14.519340 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:14.519790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:14.521006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1 admin admin] PATH_INFO: `/v3/projects/eed06257772147bcb65f3912cb4394b6` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:14.522719 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed06257772147bcb65f3912cb4394b6)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:14.525077 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:14.595616 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed06257772147bcb65f3912cb4394b6', 'request_id': 'req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:14.606350 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed06257772147bcb65f3912cb4394b6', 'request_id': 'req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:14.618349 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed06257772147bcb65f3912cb4394b6', 'request_id': 'req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:14.630520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1 admin admin] The token cache is being invalidate because project eed06257772147bcb65f3912cb4394b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:14.630816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:14.631481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:14.635879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 890/1769] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:14 2022] DELETE /identity/v3/projects/eed06257772147bcb65f3912cb4394b6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:14.637320 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e5b75-91c1-4014-93eb-4bfb2117ee49 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:14.648575 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e5b75-91c1-4014-93eb-4bfb2117ee49 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:14.708861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9690175-bfee-4476-857f-6df972766778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:14.709731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9690175-bfee-4476-857f-6df972766778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:14.710011 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9690175-bfee-4476-857f-6df972766778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:14.710345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9690175-bfee-4476-857f-6df972766778 admin admin] PATH_INFO: `/v3/users/992bf9e2464e4b29887f1b3169e031d0` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:14.711515 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9690175-bfee-4476-857f-6df972766778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=992bf9e2464e4b29887f1b3169e031d0)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:14.713428 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9690175-bfee-4476-857f-6df972766778 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:14.759573 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f9690175-bfee-4476-857f-6df972766778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '992bf9e2464e4b29887f1b3169e031d0'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:14.766456 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f9690175-bfee-4476-857f-6df972766778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '992bf9e2464e4b29887f1b3169e031d0'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:14.767130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f9690175-bfee-4476-857f-6df972766778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '992bf9e2464e4b29887f1b3169e031d0'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:14.778388 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f9690175-bfee-4476-857f-6df972766778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '992bf9e2464e4b29887f1b3169e031d0'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:14.785276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f9690175-bfee-4476-857f-6df972766778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '992bf9e2464e4b29887f1b3169e031d0'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:14.791247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 880/1770] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:14 2022] DELETE /identity/v3/users/992bf9e2464e4b29887f1b3169e031d0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:15.087875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:15.089565 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:15.108162 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d029365-62c6-4e28-8895-f8bd2f2ac8c1 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:15.175270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb23b37-583b-4d2c-978e-70b07acd134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:15.176155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb23b37-583b-4d2c-978e-70b07acd134f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:15.176618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb23b37-583b-4d2c-978e-70b07acd134f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:15.176989 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb23b37-583b-4d2c-978e-70b07acd134f admin admin] PATH_INFO: `/v3/projects/6a827e20174741a5880beb85cde8f6e2` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:15.178871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb23b37-583b-4d2c-978e-70b07acd134f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a827e20174741a5880beb85cde8f6e2)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:15.180229 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb23b37-583b-4d2c-978e-70b07acd134f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:15.227732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3fb23b37-583b-4d2c-978e-70b07acd134f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a827e20174741a5880beb85cde8f6e2', 'request_id': 'req-3fb23b37-583b-4d2c-978e-70b07acd134f'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:15.234418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3fb23b37-583b-4d2c-978e-70b07acd134f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a827e20174741a5880beb85cde8f6e2', 'request_id': 'req-3fb23b37-583b-4d2c-978e-70b07acd134f'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:15.243106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3fb23b37-583b-4d2c-978e-70b07acd134f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a827e20174741a5880beb85cde8f6e2', 'request_id': 'req-3fb23b37-583b-4d2c-978e-70b07acd134f'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:15.253777 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3fb23b37-583b-4d2c-978e-70b07acd134f admin admin] The token cache is being invalidate because project 6a827e20174741a5880beb85cde8f6e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:15.254074 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3fb23b37-583b-4d2c-978e-70b07acd134f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:15.255361 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3fb23b37-583b-4d2c-978e-70b07acd134f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:15.256675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 891/1771] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:15 2022] DELETE /identity/v3/projects/6a827e20174741a5880beb85cde8f6e2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:15.261926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ead963-ae30-4381-bd98-04970f1b8c92 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:15.262247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ead963-ae30-4381-bd98-04970f1b8c92 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:15.262533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ead963-ae30-4381-bd98-04970f1b8c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:15.282276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b6ead963-ae30-4381-bd98-04970f1b8c92 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:15.283488 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b6ead963-ae30-4381-bd98-04970f1b8c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:15.344996 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 881/1772] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:15.352754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921bc0-3703-415c-8f0f-b89ac263a74a None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:15.353043 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921bc0-3703-415c-8f0f-b89ac263a74a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:15.353321 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66921bc0-3703-415c-8f0f-b89ac263a74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:15.372233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-66921bc0-3703-415c-8f0f-b89ac263a74a None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:15.373587 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-66921bc0-3703-415c-8f0f-b89ac263a74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:15.382429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 892/1773] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:15.386538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ead963-ae30-4381-bd98-04970f1b8c92 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:15.396138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ead963-ae30-4381-bd98-04970f1b8c92 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:15.400678 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c765f36-811c-4b32-830c-26d6950ff3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:15.401329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c765f36-811c-4b32-830c-26d6950ff3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:15.401613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c765f36-811c-4b32-830c-26d6950ff3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:15.401891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c765f36-811c-4b32-830c-26d6950ff3a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:15.402658 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c765f36-811c-4b32-830c-26d6950ff3a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:32:15.402968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c765f36-811c-4b32-830c-26d6950ff3a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:15.404566 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c765f36-811c-4b32-830c-26d6950ff3a8 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:15.416341 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 882/1774] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:32:15.420657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66921bc0-3703-415c-8f0f-b89ac263a74a None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:15.430441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66921bc0-3703-415c-8f0f-b89ac263a74a None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:15.434992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392e0ca-b0aa-4356-a9b7-71dcd08e7e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:15.435638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392e0ca-b0aa-4356-a9b7-71dcd08e7e61 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:15.435922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392e0ca-b0aa-4356-a9b7-71dcd08e7e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:15.436195 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392e0ca-b0aa-4356-a9b7-71dcd08e7e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:15.436887 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392e0ca-b0aa-4356-a9b7-71dcd08e7e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:15.438837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392e0ca-b0aa-4356-a9b7-71dcd08e7e61 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:15.464250 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 893/1775] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:15 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:15.468544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c765f36-811c-4b32-830c-26d6950ff3a8 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:15.478310 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c765f36-811c-4b32-830c-26d6950ff3a8 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:15.532480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b71b68-612f-4a5f-8dd9-0237c0717e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:15.533150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b71b68-612f-4a5f-8dd9-0237c0717e96 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:15.533435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b71b68-612f-4a5f-8dd9-0237c0717e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:15.533707 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b71b68-612f-4a5f-8dd9-0237c0717e96 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:15.534439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b71b68-612f-4a5f-8dd9-0237c0717e96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:15.537026 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b71b68-612f-4a5f-8dd9-0237c0717e96 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:15.557431 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 883/1776] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:15 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:15.561743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392e0ca-b0aa-4356-a9b7-71dcd08e7e61 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:15.572772 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392e0ca-b0aa-4356-a9b7-71dcd08e7e61 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:15.577580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e493a-1c81-40c1-9705-c32b5800d9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:15.578304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e493a-1c81-40c1-9705-c32b5800d9ac admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:15.578593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e493a-1c81-40c1-9705-c32b5800d9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:15.578876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e493a-1c81-40c1-9705-c32b5800d9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:15.579605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e493a-1c81-40c1-9705-c32b5800d9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:15.581247 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e493a-1c81-40c1-9705-c32b5800d9ac admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:15.591982 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 894/1777] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:15.596027 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b71b68-612f-4a5f-8dd9-0237c0717e96 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:15.606000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b71b68-612f-4a5f-8dd9-0237c0717e96 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:15.610727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32473b27-a320-4c0b-9985-f60ad2a06416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:15.611379 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32473b27-a320-4c0b-9985-f60ad2a06416 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:15.611664 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32473b27-a320-4c0b-9985-f60ad2a06416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:15.611936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32473b27-a320-4c0b-9985-f60ad2a06416 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:15.612649 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32473b27-a320-4c0b-9985-f60ad2a06416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:15.614767 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32473b27-a320-4c0b-9985-f60ad2a06416 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:15.624995 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 884/1778] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:32:15.629055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e493a-1c81-40c1-9705-c32b5800d9ac admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:15.640172 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e493a-1c81-40c1-9705-c32b5800d9ac admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:15.644899 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5988b4-f93d-4cdb-ad8d-dee73dd4a8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:15.645780 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5988b4-f93d-4cdb-ad8d-dee73dd4a8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:15.646054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5988b4-f93d-4cdb-ad8d-dee73dd4a8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:15.646361 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5988b4-f93d-4cdb-ad8d-dee73dd4a8d5 admin admin] PATH_INFO: `/v3/projects/9b8ebcedc9e74e9fb1e8c1d675e16493/users/4b76e73acc244589ac46fee6cdcc4739/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:15.661778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5988b4-f93d-4cdb-ad8d-dee73dd4a8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b8ebcedc9e74e9fb1e8c1d675e16493, user_id=4b76e73acc244589ac46fee6cdcc4739, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:15.664746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5988b4-f93d-4cdb-ad8d-dee73dd4a8d5 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:15.678057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 895/1779] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:15 2022] PUT /identity/v3/projects/9b8ebcedc9e74e9fb1e8c1d675e16493/users/4b76e73acc244589ac46fee6cdcc4739/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:15.688360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5c54f-a42b-461e-a7d9-240546d4546a None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:15.688822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5c54f-a42b-461e-a7d9-240546d4546a None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:15.688947 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5c54f-a42b-461e-a7d9-240546d4546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:15.720418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-71d5c54f-a42b-461e-a7d9-240546d4546a None None] MFA Rules not processed for user `4b76e73acc244589ac46fee6cdcc4739`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:15.721801 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-71d5c54f-a42b-461e-a7d9-240546d4546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:15.802132 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 885/1780] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:15.806704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5988b4-f93d-4cdb-ad8d-dee73dd4a8d5 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:15.883391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5988b4-f93d-4cdb-ad8d-dee73dd4a8d5 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:15.888023 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96ee6-0021-44af-aa94-396f3f06af8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:15.888682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96ee6-0021-44af-aa94-396f3f06af8f admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:15.888968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96ee6-0021-44af-aa94-396f3f06af8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:15.889276 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96ee6-0021-44af-aa94-396f3f06af8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:15.889981 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b96ee6-0021-44af-aa94-396f3f06af8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:15.891931 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b96ee6-0021-44af-aa94-396f3f06af8f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:15.916430 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 896/1781] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:15 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:15.920714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5c54f-a42b-461e-a7d9-240546d4546a None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:15.931179 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5c54f-a42b-461e-a7d9-240546d4546a None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:15.985494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869d8d2-d70e-4ce0-ba7a-b701decc5e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:15.986079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869d8d2-d70e-4ce0-ba7a-b701decc5e4b admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:15.986386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869d8d2-d70e-4ce0-ba7a-b701decc5e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:15.986658 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869d8d2-d70e-4ce0-ba7a-b701decc5e4b admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:15.987345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869d8d2-d70e-4ce0-ba7a-b701decc5e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:15.989450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869d8d2-d70e-4ce0-ba7a-b701decc5e4b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:16.009682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 886/1782] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:15 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:16.013851 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96ee6-0021-44af-aa94-396f3f06af8f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:16.024470 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96ee6-0021-44af-aa94-396f3f06af8f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:16.029088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031a52b-1316-43b8-a24e-b7e4cdfd9399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:16.029742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031a52b-1316-43b8-a24e-b7e4cdfd9399 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:16.030025 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031a52b-1316-43b8-a24e-b7e4cdfd9399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:16.030333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031a52b-1316-43b8-a24e-b7e4cdfd9399 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:16.031052 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031a52b-1316-43b8-a24e-b7e4cdfd9399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:16.032652 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031a52b-1316-43b8-a24e-b7e4cdfd9399 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:16.043552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 897/1783] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:16.047956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869d8d2-d70e-4ce0-ba7a-b701decc5e4b admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:16.058383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869d8d2-d70e-4ce0-ba7a-b701decc5e4b admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:16.063062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaebd18-0793-4a13-bc10-ecd885e7fdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:16.064209 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaebd18-0793-4a13-bc10-ecd885e7fdc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:16.064556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaebd18-0793-4a13-bc10-ecd885e7fdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:16.064875 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaebd18-0793-4a13-bc10-ecd885e7fdc2 admin admin] PATH_INFO: `/v3/projects/4aeae46b9a314d1886a52813c9d8d2c6/users/1aa11f853d354149b71527ff4059d8e9/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:16.080606 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaebd18-0793-4a13-bc10-ecd885e7fdc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aeae46b9a314d1886a52813c9d8d2c6, user_id=1aa11f853d354149b71527ff4059d8e9, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:16.083388 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaebd18-0793-4a13-bc10-ecd885e7fdc2 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:16.096803 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 887/1784] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:16 2022] PUT /identity/v3/projects/4aeae46b9a314d1886a52813c9d8d2c6/users/1aa11f853d354149b71527ff4059d8e9/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:16.100769 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031a52b-1316-43b8-a24e-b7e4cdfd9399 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:16.110774 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031a52b-1316-43b8-a24e-b7e4cdfd9399 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:16.168749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7d5e2-3962-4a72-8a69-5adcd755a61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:16.169459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7d5e2-3962-4a72-8a69-5adcd755a61f admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:16.169747 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7d5e2-3962-4a72-8a69-5adcd755a61f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:16.170056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7d5e2-3962-4a72-8a69-5adcd755a61f admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:16.170818 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7d5e2-3962-4a72-8a69-5adcd755a61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:16.172427 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7d5e2-3962-4a72-8a69-5adcd755a61f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:16.185861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 898/1785] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:16.187054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaebd18-0793-4a13-bc10-ecd885e7fdc2 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:16.197549 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaebd18-0793-4a13-bc10-ecd885e7fdc2 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:16.202527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae36900-df0c-43c0-887d-87f0f1bdf4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:16.203507 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae36900-df0c-43c0-887d-87f0f1bdf4ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:16.203795 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae36900-df0c-43c0-887d-87f0f1bdf4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:16.204074 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae36900-df0c-43c0-887d-87f0f1bdf4ab admin admin] PATH_INFO: `/v3/projects/4aeae46b9a314d1886a52813c9d8d2c6/users/1aa11f853d354149b71527ff4059d8e9/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:16.206080 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae36900-df0c-43c0-887d-87f0f1bdf4ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aeae46b9a314d1886a52813c9d8d2c6, user_id=1aa11f853d354149b71527ff4059d8e9, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:16.209599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae36900-df0c-43c0-887d-87f0f1bdf4ab admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:16.220336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 888/1786] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:16 2022] PUT /identity/v3/projects/4aeae46b9a314d1886a52813c9d8d2c6/users/1aa11f853d354149b71527ff4059d8e9/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:16.231827 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e45356-5118-4500-a32e-f980b6d181a5 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:16.232112 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e45356-5118-4500-a32e-f980b6d181a5 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:16.232388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e45356-5118-4500-a32e-f980b6d181a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:16.260363 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-46e45356-5118-4500-a32e-f980b6d181a5 None None] MFA Rules not processed for user `1aa11f853d354149b71527ff4059d8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:16.261581 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-46e45356-5118-4500-a32e-f980b6d181a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:16.330420 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 899/1787] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:16.341751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae36900-df0c-43c0-887d-87f0f1bdf4ab admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:16.343473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-9ae36900-df0c-43c0-887d-87f0f1bdf4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:16.405741 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae36900-df0c-43c0-887d-87f0f1bdf4ab admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:16.409787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddeb96-afb1-4d87-85c2-95852cba61b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:16.411073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddeb96-afb1-4d87-85c2-95852cba61b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:16.411382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddeb96-afb1-4d87-85c2-95852cba61b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:16.411686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddeb96-afb1-4d87-85c2-95852cba61b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:16.421940 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddeb96-afb1-4d87-85c2-95852cba61b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:16.423488 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddeb96-afb1-4d87-85c2-95852cba61b4 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:16.433988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 889/1788] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:16.806890 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e45356-5118-4500-a32e-f980b6d181a5 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:16.876270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e45356-5118-4500-a32e-f980b6d181a5 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:16.882116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fac58c-6e30-4315-bb5b-d7a4e0c7c5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:16.883021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fac58c-6e30-4315-bb5b-d7a4e0c7c5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:16.883303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fac58c-6e30-4315-bb5b-d7a4e0c7c5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:16.883582 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fac58c-6e30-4315-bb5b-d7a4e0c7c5d3 admin admin] PATH_INFO: `/v3/users/4b76e73acc244589ac46fee6cdcc4739` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:16.884798 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fac58c-6e30-4315-bb5b-d7a4e0c7c5d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b76e73acc244589ac46fee6cdcc4739)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:16.886786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fac58c-6e30-4315-bb5b-d7a4e0c7c5d3 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:16.937931 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a5fac58c-6e30-4315-bb5b-d7a4e0c7c5d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b76e73acc244589ac46fee6cdcc4739'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:16.947705 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a5fac58c-6e30-4315-bb5b-d7a4e0c7c5d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b76e73acc244589ac46fee6cdcc4739'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:16.948402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a5fac58c-6e30-4315-bb5b-d7a4e0c7c5d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b76e73acc244589ac46fee6cdcc4739'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:16.960782 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a5fac58c-6e30-4315-bb5b-d7a4e0c7c5d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b76e73acc244589ac46fee6cdcc4739'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:16.967530 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a5fac58c-6e30-4315-bb5b-d7a4e0c7c5d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b76e73acc244589ac46fee6cdcc4739'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:16.974413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 900/1789] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:16 2022] DELETE /identity/v3/users/4b76e73acc244589ac46fee6cdcc4739 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:16.978444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230521e-ee6e-49a5-a7cc-03584165ae42 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:16.978927 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230521e-ee6e-49a5-a7cc-03584165ae42 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:16.979018 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230521e-ee6e-49a5-a7cc-03584165ae42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:16.997158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-e230521e-ee6e-49a5-a7cc-03584165ae42 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:16.998342 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e230521e-ee6e-49a5-a7cc-03584165ae42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:17.057294 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 890/1790] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:17.070137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fac58c-6e30-4315-bb5b-d7a4e0c7c5d3 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:17.071549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a5fac58c-6e30-4315-bb5b-d7a4e0c7c5d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:17.128765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fac58c-6e30-4315-bb5b-d7a4e0c7c5d3 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:17.133320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b99eb-0477-4673-a046-726dcc2d2447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:17.133992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b99eb-0477-4673-a046-726dcc2d2447 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:17.134327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b99eb-0477-4673-a046-726dcc2d2447 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:17.134800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b99eb-0477-4673-a046-726dcc2d2447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:17.146092 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b99eb-0477-4673-a046-726dcc2d2447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:17.147566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b99eb-0477-4673-a046-726dcc2d2447 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:17.157814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 901/1791] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:17.555679 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230521e-ee6e-49a5-a7cc-03584165ae42 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:17.557102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e230521e-ee6e-49a5-a7cc-03584165ae42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:17.572031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230521e-ee6e-49a5-a7cc-03584165ae42 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:17.577074 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29210a-c1f4-4d95-a600-37e7e2f0d380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:17.578122 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29210a-c1f4-4d95-a600-37e7e2f0d380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:17.578588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29210a-c1f4-4d95-a600-37e7e2f0d380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:17.579037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29210a-c1f4-4d95-a600-37e7e2f0d380 admin admin] PATH_INFO: `/v3/projects/9b8ebcedc9e74e9fb1e8c1d675e16493` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:17.582567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29210a-c1f4-4d95-a600-37e7e2f0d380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b8ebcedc9e74e9fb1e8c1d675e16493)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:17.585285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29210a-c1f4-4d95-a600-37e7e2f0d380 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:17.644241 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6f29210a-c1f4-4d95-a600-37e7e2f0d380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b8ebcedc9e74e9fb1e8c1d675e16493', 'request_id': 'req-6f29210a-c1f4-4d95-a600-37e7e2f0d380'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:17.650754 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6f29210a-c1f4-4d95-a600-37e7e2f0d380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b8ebcedc9e74e9fb1e8c1d675e16493', 'request_id': 'req-6f29210a-c1f4-4d95-a600-37e7e2f0d380'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:17.658307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6f29210a-c1f4-4d95-a600-37e7e2f0d380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b8ebcedc9e74e9fb1e8c1d675e16493', 'request_id': 'req-6f29210a-c1f4-4d95-a600-37e7e2f0d380'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:17.669449 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6f29210a-c1f4-4d95-a600-37e7e2f0d380 admin admin] The token cache is being invalidate because project 9b8ebcedc9e74e9fb1e8c1d675e16493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:17.669742 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6f29210a-c1f4-4d95-a600-37e7e2f0d380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:17.670425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6f29210a-c1f4-4d95-a600-37e7e2f0d380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:17.671999 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 891/1792] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:17 2022] DELETE /identity/v3/projects/9b8ebcedc9e74e9fb1e8c1d675e16493 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:17.676011 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b99eb-0477-4673-a046-726dcc2d2447 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:17.686372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b99eb-0477-4673-a046-726dcc2d2447 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:17.741949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb66d2-3976-4057-9eb2-b492d45f7dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:17.742856 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb66d2-3976-4057-9eb2-b492d45f7dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:17.743139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb66d2-3976-4057-9eb2-b492d45f7dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:17.743414 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb66d2-3976-4057-9eb2-b492d45f7dd3 admin admin] PATH_INFO: `/v3/users/1aa11f853d354149b71527ff4059d8e9` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:17.744592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb66d2-3976-4057-9eb2-b492d45f7dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa11f853d354149b71527ff4059d8e9)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:17.746590 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb66d2-3976-4057-9eb2-b492d45f7dd3 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:17.796021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7bfb66d2-3976-4057-9eb2-b492d45f7dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa11f853d354149b71527ff4059d8e9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:17.803638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7bfb66d2-3976-4057-9eb2-b492d45f7dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa11f853d354149b71527ff4059d8e9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:17.804248 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7bfb66d2-3976-4057-9eb2-b492d45f7dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa11f853d354149b71527ff4059d8e9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:17.816076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7bfb66d2-3976-4057-9eb2-b492d45f7dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa11f853d354149b71527ff4059d8e9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:17.822848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7bfb66d2-3976-4057-9eb2-b492d45f7dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa11f853d354149b71527ff4059d8e9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:17.829049 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 902/1793] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:17 2022] DELETE /identity/v3/users/1aa11f853d354149b71527ff4059d8e9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:18.173074 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29210a-c1f4-4d95-a600-37e7e2f0d380 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:18.174689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6f29210a-c1f4-4d95-a600-37e7e2f0d380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:18.205699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29210a-c1f4-4d95-a600-37e7e2f0d380 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:18.298313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160bfa9-696d-4104-b385-b142cf6e91a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:18.300093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160bfa9-696d-4104-b385-b142cf6e91a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:18.300556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160bfa9-696d-4104-b385-b142cf6e91a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:18.300838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160bfa9-696d-4104-b385-b142cf6e91a9 admin admin] PATH_INFO: `/v3/projects/4aeae46b9a314d1886a52813c9d8d2c6` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:18.302219 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160bfa9-696d-4104-b385-b142cf6e91a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aeae46b9a314d1886a52813c9d8d2c6)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:18.305028 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160bfa9-696d-4104-b385-b142cf6e91a9 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:18.363855 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5160bfa9-696d-4104-b385-b142cf6e91a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aeae46b9a314d1886a52813c9d8d2c6', 'request_id': 'req-5160bfa9-696d-4104-b385-b142cf6e91a9'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:18.371962 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5160bfa9-696d-4104-b385-b142cf6e91a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aeae46b9a314d1886a52813c9d8d2c6', 'request_id': 'req-5160bfa9-696d-4104-b385-b142cf6e91a9'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:18.388159 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5160bfa9-696d-4104-b385-b142cf6e91a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aeae46b9a314d1886a52813c9d8d2c6', 'request_id': 'req-5160bfa9-696d-4104-b385-b142cf6e91a9'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:18.445059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5160bfa9-696d-4104-b385-b142cf6e91a9 admin admin] The token cache is being invalidate because project 4aeae46b9a314d1886a52813c9d8d2c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:18.445194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5160bfa9-696d-4104-b385-b142cf6e91a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:18.446698 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5160bfa9-696d-4104-b385-b142cf6e91a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:18.448742 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 892/1794] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:18 2022] DELETE /identity/v3/projects/4aeae46b9a314d1886a52813c9d8d2c6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:18.454104 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecb495-c097-44a4-aacb-452502f7800a None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:18.454600 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecb495-c097-44a4-aacb-452502f7800a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:18.454956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecb495-c097-44a4-aacb-452502f7800a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:18.489632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-ffecb495-c097-44a4-aacb-452502f7800a None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:18.491081 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ffecb495-c097-44a4-aacb-452502f7800a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:18.577173 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 903/1795] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:18.580580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a35f54-4db1-4eb8-9c9b-8e7fc7b289ff None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:18.581060 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a35f54-4db1-4eb8-9c9b-8e7fc7b289ff None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:18.581806 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a35f54-4db1-4eb8-9c9b-8e7fc7b289ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:18.615436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-10a35f54-4db1-4eb8-9c9b-8e7fc7b289ff None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:18.616813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-10a35f54-4db1-4eb8-9c9b-8e7fc7b289ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:18.628361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 893/1796] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:18.633229 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecb495-c097-44a4-aacb-452502f7800a None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:18.643123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecb495-c097-44a4-aacb-452502f7800a None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:18.649651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2eeaa-7000-45cf-8bfd-eb6c24818dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:18.650961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2eeaa-7000-45cf-8bfd-eb6c24818dea admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:18.651249 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2eeaa-7000-45cf-8bfd-eb6c24818dea admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:18.651524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2eeaa-7000-45cf-8bfd-eb6c24818dea admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:18.652261 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2eeaa-7000-45cf-8bfd-eb6c24818dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:32:18.652568 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2eeaa-7000-45cf-8bfd-eb6c24818dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:18.654324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2eeaa-7000-45cf-8bfd-eb6c24818dea admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:18.670345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 904/1797] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:32:18.672668 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a35f54-4db1-4eb8-9c9b-8e7fc7b289ff None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:18.684030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a35f54-4db1-4eb8-9c9b-8e7fc7b289ff None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:18.689211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c33a2-c9fc-4b3d-bb0a-a4b28c0d01c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:18.689903 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c33a2-c9fc-4b3d-bb0a-a4b28c0d01c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:18.690208 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c33a2-c9fc-4b3d-bb0a-a4b28c0d01c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:18.690640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c33a2-c9fc-4b3d-bb0a-a4b28c0d01c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:18.691470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c33a2-c9fc-4b3d-bb0a-a4b28c0d01c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:18.694063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c33a2-c9fc-4b3d-bb0a-a4b28c0d01c9 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:18.733425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 894/1798] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:18 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:18.737261 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2eeaa-7000-45cf-8bfd-eb6c24818dea admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:18.751729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2eeaa-7000-45cf-8bfd-eb6c24818dea admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:18.846764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc17ab-c753-4621-ba00-66af17efcc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:18.849555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc17ab-c753-4621-ba00-66af17efcc95 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:18.849555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc17ab-c753-4621-ba00-66af17efcc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:18.849555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc17ab-c753-4621-ba00-66af17efcc95 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:18.849555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc17ab-c753-4621-ba00-66af17efcc95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:18.851859 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc17ab-c753-4621-ba00-66af17efcc95 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:18.876212 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 905/1799] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:18 2022] POST /identity/v3/users => generated 285 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:32:18.880383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c33a2-c9fc-4b3d-bb0a-a4b28c0d01c9 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:18.891846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c33a2-c9fc-4b3d-bb0a-a4b28c0d01c9 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:18.897822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae352c-d632-4538-aaa9-19cc22adef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:18.898741 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae352c-d632-4538-aaa9-19cc22adef43 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:18.899095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae352c-d632-4538-aaa9-19cc22adef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:18.912359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae352c-d632-4538-aaa9-19cc22adef43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:18.913461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae352c-d632-4538-aaa9-19cc22adef43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:18.916785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae352c-d632-4538-aaa9-19cc22adef43 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:18.934732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 895/1800] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:18.936050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc17ab-c753-4621-ba00-66af17efcc95 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:18.947340 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc17ab-c753-4621-ba00-66af17efcc95 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:18.952643 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc7f1d-a4c3-496d-a708-f90a3f53d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:18.953473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc7f1d-a4c3-496d-a708-f90a3f53d31c admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:18.953991 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc7f1d-a4c3-496d-a708-f90a3f53d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:18.956047 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc7f1d-a4c3-496d-a708-f90a3f53d31c admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:18.956047 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc7f1d-a4c3-496d-a708-f90a3f53d31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:18.968335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc7f1d-a4c3-496d-a708-f90a3f53d31c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:18.985558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 906/1801] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:32:18.987254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae352c-d632-4538-aaa9-19cc22adef43 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:19.003033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae352c-d632-4538-aaa9-19cc22adef43 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:19.010094 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181244c0-3013-4248-b9ef-dcc51594f4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:19.011342 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181244c0-3013-4248-b9ef-dcc51594f4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:19.011727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181244c0-3013-4248-b9ef-dcc51594f4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:19.012154 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181244c0-3013-4248-b9ef-dcc51594f4e0 admin admin] PATH_INFO: `/v3/projects/650ebf52fe99482d9ae26028ee4926ae/users/bca69ccc10f74edba71cc0c89a3cad1b/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:19.031483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181244c0-3013-4248-b9ef-dcc51594f4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650ebf52fe99482d9ae26028ee4926ae, user_id=bca69ccc10f74edba71cc0c89a3cad1b, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:19.034806 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181244c0-3013-4248-b9ef-dcc51594f4e0 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:19.058539 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 896/1802] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:18 2022] PUT /identity/v3/projects/650ebf52fe99482d9ae26028ee4926ae/users/bca69ccc10f74edba71cc0c89a3cad1b/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:19.064921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c1f55-aa29-4c4a-af70-dd4e7c8b6ae7 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:19.065292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c1f55-aa29-4c4a-af70-dd4e7c8b6ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:19.065721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c1f55-aa29-4c4a-af70-dd4e7c8b6ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:19.098045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-564c1f55-aa29-4c4a-af70-dd4e7c8b6ae7 None None] MFA Rules not processed for user `bca69ccc10f74edba71cc0c89a3cad1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:19.099578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-564c1f55-aa29-4c4a-af70-dd4e7c8b6ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:19.192557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 907/1803] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:19.200401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181244c0-3013-4248-b9ef-dcc51594f4e0 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:19.304263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181244c0-3013-4248-b9ef-dcc51594f4e0 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:19.338956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a994587-b1cf-4ec3-a8c7-f5f4d1178805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:19.339646 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a994587-b1cf-4ec3-a8c7-f5f4d1178805 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:19.339930 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a994587-b1cf-4ec3-a8c7-f5f4d1178805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:19.340212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a994587-b1cf-4ec3-a8c7-f5f4d1178805 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:19.340917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a994587-b1cf-4ec3-a8c7-f5f4d1178805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:19.368532 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a994587-b1cf-4ec3-a8c7-f5f4d1178805 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:19.424090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 897/1804] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:19 2022] POST /identity/v3/projects => generated 367 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:19.428511 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c1f55-aa29-4c4a-af70-dd4e7c8b6ae7 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:19.456473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c1f55-aa29-4c4a-af70-dd4e7c8b6ae7 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:19.532216 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017048f-605e-43be-8a4b-8f3063f94da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:19.533404 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017048f-605e-43be-8a4b-8f3063f94da5 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:19.534210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017048f-605e-43be-8a4b-8f3063f94da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:19.534693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017048f-605e-43be-8a4b-8f3063f94da5 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:19.536175 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017048f-605e-43be-8a4b-8f3063f94da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:19.539101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017048f-605e-43be-8a4b-8f3063f94da5 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:19.565460 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 908/1805] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:19 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:19.570109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a994587-b1cf-4ec3-a8c7-f5f4d1178805 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:19.584531 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a994587-b1cf-4ec3-a8c7-f5f4d1178805 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:19.591745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0e167-e6c1-4129-83cb-31237328b0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:19.592701 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0e167-e6c1-4129-83cb-31237328b0bf admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:19.593207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0e167-e6c1-4129-83cb-31237328b0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:19.593656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0e167-e6c1-4129-83cb-31237328b0bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:19.595911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0e167-e6c1-4129-83cb-31237328b0bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:19.600016 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0e167-e6c1-4129-83cb-31237328b0bf admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:19.618551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 898/1806] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:32:19.622833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017048f-605e-43be-8a4b-8f3063f94da5 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:19.644280 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017048f-605e-43be-8a4b-8f3063f94da5 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:19.659633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8b014-0a52-4c2e-8769-7c65be219ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:19.661226 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8b014-0a52-4c2e-8769-7c65be219ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:19.661647 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8b014-0a52-4c2e-8769-7c65be219ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:19.661938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8b014-0a52-4c2e-8769-7c65be219ee7 admin admin] PATH_INFO: `/v3/projects/840fb021d387427791f5d662f40cfda8/users/522c0e1e7c58494e98d6b7107eac97d2/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:19.686797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8b014-0a52-4c2e-8769-7c65be219ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=840fb021d387427791f5d662f40cfda8, user_id=522c0e1e7c58494e98d6b7107eac97d2, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:19.704805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8b014-0a52-4c2e-8769-7c65be219ee7 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:19.741994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 909/1807] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:19 2022] PUT /identity/v3/projects/840fb021d387427791f5d662f40cfda8/users/522c0e1e7c58494e98d6b7107eac97d2/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:19.746109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0e167-e6c1-4129-83cb-31237328b0bf admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:19.762340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0e167-e6c1-4129-83cb-31237328b0bf admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:19.839813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c592f-2b7d-40ea-a12a-da7a503063b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:19.840600 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c592f-2b7d-40ea-a12a-da7a503063b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:19.840954 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c592f-2b7d-40ea-a12a-da7a503063b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:19.841302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c592f-2b7d-40ea-a12a-da7a503063b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:19.842389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c592f-2b7d-40ea-a12a-da7a503063b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:19.844024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c592f-2b7d-40ea-a12a-da7a503063b8 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:19.855223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 899/1808] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:19.859412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8b014-0a52-4c2e-8769-7c65be219ee7 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:19.871418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8b014-0a52-4c2e-8769-7c65be219ee7 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:19.876948 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5ff7b-d849-4a5a-b766-a61b08d2a23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:19.877850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5ff7b-d849-4a5a-b766-a61b08d2a23b admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:19.878129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5ff7b-d849-4a5a-b766-a61b08d2a23b admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:19.878433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5ff7b-d849-4a5a-b766-a61b08d2a23b admin admin] PATH_INFO: `/v3/projects/840fb021d387427791f5d662f40cfda8/users/522c0e1e7c58494e98d6b7107eac97d2/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:19.881402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5ff7b-d849-4a5a-b766-a61b08d2a23b admin admin] RBAC: Authorizing `identity:create_grant(project_id=840fb021d387427791f5d662f40cfda8, user_id=522c0e1e7c58494e98d6b7107eac97d2, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:19.884224 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5ff7b-d849-4a5a-b766-a61b08d2a23b admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:19.895422 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 910/1809] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:19 2022] PUT /identity/v3/projects/840fb021d387427791f5d662f40cfda8/users/522c0e1e7c58494e98d6b7107eac97d2/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:19.906545 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dd828-a840-4fde-8e7d-b4c81adb4537 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:19.906836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dd828-a840-4fde-8e7d-b4c81adb4537 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:19.907117 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dd828-a840-4fde-8e7d-b4c81adb4537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:19.933876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b99dd828-a840-4fde-8e7d-b4c81adb4537 None None] MFA Rules not processed for user `522c0e1e7c58494e98d6b7107eac97d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:19.935093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b99dd828-a840-4fde-8e7d-b4c81adb4537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:20.021487 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 900/1810] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:20.033473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5ff7b-d849-4a5a-b766-a61b08d2a23b admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:20.035555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e4b5ff7b-d849-4a5a-b766-a61b08d2a23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:20.100011 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5ff7b-d849-4a5a-b766-a61b08d2a23b admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:20.103665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c0ff5-ef13-43a8-8327-7fd17b37f27c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:20.104314 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c0ff5-ef13-43a8-8327-7fd17b37f27c service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:20.104596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c0ff5-ef13-43a8-8327-7fd17b37f27c service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:20.104872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c0ff5-ef13-43a8-8327-7fd17b37f27c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:20.115390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c0ff5-ef13-43a8-8327-7fd17b37f27c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:20.116856 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c0ff5-ef13-43a8-8327-7fd17b37f27c service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:20.126362 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 911/1811] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:20 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:20.174376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dd828-a840-4fde-8e7d-b4c81adb4537 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:20.175749 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b99dd828-a840-4fde-8e7d-b4c81adb4537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:20.188359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dd828-a840-4fde-8e7d-b4c81adb4537 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:20.192487 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fde665-69cb-4b49-9788-9c066e6bb972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:20.193131 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fde665-69cb-4b49-9788-9c066e6bb972 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:20.193417 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fde665-69cb-4b49-9788-9c066e6bb972 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:20.193716 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fde665-69cb-4b49-9788-9c066e6bb972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:20.265260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fde665-69cb-4b49-9788-9c066e6bb972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:20.266745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fde665-69cb-4b49-9788-9c066e6bb972 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:20.277826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 901/1812] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:21.542787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c0ff5-ef13-43a8-8327-7fd17b37f27c service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:21.544408 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-046c0ff5-ef13-43a8-8327-7fd17b37f27c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:21.626899 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c0ff5-ef13-43a8-8327-7fd17b37f27c service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:21.632791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d165bed-dfbc-4db6-a85c-c15604643122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:21.633823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d165bed-dfbc-4db6-a85c-c15604643122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:21.634385 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d165bed-dfbc-4db6-a85c-c15604643122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:21.634728 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d165bed-dfbc-4db6-a85c-c15604643122 admin admin] PATH_INFO: `/v3/users/8e050c8fffa84c62bc6f0b6b87f8a025` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:21.636429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d165bed-dfbc-4db6-a85c-c15604643122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e050c8fffa84c62bc6f0b6b87f8a025)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:21.638854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d165bed-dfbc-4db6-a85c-c15604643122 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:21.715506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0d165bed-dfbc-4db6-a85c-c15604643122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e050c8fffa84c62bc6f0b6b87f8a025'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:21.727258 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0d165bed-dfbc-4db6-a85c-c15604643122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e050c8fffa84c62bc6f0b6b87f8a025'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:21.728309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0d165bed-dfbc-4db6-a85c-c15604643122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e050c8fffa84c62bc6f0b6b87f8a025'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:21.747293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0d165bed-dfbc-4db6-a85c-c15604643122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e050c8fffa84c62bc6f0b6b87f8a025'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:21.771249 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0d165bed-dfbc-4db6-a85c-c15604643122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e050c8fffa84c62bc6f0b6b87f8a025'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:21.793988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d27cb-7606-4808-851a-e678352a8edc None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:21.794612 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d27cb-7606-4808-851a-e678352a8edc None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:21.794691 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d27cb-7606-4808-851a-e678352a8edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:21.794860 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 912/1813] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:21 2022] DELETE /identity/v3/users/8e050c8fffa84c62bc6f0b6b87f8a025 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:21.835275 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-e31d27cb-7606-4808-851a-e678352a8edc None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:21.836512 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e31d27cb-7606-4808-851a-e678352a8edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:21.936138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 902/1814] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:21.947429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d165bed-dfbc-4db6-a85c-c15604643122 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:21.952064 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-0d165bed-dfbc-4db6-a85c-c15604643122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:22.069120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d165bed-dfbc-4db6-a85c-c15604643122 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:22.075135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311803b-b7d9-44cf-9a82-2d630c664e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:22.075993 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311803b-b7d9-44cf-9a82-2d630c664e83 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:22.076107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311803b-b7d9-44cf-9a82-2d630c664e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:22.077515 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311803b-b7d9-44cf-9a82-2d630c664e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:22.091569 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311803b-b7d9-44cf-9a82-2d630c664e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:22.093943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311803b-b7d9-44cf-9a82-2d630c664e83 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:22.105659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 913/1815] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:22.518929 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d27cb-7606-4808-851a-e678352a8edc None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:22.522997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e31d27cb-7606-4808-851a-e678352a8edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:22.536686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d27cb-7606-4808-851a-e678352a8edc None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:22.542609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e84bec-d201-4423-930c-912b26afb98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:22.543584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e84bec-d201-4423-930c-912b26afb98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:22.543941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e84bec-d201-4423-930c-912b26afb98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:22.544285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e84bec-d201-4423-930c-912b26afb98b admin admin] PATH_INFO: `/v3/projects/4571561a4f6b4bdbb914a8a3e96fd875` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:22.545568 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e84bec-d201-4423-930c-912b26afb98b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4571561a4f6b4bdbb914a8a3e96fd875)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:22.547820 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e84bec-d201-4423-930c-912b26afb98b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:22.608576 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-52e84bec-d201-4423-930c-912b26afb98b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4571561a4f6b4bdbb914a8a3e96fd875', 'request_id': 'req-52e84bec-d201-4423-930c-912b26afb98b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:22.618816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-52e84bec-d201-4423-930c-912b26afb98b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4571561a4f6b4bdbb914a8a3e96fd875', 'request_id': 'req-52e84bec-d201-4423-930c-912b26afb98b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:22.626902 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-52e84bec-d201-4423-930c-912b26afb98b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4571561a4f6b4bdbb914a8a3e96fd875', 'request_id': 'req-52e84bec-d201-4423-930c-912b26afb98b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:22.638411 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-52e84bec-d201-4423-930c-912b26afb98b admin admin] The token cache is being invalidate because project 4571561a4f6b4bdbb914a8a3e96fd875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:22.638707 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-52e84bec-d201-4423-930c-912b26afb98b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:22.639370 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-52e84bec-d201-4423-930c-912b26afb98b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:22.641188 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 903/1816] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:22 2022] DELETE /identity/v3/projects/4571561a4f6b4bdbb914a8a3e96fd875 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:22.646050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311803b-b7d9-44cf-9a82-2d630c664e83 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:22.656002 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311803b-b7d9-44cf-9a82-2d630c664e83 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:22.726306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0ff87-202f-4b2a-b2b8-f9a3fcdc247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:22.727294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0ff87-202f-4b2a-b2b8-f9a3fcdc247c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:22.727648 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0ff87-202f-4b2a-b2b8-f9a3fcdc247c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:22.728006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0ff87-202f-4b2a-b2b8-f9a3fcdc247c admin admin] PATH_INFO: `/v3/users/e94975626e2342b29396dc1c1a23d260` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:22.729230 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0ff87-202f-4b2a-b2b8-f9a3fcdc247c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94975626e2342b29396dc1c1a23d260)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:22.731279 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0ff87-202f-4b2a-b2b8-f9a3fcdc247c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:22.780822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9ba0ff87-202f-4b2a-b2b8-f9a3fcdc247c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94975626e2342b29396dc1c1a23d260'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:22.788691 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9ba0ff87-202f-4b2a-b2b8-f9a3fcdc247c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94975626e2342b29396dc1c1a23d260'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:22.789706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9ba0ff87-202f-4b2a-b2b8-f9a3fcdc247c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94975626e2342b29396dc1c1a23d260'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:22.802754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9ba0ff87-202f-4b2a-b2b8-f9a3fcdc247c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94975626e2342b29396dc1c1a23d260'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:22.810126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9ba0ff87-202f-4b2a-b2b8-f9a3fcdc247c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94975626e2342b29396dc1c1a23d260'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:22.819223 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 914/1817] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:22 2022] DELETE /identity/v3/users/e94975626e2342b29396dc1c1a23d260 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:23.216733 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e84bec-d201-4423-930c-912b26afb98b admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:23.219304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-52e84bec-d201-4423-930c-912b26afb98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:23.234813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e84bec-d201-4423-930c-912b26afb98b admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:23.309549 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02a32-e52c-40c6-8602-7e9da63af3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:23.310531 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02a32-e52c-40c6-8602-7e9da63af3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:23.310843 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02a32-e52c-40c6-8602-7e9da63af3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:23.311159 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02a32-e52c-40c6-8602-7e9da63af3ff admin admin] PATH_INFO: `/v3/projects/e2b9cc4a21494a6baba0dc390c87b58a` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:23.312362 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f02a32-e52c-40c6-8602-7e9da63af3ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b9cc4a21494a6baba0dc390c87b58a)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:23.314410 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f02a32-e52c-40c6-8602-7e9da63af3ff admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:23.368690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b5f02a32-e52c-40c6-8602-7e9da63af3ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b9cc4a21494a6baba0dc390c87b58a', 'request_id': 'req-b5f02a32-e52c-40c6-8602-7e9da63af3ff'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:23.375990 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b5f02a32-e52c-40c6-8602-7e9da63af3ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b9cc4a21494a6baba0dc390c87b58a', 'request_id': 'req-b5f02a32-e52c-40c6-8602-7e9da63af3ff'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:23.384378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b5f02a32-e52c-40c6-8602-7e9da63af3ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b9cc4a21494a6baba0dc390c87b58a', 'request_id': 'req-b5f02a32-e52c-40c6-8602-7e9da63af3ff'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:23.396293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b5f02a32-e52c-40c6-8602-7e9da63af3ff admin admin] The token cache is being invalidate because project e2b9cc4a21494a6baba0dc390c87b58a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:23.396584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b5f02a32-e52c-40c6-8602-7e9da63af3ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:23.397234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b5f02a32-e52c-40c6-8602-7e9da63af3ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:23.398892 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 904/1818] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:23 2022] DELETE /identity/v3/projects/e2b9cc4a21494a6baba0dc390c87b58a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:23.403719 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2a187-f5b3-40b6-ab10-628a16aab019 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:23.404007 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2a187-f5b3-40b6-ab10-628a16aab019 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:23.404422 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2a187-f5b3-40b6-ab10-628a16aab019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:23.435820 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-90c2a187-f5b3-40b6-ab10-628a16aab019 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:23.437037 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-90c2a187-f5b3-40b6-ab10-628a16aab019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:23.503591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 915/1819] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:23.512175 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b85fa1-7a1f-4aa4-bccd-c502adba9db0 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:23.512461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b85fa1-7a1f-4aa4-bccd-c502adba9db0 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:23.512737 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b85fa1-7a1f-4aa4-bccd-c502adba9db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:23.533730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-40b85fa1-7a1f-4aa4-bccd-c502adba9db0 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:23.535470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-40b85fa1-7a1f-4aa4-bccd-c502adba9db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:23.544935 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 905/1820] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:23.548734 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2a187-f5b3-40b6-ab10-628a16aab019 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:23.559147 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2a187-f5b3-40b6-ab10-628a16aab019 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:23.564086 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8938e-e150-414d-9710-d4bb06bcb559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:23.564841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8938e-e150-414d-9710-d4bb06bcb559 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:23.565291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8938e-e150-414d-9710-d4bb06bcb559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:23.565506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8938e-e150-414d-9710-d4bb06bcb559 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:23.566284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8938e-e150-414d-9710-d4bb06bcb559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:32:23.567320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8938e-e150-414d-9710-d4bb06bcb559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:23.569154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8938e-e150-414d-9710-d4bb06bcb559 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:23.582302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 916/1821] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:32:23.587060 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b85fa1-7a1f-4aa4-bccd-c502adba9db0 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:23.597115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b85fa1-7a1f-4aa4-bccd-c502adba9db0 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:23.602606 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab804a4b-8483-486c-983d-6d6063244da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:23.603310 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab804a4b-8483-486c-983d-6d6063244da8 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:23.603592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab804a4b-8483-486c-983d-6d6063244da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:23.603868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab804a4b-8483-486c-983d-6d6063244da8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:23.604736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab804a4b-8483-486c-983d-6d6063244da8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:23.606693 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab804a4b-8483-486c-983d-6d6063244da8 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:23.635052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 906/1822] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:23 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:23.639158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8938e-e150-414d-9710-d4bb06bcb559 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:23.650047 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8938e-e150-414d-9710-d4bb06bcb559 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:23.726108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6552d24-a385-43dd-8711-738974c0fb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:23.726804 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6552d24-a385-43dd-8711-738974c0fb93 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:23.727085 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6552d24-a385-43dd-8711-738974c0fb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:23.727359 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6552d24-a385-43dd-8711-738974c0fb93 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:23.728038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6552d24-a385-43dd-8711-738974c0fb93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:23.729948 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6552d24-a385-43dd-8711-738974c0fb93 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:23.753175 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 917/1823] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:23 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:32:23.755279 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab804a4b-8483-486c-983d-6d6063244da8 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:23.765112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab804a4b-8483-486c-983d-6d6063244da8 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:23.769632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbfbb1-b936-450a-a1c2-548e7a205a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:23.770319 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbfbb1-b936-450a-a1c2-548e7a205a55 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:23.770599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbfbb1-b936-450a-a1c2-548e7a205a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:23.770869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbfbb1-b936-450a-a1c2-548e7a205a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:23.771585 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbfbb1-b936-450a-a1c2-548e7a205a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:23.773304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbfbb1-b936-450a-a1c2-548e7a205a55 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:23.783809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 907/1824] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:32:23.788464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6552d24-a385-43dd-8711-738974c0fb93 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:23.799275 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6552d24-a385-43dd-8711-738974c0fb93 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:23.804704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709eeaab-3d7b-4b76-91f6-da80ed3878e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:23.805440 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eeaab-3d7b-4b76-91f6-da80ed3878e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:23.805793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eeaab-3d7b-4b76-91f6-da80ed3878e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:23.806137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eeaab-3d7b-4b76-91f6-da80ed3878e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:23.807031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709eeaab-3d7b-4b76-91f6-da80ed3878e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:23.808706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709eeaab-3d7b-4b76-91f6-da80ed3878e4 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:23.811378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbfbb1-b936-450a-a1c2-548e7a205a55 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:23.813048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5cdbfbb1-b936-450a-a1c2-548e7a205a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:23.822021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 918/1825] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:23.823920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709eeaab-3d7b-4b76-91f6-da80ed3878e4 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:23.825915 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbfbb1-b936-450a-a1c2-548e7a205a55 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:23.830806 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be134d35-4e07-4a68-b799-84be477607e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:23.831674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be134d35-4e07-4a68-b799-84be477607e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:23.831951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be134d35-4e07-4a68-b799-84be477607e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:23.832272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be134d35-4e07-4a68-b799-84be477607e2 admin admin] PATH_INFO: `/v3/users/bca69ccc10f74edba71cc0c89a3cad1b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:23.833665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be134d35-4e07-4a68-b799-84be477607e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca69ccc10f74edba71cc0c89a3cad1b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:23.833787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709eeaab-3d7b-4b76-91f6-da80ed3878e4 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:23.835929 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be134d35-4e07-4a68-b799-84be477607e2 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:23.838302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d7cc0-0bfb-48d9-a378-16e49a965f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:23.839167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d7cc0-0bfb-48d9-a378-16e49a965f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:23.839443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d7cc0-0bfb-48d9-a378-16e49a965f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:23.839715 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d7cc0-0bfb-48d9-a378-16e49a965f6f admin admin] PATH_INFO: `/v3/projects/1d3f6bcdf42542e1a5640df3e16ab8f2/users/61732fa4a788461eaea0717d0afd6cb1/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:23.854699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d7cc0-0bfb-48d9-a378-16e49a965f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3f6bcdf42542e1a5640df3e16ab8f2, user_id=61732fa4a788461eaea0717d0afd6cb1, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:23.857392 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d7cc0-0bfb-48d9-a378-16e49a965f6f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:23.870885 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 919/1826] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:23 2022] PUT /identity/v3/projects/1d3f6bcdf42542e1a5640df3e16ab8f2/users/61732fa4a788461eaea0717d0afd6cb1/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:23.883815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf109e6-fd50-4bc9-b8f2-05732a212f3f None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:23.884345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf109e6-fd50-4bc9-b8f2-05732a212f3f None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:23.884911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf109e6-fd50-4bc9-b8f2-05732a212f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:23.893045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-be134d35-4e07-4a68-b799-84be477607e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca69ccc10f74edba71cc0c89a3cad1b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:23.900253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-be134d35-4e07-4a68-b799-84be477607e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca69ccc10f74edba71cc0c89a3cad1b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:23.900966 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-be134d35-4e07-4a68-b799-84be477607e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca69ccc10f74edba71cc0c89a3cad1b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:23.914123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-5cf109e6-fd50-4bc9-b8f2-05732a212f3f None None] MFA Rules not processed for user `61732fa4a788461eaea0717d0afd6cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:23.915378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5cf109e6-fd50-4bc9-b8f2-05732a212f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:23.915720 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-be134d35-4e07-4a68-b799-84be477607e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca69ccc10f74edba71cc0c89a3cad1b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:23.924684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-be134d35-4e07-4a68-b799-84be477607e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca69ccc10f74edba71cc0c89a3cad1b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:23.932091 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 908/1827] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:23 2022] DELETE /identity/v3/users/bca69ccc10f74edba71cc0c89a3cad1b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:23.936362 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ed49e-2080-4852-9dbb-a50f4a908411 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:23.936731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ed49e-2080-4852-9dbb-a50f4a908411 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:23.937052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ed49e-2080-4852-9dbb-a50f4a908411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:23.955413 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b50ed49e-2080-4852-9dbb-a50f4a908411 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:23.956871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b50ed49e-2080-4852-9dbb-a50f4a908411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:23.991745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 920/1828] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:23.999110 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf109e6-fd50-4bc9-b8f2-05732a212f3f None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:24.000900 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5cf109e6-fd50-4bc9-b8f2-05732a212f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:24.021240 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 909/1829] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:24.031501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ed49e-2080-4852-9dbb-a50f4a908411 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:24.033362 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b50ed49e-2080-4852-9dbb-a50f4a908411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:24.080265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf109e6-fd50-4bc9-b8f2-05732a212f3f None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:24.087671 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3e1d2-dda6-4603-bb98-35ff8bff7814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:24.088352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3e1d2-dda6-4603-bb98-35ff8bff7814 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:24.088654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3e1d2-dda6-4603-bb98-35ff8bff7814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:24.088923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3e1d2-dda6-4603-bb98-35ff8bff7814 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:24.089625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3e1d2-dda6-4603-bb98-35ff8bff7814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:24.091809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3e1d2-dda6-4603-bb98-35ff8bff7814 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:24.113424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ed49e-2080-4852-9dbb-a50f4a908411 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:24.118641 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce45a0-41b5-4dc1-afe4-4ddcf7943844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:24.122409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce45a0-41b5-4dc1-afe4-4ddcf7943844 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:24.122738 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce45a0-41b5-4dc1-afe4-4ddcf7943844 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:24.123415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 921/1830] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:23 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:24.126227 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce45a0-41b5-4dc1-afe4-4ddcf7943844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:24.127203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3e1d2-dda6-4603-bb98-35ff8bff7814 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:24.137939 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce45a0-41b5-4dc1-afe4-4ddcf7943844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:24.139466 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce45a0-41b5-4dc1-afe4-4ddcf7943844 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:24.153230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 910/1831] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:32:24.210018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3e1d2-dda6-4603-bb98-35ff8bff7814 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:24.227327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef13b61-7b22-4a7a-97f9-28738f81dcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:24.228020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef13b61-7b22-4a7a-97f9-28738f81dcc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:24.228307 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef13b61-7b22-4a7a-97f9-28738f81dcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:24.228596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef13b61-7b22-4a7a-97f9-28738f81dcc0 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:24.229359 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef13b61-7b22-4a7a-97f9-28738f81dcc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:24.231498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef13b61-7b22-4a7a-97f9-28738f81dcc0 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:24.267985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 922/1832] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:24 2022] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:32:24.272187 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce45a0-41b5-4dc1-afe4-4ddcf7943844 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:24.285304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce45a0-41b5-4dc1-afe4-4ddcf7943844 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:24.291446 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab0d97-55d7-4c6f-9561-76f1e6a74112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:24.292172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab0d97-55d7-4c6f-9561-76f1e6a74112 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:24.292778 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab0d97-55d7-4c6f-9561-76f1e6a74112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:24.292778 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab0d97-55d7-4c6f-9561-76f1e6a74112 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:24.293598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab0d97-55d7-4c6f-9561-76f1e6a74112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:24.295249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab0d97-55d7-4c6f-9561-76f1e6a74112 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:24.307281 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 911/1833] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:24.320721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef13b61-7b22-4a7a-97f9-28738f81dcc0 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:24.322263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef13b61-7b22-4a7a-97f9-28738f81dcc0 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:24.327181 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a604bbb-5223-4f4b-87a0-8fe0a7864933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:24.328076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a604bbb-5223-4f4b-87a0-8fe0a7864933 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:24.328362 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a604bbb-5223-4f4b-87a0-8fe0a7864933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:24.328667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a604bbb-5223-4f4b-87a0-8fe0a7864933 admin admin] PATH_INFO: `/v3/projects/f5839cc032574522875943a11f26568a/users/e315314fca3e44a9857df984666e116c/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:24.343990 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a604bbb-5223-4f4b-87a0-8fe0a7864933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5839cc032574522875943a11f26568a, user_id=e315314fca3e44a9857df984666e116c, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:24.346733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a604bbb-5223-4f4b-87a0-8fe0a7864933 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:24.359682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 923/1834] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:24 2022] PUT /identity/v3/projects/f5839cc032574522875943a11f26568a/users/e315314fca3e44a9857df984666e116c/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:24.365424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab0d97-55d7-4c6f-9561-76f1e6a74112 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:24.374293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab0d97-55d7-4c6f-9561-76f1e6a74112 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:24.441112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc2d76-fdb4-4ebf-a16e-daac52bfad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:24.442407 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc2d76-fdb4-4ebf-a16e-daac52bfad7b admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:24.442688 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc2d76-fdb4-4ebf-a16e-daac52bfad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:24.442972 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc2d76-fdb4-4ebf-a16e-daac52bfad7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:24.443715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc2d76-fdb4-4ebf-a16e-daac52bfad7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:24.445332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc2d76-fdb4-4ebf-a16e-daac52bfad7b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:24.456696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 912/1835] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:32:24.461674 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a604bbb-5223-4f4b-87a0-8fe0a7864933 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:24.474335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a604bbb-5223-4f4b-87a0-8fe0a7864933 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:24.479687 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7aed1-02f2-426d-9372-70e160267ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:24.480580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7aed1-02f2-426d-9372-70e160267ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:24.480863 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7aed1-02f2-426d-9372-70e160267ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:24.481138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7aed1-02f2-426d-9372-70e160267ddc admin admin] PATH_INFO: `/v3/projects/f5839cc032574522875943a11f26568a/users/e315314fca3e44a9857df984666e116c/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:24.483229 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7aed1-02f2-426d-9372-70e160267ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5839cc032574522875943a11f26568a, user_id=e315314fca3e44a9857df984666e116c, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:24.486034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7aed1-02f2-426d-9372-70e160267ddc admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:24.497448 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 924/1836] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:24 2022] PUT /identity/v3/projects/f5839cc032574522875943a11f26568a/users/e315314fca3e44a9857df984666e116c/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:24.509406 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efdc62-5c7b-4139-b027-1a8c4bab392c None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:24.509702 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efdc62-5c7b-4139-b027-1a8c4bab392c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:24.509987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efdc62-5c7b-4139-b027-1a8c4bab392c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:24.537364 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-19efdc62-5c7b-4139-b027-1a8c4bab392c None None] MFA Rules not processed for user `e315314fca3e44a9857df984666e116c`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:24.538689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-19efdc62-5c7b-4139-b027-1a8c4bab392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:24.574131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7aed1-02f2-426d-9372-70e160267ddc admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:24.576599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-56f7aed1-02f2-426d-9372-70e160267ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:24.617662 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 913/1837] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:24.628530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efdc62-5c7b-4139-b027-1a8c4bab392c None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:24.630514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-19efdc62-5c7b-4139-b027-1a8c4bab392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:24.653363 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7aed1-02f2-426d-9372-70e160267ddc admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:24.658692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034e092-415b-4034-a41e-c2bb85a157cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:24.659545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034e092-415b-4034-a41e-c2bb85a157cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:24.659826 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034e092-415b-4034-a41e-c2bb85a157cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:24.660099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034e092-415b-4034-a41e-c2bb85a157cd admin admin] PATH_INFO: `/v3/projects/650ebf52fe99482d9ae26028ee4926ae` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:24.662955 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034e092-415b-4034-a41e-c2bb85a157cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=650ebf52fe99482d9ae26028ee4926ae)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:24.665048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034e092-415b-4034-a41e-c2bb85a157cd admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:24.686804 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efdc62-5c7b-4139-b027-1a8c4bab392c None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:24.691072 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a716f6c-d500-49b9-a0fc-236baf04a70d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:24.692297 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a716f6c-d500-49b9-a0fc-236baf04a70d service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:24.692830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a716f6c-d500-49b9-a0fc-236baf04a70d service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:24.693150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a716f6c-d500-49b9-a0fc-236baf04a70d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:24.712906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0034e092-415b-4034-a41e-c2bb85a157cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650ebf52fe99482d9ae26028ee4926ae', 'request_id': 'req-0034e092-415b-4034-a41e-c2bb85a157cd'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:24.719579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0034e092-415b-4034-a41e-c2bb85a157cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650ebf52fe99482d9ae26028ee4926ae', 'request_id': 'req-0034e092-415b-4034-a41e-c2bb85a157cd'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:24.727757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0034e092-415b-4034-a41e-c2bb85a157cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650ebf52fe99482d9ae26028ee4926ae', 'request_id': 'req-0034e092-415b-4034-a41e-c2bb85a157cd'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:24.739739 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0034e092-415b-4034-a41e-c2bb85a157cd admin admin] The token cache is being invalidate because project 650ebf52fe99482d9ae26028ee4926ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:24.740031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0034e092-415b-4034-a41e-c2bb85a157cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:24.740814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0034e092-415b-4034-a41e-c2bb85a157cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:24.742902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 925/1838] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:24 2022] DELETE /identity/v3/projects/650ebf52fe99482d9ae26028ee4926ae => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:24.746485 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034e092-415b-4034-a41e-c2bb85a157cd admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:24.748266 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-0034e092-415b-4034-a41e-c2bb85a157cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:24.775132 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a716f6c-d500-49b9-a0fc-236baf04a70d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:24.776616 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a716f6c-d500-49b9-a0fc-236baf04a70d service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:24.787511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 914/1839] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:32:24.821447 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034e092-415b-4034-a41e-c2bb85a157cd admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:24.826527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb0317-4844-4d6d-81f9-b7693590e7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:24.827406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb0317-4844-4d6d-81f9-b7693590e7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:24.827696 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb0317-4844-4d6d-81f9-b7693590e7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:24.827973 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb0317-4844-4d6d-81f9-b7693590e7d4 admin admin] PATH_INFO: `/v3/users/522c0e1e7c58494e98d6b7107eac97d2` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:24.829555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb0317-4844-4d6d-81f9-b7693590e7d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=522c0e1e7c58494e98d6b7107eac97d2)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:24.831187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb0317-4844-4d6d-81f9-b7693590e7d4 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:24.889164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-73bb0317-4844-4d6d-81f9-b7693590e7d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522c0e1e7c58494e98d6b7107eac97d2'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:24.898812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-73bb0317-4844-4d6d-81f9-b7693590e7d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522c0e1e7c58494e98d6b7107eac97d2'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:24.899747 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-73bb0317-4844-4d6d-81f9-b7693590e7d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522c0e1e7c58494e98d6b7107eac97d2'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:24.915525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-73bb0317-4844-4d6d-81f9-b7693590e7d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522c0e1e7c58494e98d6b7107eac97d2'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:24.923165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-73bb0317-4844-4d6d-81f9-b7693590e7d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522c0e1e7c58494e98d6b7107eac97d2'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:24.929874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 926/1840] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:24 2022] DELETE /identity/v3/users/522c0e1e7c58494e98d6b7107eac97d2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:25.335861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a716f6c-d500-49b9-a0fc-236baf04a70d service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:25.353933 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a716f6c-d500-49b9-a0fc-236baf04a70d service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:25.440646 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edf7d6-5a22-4329-98a9-ef3cf123c4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:25.442063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edf7d6-5a22-4329-98a9-ef3cf123c4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:25.442416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edf7d6-5a22-4329-98a9-ef3cf123c4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:25.442953 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edf7d6-5a22-4329-98a9-ef3cf123c4dc admin admin] PATH_INFO: `/v3/projects/840fb021d387427791f5d662f40cfda8` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:25.443847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edf7d6-5a22-4329-98a9-ef3cf123c4dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=840fb021d387427791f5d662f40cfda8)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:25.445789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edf7d6-5a22-4329-98a9-ef3cf123c4dc admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:25.495734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d8edf7d6-5a22-4329-98a9-ef3cf123c4dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840fb021d387427791f5d662f40cfda8', 'request_id': 'req-d8edf7d6-5a22-4329-98a9-ef3cf123c4dc'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:25.502096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d8edf7d6-5a22-4329-98a9-ef3cf123c4dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840fb021d387427791f5d662f40cfda8', 'request_id': 'req-d8edf7d6-5a22-4329-98a9-ef3cf123c4dc'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:25.511440 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d8edf7d6-5a22-4329-98a9-ef3cf123c4dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840fb021d387427791f5d662f40cfda8', 'request_id': 'req-d8edf7d6-5a22-4329-98a9-ef3cf123c4dc'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:25.523329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d8edf7d6-5a22-4329-98a9-ef3cf123c4dc admin admin] The token cache is being invalidate because project 840fb021d387427791f5d662f40cfda8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:25.523629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d8edf7d6-5a22-4329-98a9-ef3cf123c4dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:25.524268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d8edf7d6-5a22-4329-98a9-ef3cf123c4dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:25.525892 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 915/1841] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:25 2022] DELETE /identity/v3/projects/840fb021d387427791f5d662f40cfda8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:25.530757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93890-98f7-4d16-993b-a9619ce50c39 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:25.531049 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93890-98f7-4d16-993b-a9619ce50c39 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:25.531365 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93890-98f7-4d16-993b-a9619ce50c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:25.549133 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-13d93890-98f7-4d16-993b-a9619ce50c39 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:25.550367 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-13d93890-98f7-4d16-993b-a9619ce50c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:25.612032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 927/1842] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:25.619999 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f4ca-b91f-4740-8373-9183577a552c None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:25.620291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f4ca-b91f-4740-8373-9183577a552c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:25.620641 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f4ca-b91f-4740-8373-9183577a552c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:25.639613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-8146f4ca-b91f-4740-8373-9183577a552c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:25.640827 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-8146f4ca-b91f-4740-8373-9183577a552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:25.649513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 916/1843] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:25.653822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d93890-98f7-4d16-993b-a9619ce50c39 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:25.664236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d93890-98f7-4d16-993b-a9619ce50c39 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:25.668863 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cfac4-9a52-4813-b41c-f2f6b5e2e791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:25.669529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cfac4-9a52-4813-b41c-f2f6b5e2e791 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:25.669822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cfac4-9a52-4813-b41c-f2f6b5e2e791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:25.670103 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cfac4-9a52-4813-b41c-f2f6b5e2e791 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:25.670877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cfac4-9a52-4813-b41c-f2f6b5e2e791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:32:25.671185 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cfac4-9a52-4813-b41c-f2f6b5e2e791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:25.672791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cfac4-9a52-4813-b41c-f2f6b5e2e791 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:25.684885 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 928/1844] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:32:25.689084 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146f4ca-b91f-4740-8373-9183577a552c None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:25.698361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146f4ca-b91f-4740-8373-9183577a552c None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:25.703228 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbd577-849b-4e78-a1dc-98fd2a7fab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:25.703874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbd577-849b-4e78-a1dc-98fd2a7fab4b admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:25.704156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbd577-849b-4e78-a1dc-98fd2a7fab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:25.704431 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbd577-849b-4e78-a1dc-98fd2a7fab4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:25.705166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbd577-849b-4e78-a1dc-98fd2a7fab4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:25.707523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbd577-849b-4e78-a1dc-98fd2a7fab4b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:25.732718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 917/1845] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:25 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:32:25.736793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cfac4-9a52-4813-b41c-f2f6b5e2e791 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:25.747290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cfac4-9a52-4813-b41c-f2f6b5e2e791 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:25.801675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb30f2-23a4-4704-aa9b-ec64fc3eae4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:25.802458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb30f2-23a4-4704-aa9b-ec64fc3eae4c admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:25.802748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb30f2-23a4-4704-aa9b-ec64fc3eae4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:25.803028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb30f2-23a4-4704-aa9b-ec64fc3eae4c admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:25.803735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb30f2-23a4-4704-aa9b-ec64fc3eae4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:25.805664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb30f2-23a4-4704-aa9b-ec64fc3eae4c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:25.824543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 929/1846] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:25 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:25.828644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbd577-849b-4e78-a1dc-98fd2a7fab4b admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:25.839413 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbd577-849b-4e78-a1dc-98fd2a7fab4b admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:25.844029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c27dcb-ef6a-4ffc-b1f2-d0a2c5da38a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:25.844689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c27dcb-ef6a-4ffc-b1f2-d0a2c5da38a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:25.844973 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c27dcb-ef6a-4ffc-b1f2-d0a2c5da38a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:25.845252 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c27dcb-ef6a-4ffc-b1f2-d0a2c5da38a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:25.845974 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c27dcb-ef6a-4ffc-b1f2-d0a2c5da38a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:25.847639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c27dcb-ef6a-4ffc-b1f2-d0a2c5da38a7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:25.858372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 918/1847] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:25.862070 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb30f2-23a4-4704-aa9b-ec64fc3eae4c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:25.872089 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb30f2-23a4-4704-aa9b-ec64fc3eae4c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:25.876754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49073e6-df95-4508-aa0d-73b1d251d89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:25.877405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49073e6-df95-4508-aa0d-73b1d251d89a admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:25.877692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49073e6-df95-4508-aa0d-73b1d251d89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:25.877971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49073e6-df95-4508-aa0d-73b1d251d89a admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:25.878735 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49073e6-df95-4508-aa0d-73b1d251d89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:25.881037 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49073e6-df95-4508-aa0d-73b1d251d89a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:25.893706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 930/1848] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:32:25.896185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c27dcb-ef6a-4ffc-b1f2-d0a2c5da38a7 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:25.905888 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c27dcb-ef6a-4ffc-b1f2-d0a2c5da38a7 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:25.911655 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a628de-d10b-49ff-8848-a53e03e2056f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:25.912547 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a628de-d10b-49ff-8848-a53e03e2056f admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:25.912832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a628de-d10b-49ff-8848-a53e03e2056f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:25.913107 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a628de-d10b-49ff-8848-a53e03e2056f admin admin] PATH_INFO: `/v3/projects/8f3b275b6d5f4b1ca7944c5b1e8f14ff/users/2ba6c8d995834c3b87fc596ab0c95158/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:25.928049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a628de-d10b-49ff-8848-a53e03e2056f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3b275b6d5f4b1ca7944c5b1e8f14ff, user_id=2ba6c8d995834c3b87fc596ab0c95158, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:25.930765 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a628de-d10b-49ff-8848-a53e03e2056f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:25.944254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 919/1849] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:25 2022] PUT /identity/v3/projects/8f3b275b6d5f4b1ca7944c5b1e8f14ff/users/2ba6c8d995834c3b87fc596ab0c95158/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:25.955004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c63d57-44a3-4029-a1d9-cf029e41e1e7 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:25.955352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c63d57-44a3-4029-a1d9-cf029e41e1e7 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:25.955639 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c63d57-44a3-4029-a1d9-cf029e41e1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:25.983786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-73c63d57-44a3-4029-a1d9-cf029e41e1e7 None None] MFA Rules not processed for user `2ba6c8d995834c3b87fc596ab0c95158`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:25.985038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-73c63d57-44a3-4029-a1d9-cf029e41e1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:26.064873 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 931/1850] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:26.069602 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a628de-d10b-49ff-8848-a53e03e2056f admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:26.133205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a628de-d10b-49ff-8848-a53e03e2056f admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:26.137836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c1efe-c49f-49c7-816b-339d994eb39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:26.138526 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c1efe-c49f-49c7-816b-339d994eb39a admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:26.138809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c1efe-c49f-49c7-816b-339d994eb39a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:26.139083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c1efe-c49f-49c7-816b-339d994eb39a admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:26.139795 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c1efe-c49f-49c7-816b-339d994eb39a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:26.141736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c1efe-c49f-49c7-816b-339d994eb39a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:26.175289 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 920/1851] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:26 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:26.179057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c63d57-44a3-4029-a1d9-cf029e41e1e7 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:26.190378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c63d57-44a3-4029-a1d9-cf029e41e1e7 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:26.253729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b9f78-1607-4045-a0a9-52b19da3625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:26.255122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b9f78-1607-4045-a0a9-52b19da3625c admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:26.255406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b9f78-1607-4045-a0a9-52b19da3625c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:26.255685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b9f78-1607-4045-a0a9-52b19da3625c admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:26.256383 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b9f78-1607-4045-a0a9-52b19da3625c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:26.258378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b9f78-1607-4045-a0a9-52b19da3625c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:26.278633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 932/1852] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:26 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:32:26.282632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c1efe-c49f-49c7-816b-339d994eb39a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:26.293127 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c1efe-c49f-49c7-816b-339d994eb39a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:26.297626 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00ee1c-a39c-4fe7-83c7-421ba209d70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:26.298313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00ee1c-a39c-4fe7-83c7-421ba209d70d admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:26.298593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00ee1c-a39c-4fe7-83c7-421ba209d70d admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:26.298866 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00ee1c-a39c-4fe7-83c7-421ba209d70d admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:26.299591 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00ee1c-a39c-4fe7-83c7-421ba209d70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:26.301340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00ee1c-a39c-4fe7-83c7-421ba209d70d admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:26.315675 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 921/1853] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:26.317452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b9f78-1607-4045-a0a9-52b19da3625c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:26.327866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b9f78-1607-4045-a0a9-52b19da3625c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:26.333177 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078dac8-4d48-4778-b2e4-fecdd2b031f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:26.334062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078dac8-4d48-4778-b2e4-fecdd2b031f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:26.334964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078dac8-4d48-4778-b2e4-fecdd2b031f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:26.335294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078dac8-4d48-4778-b2e4-fecdd2b031f6 admin admin] PATH_INFO: `/v3/projects/204fb6237c734d1390de7c71fc4068a7/users/5e3fee7f5f20421dbceb9a9cb4ae2afd/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:26.349897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078dac8-4d48-4778-b2e4-fecdd2b031f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=204fb6237c734d1390de7c71fc4068a7, user_id=5e3fee7f5f20421dbceb9a9cb4ae2afd, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:26.352721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078dac8-4d48-4778-b2e4-fecdd2b031f6 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:26.366539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 933/1854] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:26 2022] PUT /identity/v3/projects/204fb6237c734d1390de7c71fc4068a7/users/5e3fee7f5f20421dbceb9a9cb4ae2afd/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:26.370729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00ee1c-a39c-4fe7-83c7-421ba209d70d admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:26.382891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00ee1c-a39c-4fe7-83c7-421ba209d70d admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:26.455156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e55b1-5d80-4e7f-ae58-ba7ce5d31f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:26.455836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e55b1-5d80-4e7f-ae58-ba7ce5d31f16 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:26.456124 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e55b1-5d80-4e7f-ae58-ba7ce5d31f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:26.456540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e55b1-5d80-4e7f-ae58-ba7ce5d31f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:26.457393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e55b1-5d80-4e7f-ae58-ba7ce5d31f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:26.459195 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e55b1-5d80-4e7f-ae58-ba7ce5d31f16 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:26.469709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 922/1855] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:26.474202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078dac8-4d48-4778-b2e4-fecdd2b031f6 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:26.487933 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078dac8-4d48-4778-b2e4-fecdd2b031f6 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:26.494303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a793ac-9bc0-4b0c-a408-de4e6a661d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:26.495283 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a793ac-9bc0-4b0c-a408-de4e6a661d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:26.495603 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a793ac-9bc0-4b0c-a408-de4e6a661d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:26.495890 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a793ac-9bc0-4b0c-a408-de4e6a661d3c admin admin] PATH_INFO: `/v3/projects/204fb6237c734d1390de7c71fc4068a7/users/5e3fee7f5f20421dbceb9a9cb4ae2afd/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:26.498093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a793ac-9bc0-4b0c-a408-de4e6a661d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=204fb6237c734d1390de7c71fc4068a7, user_id=5e3fee7f5f20421dbceb9a9cb4ae2afd, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:26.500652 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a793ac-9bc0-4b0c-a408-de4e6a661d3c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:26.511633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 934/1856] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:26 2022] PUT /identity/v3/projects/204fb6237c734d1390de7c71fc4068a7/users/5e3fee7f5f20421dbceb9a9cb4ae2afd/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:26.524356 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6791e16-7310-4cb4-9f88-6b5bafe3b8bf None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:26.524653 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6791e16-7310-4cb4-9f88-6b5bafe3b8bf None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:26.524943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6791e16-7310-4cb4-9f88-6b5bafe3b8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:26.560496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-f6791e16-7310-4cb4-9f88-6b5bafe3b8bf None None] MFA Rules not processed for user `5e3fee7f5f20421dbceb9a9cb4ae2afd`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:26.561982 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f6791e16-7310-4cb4-9f88-6b5bafe3b8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:26.661751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 923/1857] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:26.672851 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a793ac-9bc0-4b0c-a408-de4e6a661d3c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:26.675147 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-91a793ac-9bc0-4b0c-a408-de4e6a661d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:26.736830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a793ac-9bc0-4b0c-a408-de4e6a661d3c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:26.741207 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dad802-5624-4a03-85c5-310f5d46df38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:26.741860 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dad802-5624-4a03-85c5-310f5d46df38 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:26.742145 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dad802-5624-4a03-85c5-310f5d46df38 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:26.742473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dad802-5624-4a03-85c5-310f5d46df38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:26.752192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dad802-5624-4a03-85c5-310f5d46df38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:26.753637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dad802-5624-4a03-85c5-310f5d46df38 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:26.764496 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 935/1858] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:27.221189 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6791e16-7310-4cb4-9f88-6b5bafe3b8bf None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:27.296454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6791e16-7310-4cb4-9f88-6b5bafe3b8bf None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:27.302668 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb430f-738e-4791-a288-3a030e8561ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:27.303625 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb430f-738e-4791-a288-3a030e8561ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:27.303971 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb430f-738e-4791-a288-3a030e8561ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:27.304290 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb430f-738e-4791-a288-3a030e8561ba admin admin] PATH_INFO: `/v3/users/2ba6c8d995834c3b87fc596ab0c95158` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:27.305501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb430f-738e-4791-a288-3a030e8561ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba6c8d995834c3b87fc596ab0c95158)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:27.307584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb430f-738e-4791-a288-3a030e8561ba admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:27.355867 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fffb430f-738e-4791-a288-3a030e8561ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba6c8d995834c3b87fc596ab0c95158'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:27.362663 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fffb430f-738e-4791-a288-3a030e8561ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba6c8d995834c3b87fc596ab0c95158'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:27.363499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fffb430f-738e-4791-a288-3a030e8561ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba6c8d995834c3b87fc596ab0c95158'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:27.375776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fffb430f-738e-4791-a288-3a030e8561ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba6c8d995834c3b87fc596ab0c95158'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:27.383368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fffb430f-738e-4791-a288-3a030e8561ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba6c8d995834c3b87fc596ab0c95158'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:27.389884 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 924/1859] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:27 2022] DELETE /identity/v3/users/2ba6c8d995834c3b87fc596ab0c95158 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:27.397340 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c2640-e1a5-4912-af6d-40ea34e6177d None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:27.397340 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c2640-e1a5-4912-af6d-40ea34e6177d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:27.397340 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c2640-e1a5-4912-af6d-40ea34e6177d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:27.416374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-235c2640-e1a5-4912-af6d-40ea34e6177d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:27.417427 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-235c2640-e1a5-4912-af6d-40ea34e6177d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:27.611891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 936/1860] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:27.623824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb430f-738e-4791-a288-3a030e8561ba admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:27.625318 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-fffb430f-738e-4791-a288-3a030e8561ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:27.699626 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb430f-738e-4791-a288-3a030e8561ba admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:27.703584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee777710-173e-4bef-a354-f4ccd6fefab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:27.704242 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee777710-173e-4bef-a354-f4ccd6fefab9 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:27.704531 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee777710-173e-4bef-a354-f4ccd6fefab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:27.704807 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee777710-173e-4bef-a354-f4ccd6fefab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:27.714858 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee777710-173e-4bef-a354-f4ccd6fefab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:27.716306 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee777710-173e-4bef-a354-f4ccd6fefab9 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:27.727149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 925/1861] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:28.339917 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c2640-e1a5-4912-af6d-40ea34e6177d None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:28.341381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-235c2640-e1a5-4912-af6d-40ea34e6177d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:28.355345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c2640-e1a5-4912-af6d-40ea34e6177d None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:28.359817 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4d484-b46f-4814-b669-907514ed71b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:28.360628 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4d484-b46f-4814-b669-907514ed71b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:28.360965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4d484-b46f-4814-b669-907514ed71b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:28.361262 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4d484-b46f-4814-b669-907514ed71b9 admin admin] PATH_INFO: `/v3/projects/8f3b275b6d5f4b1ca7944c5b1e8f14ff` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:28.362653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4d484-b46f-4814-b669-907514ed71b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3b275b6d5f4b1ca7944c5b1e8f14ff)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:28.365678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4d484-b46f-4814-b669-907514ed71b9 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:28.422466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-efc4d484-b46f-4814-b669-907514ed71b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3b275b6d5f4b1ca7944c5b1e8f14ff', 'request_id': 'req-efc4d484-b46f-4814-b669-907514ed71b9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:28.429016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-efc4d484-b46f-4814-b669-907514ed71b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3b275b6d5f4b1ca7944c5b1e8f14ff', 'request_id': 'req-efc4d484-b46f-4814-b669-907514ed71b9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:28.437398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-efc4d484-b46f-4814-b669-907514ed71b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3b275b6d5f4b1ca7944c5b1e8f14ff', 'request_id': 'req-efc4d484-b46f-4814-b669-907514ed71b9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:28.448805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-efc4d484-b46f-4814-b669-907514ed71b9 admin admin] The token cache is being invalidate because project 8f3b275b6d5f4b1ca7944c5b1e8f14ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:28.449237 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-efc4d484-b46f-4814-b669-907514ed71b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:28.449831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-efc4d484-b46f-4814-b669-907514ed71b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:28.451799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 937/1862] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:28 2022] DELETE /identity/v3/projects/8f3b275b6d5f4b1ca7944c5b1e8f14ff => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:28.456076 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee777710-173e-4bef-a354-f4ccd6fefab9 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:28.467652 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee777710-173e-4bef-a354-f4ccd6fefab9 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:28.477988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4d484-b46f-4814-b669-907514ed71b9 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:28.479494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-efc4d484-b46f-4814-b669-907514ed71b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:28.547820 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f099236-477c-4789-8da9-be0c55807e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:28.549250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f099236-477c-4789-8da9-be0c55807e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:28.549599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f099236-477c-4789-8da9-be0c55807e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:28.550240 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f099236-477c-4789-8da9-be0c55807e52 admin admin] PATH_INFO: `/v3/users/5e3fee7f5f20421dbceb9a9cb4ae2afd` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:28.551763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f099236-477c-4789-8da9-be0c55807e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3fee7f5f20421dbceb9a9cb4ae2afd)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:28.554031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f099236-477c-4789-8da9-be0c55807e52 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:28.561190 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4d484-b46f-4814-b669-907514ed71b9 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:28.572467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87db9c-f7d5-429e-bfb5-d4398b74dbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:28.573428 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87db9c-f7d5-429e-bfb5-d4398b74dbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:28.573803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87db9c-f7d5-429e-bfb5-d4398b74dbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:28.574161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87db9c-f7d5-429e-bfb5-d4398b74dbb2 admin admin] PATH_INFO: `/v3/users/61732fa4a788461eaea0717d0afd6cb1` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:28.576157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87db9c-f7d5-429e-bfb5-d4398b74dbb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61732fa4a788461eaea0717d0afd6cb1)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:28.579172 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87db9c-f7d5-429e-bfb5-d4398b74dbb2 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:28.621059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0f099236-477c-4789-8da9-be0c55807e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3fee7f5f20421dbceb9a9cb4ae2afd'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:28.635196 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0f099236-477c-4789-8da9-be0c55807e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3fee7f5f20421dbceb9a9cb4ae2afd'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:28.636789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0f099236-477c-4789-8da9-be0c55807e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3fee7f5f20421dbceb9a9cb4ae2afd'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:28.653952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0f099236-477c-4789-8da9-be0c55807e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3fee7f5f20421dbceb9a9cb4ae2afd'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:28.662783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-bf87db9c-f7d5-429e-bfb5-d4398b74dbb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61732fa4a788461eaea0717d0afd6cb1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:28.669612 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0f099236-477c-4789-8da9-be0c55807e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3fee7f5f20421dbceb9a9cb4ae2afd'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:28.673763 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-bf87db9c-f7d5-429e-bfb5-d4398b74dbb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61732fa4a788461eaea0717d0afd6cb1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:28.674765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-bf87db9c-f7d5-429e-bfb5-d4398b74dbb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61732fa4a788461eaea0717d0afd6cb1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:28.683423 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 926/1863] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:28 2022] DELETE /identity/v3/users/5e3fee7f5f20421dbceb9a9cb4ae2afd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:28.691051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-bf87db9c-f7d5-429e-bfb5-d4398b74dbb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61732fa4a788461eaea0717d0afd6cb1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:28.710821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-bf87db9c-f7d5-429e-bfb5-d4398b74dbb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61732fa4a788461eaea0717d0afd6cb1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:28.723843 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 938/1864] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:28 2022] DELETE /identity/v3/users/61732fa4a788461eaea0717d0afd6cb1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:28.728674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de741b4-1f39-479e-a3dd-d1c696f4c06a None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:28.732106 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de741b4-1f39-479e-a3dd-d1c696f4c06a None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:28.732589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de741b4-1f39-479e-a3dd-d1c696f4c06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:28.780890 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-6de741b4-1f39-479e-a3dd-d1c696f4c06a None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:28.784957 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6de741b4-1f39-479e-a3dd-d1c696f4c06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:28.921384 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 927/1865] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:28.942406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87db9c-f7d5-429e-bfb5-d4398b74dbb2 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:28.943795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-bf87db9c-f7d5-429e-bfb5-d4398b74dbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:29.092001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87db9c-f7d5-429e-bfb5-d4398b74dbb2 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:29.106757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214addf-5893-4aac-870d-d550b9d8e9c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:29.108096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214addf-5893-4aac-870d-d550b9d8e9c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:29.108096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214addf-5893-4aac-870d-d550b9d8e9c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:29.108555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214addf-5893-4aac-870d-d550b9d8e9c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:29.132000 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214addf-5893-4aac-870d-d550b9d8e9c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:29.133606 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214addf-5893-4aac-870d-d550b9d8e9c9 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:29.154663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 939/1866] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:29.862303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de741b4-1f39-479e-a3dd-d1c696f4c06a None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:29.864991 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6de741b4-1f39-479e-a3dd-d1c696f4c06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:29.882726 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de741b4-1f39-479e-a3dd-d1c696f4c06a None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:29.893844 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f295-7cca-4b06-ad74-05ea67becfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:29.895225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f295-7cca-4b06-ad74-05ea67becfe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:29.895675 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f295-7cca-4b06-ad74-05ea67becfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:29.896131 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f295-7cca-4b06-ad74-05ea67becfe9 admin admin] PATH_INFO: `/v3/projects/204fb6237c734d1390de7c71fc4068a7` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:29.897659 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f295-7cca-4b06-ad74-05ea67becfe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=204fb6237c734d1390de7c71fc4068a7)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:29.900152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f295-7cca-4b06-ad74-05ea67becfe9 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:29.958493 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7223f295-7cca-4b06-ad74-05ea67becfe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '204fb6237c734d1390de7c71fc4068a7', 'request_id': 'req-7223f295-7cca-4b06-ad74-05ea67becfe9'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:29.965897 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7223f295-7cca-4b06-ad74-05ea67becfe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '204fb6237c734d1390de7c71fc4068a7', 'request_id': 'req-7223f295-7cca-4b06-ad74-05ea67becfe9'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:29.976538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7223f295-7cca-4b06-ad74-05ea67becfe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '204fb6237c734d1390de7c71fc4068a7', 'request_id': 'req-7223f295-7cca-4b06-ad74-05ea67becfe9'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:29.991097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7223f295-7cca-4b06-ad74-05ea67becfe9 admin admin] The token cache is being invalidate because project 204fb6237c734d1390de7c71fc4068a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:29.992189 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7223f295-7cca-4b06-ad74-05ea67becfe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:29.992862 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7223f295-7cca-4b06-ad74-05ea67becfe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:29.994926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 928/1867] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:29 2022] DELETE /identity/v3/projects/204fb6237c734d1390de7c71fc4068a7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:29.999958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457911c-70fe-473d-9958-43dc1a1e396b None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:30.000832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457911c-70fe-473d-9958-43dc1a1e396b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:30.001279 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457911c-70fe-473d-9958-43dc1a1e396b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:30.026490 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-8457911c-70fe-473d-9958-43dc1a1e396b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:30.027769 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-8457911c-70fe-473d-9958-43dc1a1e396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:30.078274 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f295-7cca-4b06-ad74-05ea67becfe9 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:30.079709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7223f295-7cca-4b06-ad74-05ea67becfe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:30.114902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 940/1868] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:30.117360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4ec06-9357-4127-b822-399ff26e24ed None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:30.117660 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4ec06-9357-4127-b822-399ff26e24ed None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:30.117941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4ec06-9357-4127-b822-399ff26e24ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:30.148998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-5ff4ec06-9357-4127-b822-399ff26e24ed None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:30.150809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5ff4ec06-9357-4127-b822-399ff26e24ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:30.159217 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f295-7cca-4b06-ad74-05ea67becfe9 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:30.164331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 941/1869] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:30.167881 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc60a5-546b-4d90-b6ad-7aea51a765d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:30.168747 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4ec06-9357-4127-b822-399ff26e24ed None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:30.169607 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc60a5-546b-4d90-b6ad-7aea51a765d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:30.169607 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc60a5-546b-4d90-b6ad-7aea51a765d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:30.169790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc60a5-546b-4d90-b6ad-7aea51a765d0 admin admin] PATH_INFO: `/v3/users/3cee1920156344dd9a73fe68c8771778` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:30.170998 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc60a5-546b-4d90-b6ad-7aea51a765d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cee1920156344dd9a73fe68c8771778)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:30.173568 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc60a5-546b-4d90-b6ad-7aea51a765d0 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:30.207296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4ec06-9357-4127-b822-399ff26e24ed None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:30.214206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f80b54-9992-4d06-af94-7b6ec762c3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:30.214797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f80b54-9992-4d06-af94-7b6ec762c3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:30.215015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f80b54-9992-4d06-af94-7b6ec762c3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:30.216122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f80b54-9992-4d06-af94-7b6ec762c3e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:30.216974 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f80b54-9992-4d06-af94-7b6ec762c3e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:32:30.217378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f80b54-9992-4d06-af94-7b6ec762c3e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:30.219188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f80b54-9992-4d06-af94-7b6ec762c3e5 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:30.237110 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 942/1870] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:32:30.238940 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f80b54-9992-4d06-af94-7b6ec762c3e5 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:30.242136 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-51f80b54-9992-4d06-af94-7b6ec762c3e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:30.261602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f80b54-9992-4d06-af94-7b6ec762c3e5 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:30.267231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8e7be-31da-497f-a0c1-4529bd6bc4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:30.268228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8e7be-31da-497f-a0c1-4529bd6bc4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:30.268590 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8e7be-31da-497f-a0c1-4529bd6bc4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:30.268936 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8e7be-31da-497f-a0c1-4529bd6bc4fe admin admin] PATH_INFO: `/v3/projects/1d3f6bcdf42542e1a5640df3e16ab8f2` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:30.270799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e6cc60a5-546b-4d90-b6ad-7aea51a765d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cee1920156344dd9a73fe68c8771778'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:30.270998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8e7be-31da-497f-a0c1-4529bd6bc4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3f6bcdf42542e1a5640df3e16ab8f2)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:30.273029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8e7be-31da-497f-a0c1-4529bd6bc4fe admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:30.279231 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e6cc60a5-546b-4d90-b6ad-7aea51a765d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cee1920156344dd9a73fe68c8771778'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:30.280401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e6cc60a5-546b-4d90-b6ad-7aea51a765d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cee1920156344dd9a73fe68c8771778'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:30.300195 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e6cc60a5-546b-4d90-b6ad-7aea51a765d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cee1920156344dd9a73fe68c8771778'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:30.313699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e6cc60a5-546b-4d90-b6ad-7aea51a765d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cee1920156344dd9a73fe68c8771778'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:30.321418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 929/1871] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:30 2022] DELETE /identity/v3/users/3cee1920156344dd9a73fe68c8771778 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:30.330018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a9b8e7be-31da-497f-a0c1-4529bd6bc4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3f6bcdf42542e1a5640df3e16ab8f2', 'request_id': 'req-a9b8e7be-31da-497f-a0c1-4529bd6bc4fe'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:30.330828 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc60a5-546b-4d90-b6ad-7aea51a765d0 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:30.332982 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e6cc60a5-546b-4d90-b6ad-7aea51a765d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:30.337858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a9b8e7be-31da-497f-a0c1-4529bd6bc4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3f6bcdf42542e1a5640df3e16ab8f2', 'request_id': 'req-a9b8e7be-31da-497f-a0c1-4529bd6bc4fe'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:30.345237 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a9b8e7be-31da-497f-a0c1-4529bd6bc4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3f6bcdf42542e1a5640df3e16ab8f2', 'request_id': 'req-a9b8e7be-31da-497f-a0c1-4529bd6bc4fe'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:30.361715 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a9b8e7be-31da-497f-a0c1-4529bd6bc4fe admin admin] The token cache is being invalidate because project 1d3f6bcdf42542e1a5640df3e16ab8f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:30.362142 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a9b8e7be-31da-497f-a0c1-4529bd6bc4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:30.362950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a9b8e7be-31da-497f-a0c1-4529bd6bc4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:30.367430 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 943/1872] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:30 2022] DELETE /identity/v3/projects/1d3f6bcdf42542e1a5640df3e16ab8f2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:30.367430 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b374ecc-8b16-4e2a-8a5a-b469be81ce31 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:30.367430 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b374ecc-8b16-4e2a-8a5a-b469be81ce31 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:30.367430 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b374ecc-8b16-4e2a-8a5a-b469be81ce31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:30.383944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-5b374ecc-8b16-4e2a-8a5a-b469be81ce31 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:30.385267 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5b374ecc-8b16-4e2a-8a5a-b469be81ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:30.409379 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc60a5-546b-4d90-b6ad-7aea51a765d0 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:30.414658 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbd26e-d0fc-4c70-9f27-2cf87a0c3f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:30.415577 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbd26e-d0fc-4c70-9f27-2cf87a0c3f3e admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:30.416146 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbd26e-d0fc-4c70-9f27-2cf87a0c3f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:30.416619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbd26e-d0fc-4c70-9f27-2cf87a0c3f3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:30.417811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbd26e-d0fc-4c70-9f27-2cf87a0c3f3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:30.420092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbd26e-d0fc-4c70-9f27-2cf87a0c3f3e admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:30.447714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 930/1873] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:30 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:30.452083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbd26e-d0fc-4c70-9f27-2cf87a0c3f3e admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:30.453746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0bdbd26e-d0fc-4c70-9f27-2cf87a0c3f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:30.461474 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 944/1874] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:30.462431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b374ecc-8b16-4e2a-8a5a-b469be81ce31 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:30.463825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5b374ecc-8b16-4e2a-8a5a-b469be81ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:30.477159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b374ecc-8b16-4e2a-8a5a-b469be81ce31 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:30.531737 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbd26e-d0fc-4c70-9f27-2cf87a0c3f3e admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:30.544596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dc838-6af7-4797-bf11-b59051f2c823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:30.545285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dc838-6af7-4797-bf11-b59051f2c823 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:30.545572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dc838-6af7-4797-bf11-b59051f2c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:30.545943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dc838-6af7-4797-bf11-b59051f2c823 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:30.546978 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dc838-6af7-4797-bf11-b59051f2c823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:30.549335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dc838-6af7-4797-bf11-b59051f2c823 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:30.559615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82257b52-2cba-4d65-9c38-c4f204670d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:30.560706 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82257b52-2cba-4d65-9c38-c4f204670d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:30.561086 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82257b52-2cba-4d65-9c38-c4f204670d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:30.561483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82257b52-2cba-4d65-9c38-c4f204670d46 admin admin] PATH_INFO: `/v3/users/e315314fca3e44a9857df984666e116c` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:30.562837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82257b52-2cba-4d65-9c38-c4f204670d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e315314fca3e44a9857df984666e116c)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:30.564855 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82257b52-2cba-4d65-9c38-c4f204670d46 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:30.588004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 945/1875] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:30 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:30.589136 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dc838-6af7-4797-bf11-b59051f2c823 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:30.599905 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-cb6dc838-6af7-4797-bf11-b59051f2c823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:30.654718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-82257b52-2cba-4d65-9c38-c4f204670d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e315314fca3e44a9857df984666e116c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:30.667222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-82257b52-2cba-4d65-9c38-c4f204670d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e315314fca3e44a9857df984666e116c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:30.668477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-82257b52-2cba-4d65-9c38-c4f204670d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e315314fca3e44a9857df984666e116c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:30.690647 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-82257b52-2cba-4d65-9c38-c4f204670d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e315314fca3e44a9857df984666e116c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:30.703869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dc838-6af7-4797-bf11-b59051f2c823 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:30.706373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-82257b52-2cba-4d65-9c38-c4f204670d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e315314fca3e44a9857df984666e116c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:30.711213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f63e3d-716e-4458-973b-974d370caacf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:30.712093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f63e3d-716e-4458-973b-974d370caacf service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:30.712386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f63e3d-716e-4458-973b-974d370caacf service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:30.712752 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f63e3d-716e-4458-973b-974d370caacf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:30.717480 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-85f63e3d-716e-4458-973b-974d370caacf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:30.717621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 931/1876] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:30 2022] DELETE /identity/v3/users/e315314fca3e44a9857df984666e116c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:30.717621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82257b52-2cba-4d65-9c38-c4f204670d46 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:30.728146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f63e3d-716e-4458-973b-974d370caacf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:30.729678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f63e3d-716e-4458-973b-974d370caacf service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:30.730460 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-82257b52-2cba-4d65-9c38-c4f204670d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:30.752565 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 946/1877] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:30.873096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82257b52-2cba-4d65-9c38-c4f204670d46 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:30.881000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4332291-8d02-4d1e-8413-f4ab15e64770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:30.882054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4332291-8d02-4d1e-8413-f4ab15e64770 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:30.882613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4332291-8d02-4d1e-8413-f4ab15e64770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:30.883160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4332291-8d02-4d1e-8413-f4ab15e64770 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:30.884309 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4332291-8d02-4d1e-8413-f4ab15e64770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:30.886713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4332291-8d02-4d1e-8413-f4ab15e64770 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:30.901336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 932/1878] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:30.905312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f63e3d-716e-4458-973b-974d370caacf service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:30.915992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f63e3d-716e-4458-973b-974d370caacf service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:30.920662 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72909602-d31e-42f6-8029-8c2588be8055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:30.921428 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72909602-d31e-42f6-8029-8c2588be8055 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:30.921808 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72909602-d31e-42f6-8029-8c2588be8055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:30.922231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72909602-d31e-42f6-8029-8c2588be8055 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:30.923060 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72909602-d31e-42f6-8029-8c2588be8055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:30.925210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72909602-d31e-42f6-8029-8c2588be8055 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:30.936106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 947/1879] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:32:30.940010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4332291-8d02-4d1e-8413-f4ab15e64770 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:30.954376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4332291-8d02-4d1e-8413-f4ab15e64770 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:30.959550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88d8e-7758-43cf-8c7e-43d8bad50c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:30.960745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88d8e-7758-43cf-8c7e-43d8bad50c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:30.960882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88d8e-7758-43cf-8c7e-43d8bad50c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:30.961176 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88d8e-7758-43cf-8c7e-43d8bad50c9c admin admin] PATH_INFO: `/v3/projects/a99db89d5866447e803708cf784c8498/users/4608183d849a434eb98261856c4d632d/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:30.981553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da88d8e-7758-43cf-8c7e-43d8bad50c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99db89d5866447e803708cf784c8498, user_id=4608183d849a434eb98261856c4d632d, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:30.984394 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da88d8e-7758-43cf-8c7e-43d8bad50c9c admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:31.000759 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 933/1880] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:30 2022] PUT /identity/v3/projects/a99db89d5866447e803708cf784c8498/users/4608183d849a434eb98261856c4d632d/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:31.012071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c0474-df78-4851-b1c6-e4f1cd79b4d9 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:31.012588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c0474-df78-4851-b1c6-e4f1cd79b4d9 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:31.012588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c0474-df78-4851-b1c6-e4f1cd79b4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:31.044668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-523c0474-df78-4851-b1c6-e4f1cd79b4d9 None None] MFA Rules not processed for user `4608183d849a434eb98261856c4d632d`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:31.046566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-523c0474-df78-4851-b1c6-e4f1cd79b4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:31.168021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 948/1881] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:31.179712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88d8e-7758-43cf-8c7e-43d8bad50c9c admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:31.181533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5da88d8e-7758-43cf-8c7e-43d8bad50c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:31.258170 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88d8e-7758-43cf-8c7e-43d8bad50c9c admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:31.262059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f1cd1-8953-4962-95d5-89ef254e5904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:31.262980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f1cd1-8953-4962-95d5-89ef254e5904 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:31.263137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f1cd1-8953-4962-95d5-89ef254e5904 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:31.263415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f1cd1-8953-4962-95d5-89ef254e5904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:31.275183 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f1cd1-8953-4962-95d5-89ef254e5904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:31.277199 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f1cd1-8953-4962-95d5-89ef254e5904 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:31.289224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 934/1882] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:31.788951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c0474-df78-4851-b1c6-e4f1cd79b4d9 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:31.790636 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-523c0474-df78-4851-b1c6-e4f1cd79b4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:31.805644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f1cd1-8953-4962-95d5-89ef254e5904 service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:31.807376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d57f1cd1-8953-4962-95d5-89ef254e5904 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:31.915168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f1cd1-8953-4962-95d5-89ef254e5904 service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:31.924682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:31.926015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:31.926709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:31.927252 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9 admin admin] PATH_INFO: `/v3/projects/26268a71a0194a27bde23a2e53fea008` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:31.930363 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26268a71a0194a27bde23a2e53fea008)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:31.933176 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:31.986646 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c0474-df78-4851-b1c6-e4f1cd79b4d9 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:32.022105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26268a71a0194a27bde23a2e53fea008', 'request_id': 'req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:32.035739 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26268a71a0194a27bde23a2e53fea008', 'request_id': 'req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:32.055273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26268a71a0194a27bde23a2e53fea008', 'request_id': 'req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:32.088881 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9 admin admin] The token cache is being invalidate because project 26268a71a0194a27bde23a2e53fea008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:32.089190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:32.089925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:32.094432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 935/1883] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:31 2022] DELETE /identity/v3/projects/26268a71a0194a27bde23a2e53fea008 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:32.098457 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:32.099994 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:32.130162 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6257f7-cb0a-4832-aa45-470fd79a720a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:32.131655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6257f7-cb0a-4832-aa45-470fd79a720a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:32.132088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6257f7-cb0a-4832-aa45-470fd79a720a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:32.133121 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6257f7-cb0a-4832-aa45-470fd79a720a admin admin] PATH_INFO: `/v3/projects/f5839cc032574522875943a11f26568a` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:32.135283 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6257f7-cb0a-4832-aa45-470fd79a720a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5839cc032574522875943a11f26568a)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:32.138412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6257f7-cb0a-4832-aa45-470fd79a720a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:32.197773 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fe1b1-7e9f-458e-ada4-88f50ded7ee9 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:32.211869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-5e6257f7-cb0a-4832-aa45-470fd79a720a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5839cc032574522875943a11f26568a', 'request_id': 'req-5e6257f7-cb0a-4832-aa45-470fd79a720a'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:32.222951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-5e6257f7-cb0a-4832-aa45-470fd79a720a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5839cc032574522875943a11f26568a', 'request_id': 'req-5e6257f7-cb0a-4832-aa45-470fd79a720a'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:32.232948 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-5e6257f7-cb0a-4832-aa45-470fd79a720a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5839cc032574522875943a11f26568a', 'request_id': 'req-5e6257f7-cb0a-4832-aa45-470fd79a720a'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:32.262939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-5e6257f7-cb0a-4832-aa45-470fd79a720a admin admin] The token cache is being invalidate because project f5839cc032574522875943a11f26568a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:32.263241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-5e6257f7-cb0a-4832-aa45-470fd79a720a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:32.264203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-5e6257f7-cb0a-4832-aa45-470fd79a720a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:32.265954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 949/1884] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:31 2022] DELETE /identity/v3/projects/f5839cc032574522875943a11f26568a => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:32.270329 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2eebc-31cd-4107-87ce-015d9e6464f0 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:32.270733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2eebc-31cd-4107-87ce-015d9e6464f0 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:32.271116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2eebc-31cd-4107-87ce-015d9e6464f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:32.288528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673ac6c-0a29-41fa-a7ef-09543c5ee928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:32.289328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673ac6c-0a29-41fa-a7ef-09543c5ee928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:32.289606 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673ac6c-0a29-41fa-a7ef-09543c5ee928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:32.289878 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673ac6c-0a29-41fa-a7ef-09543c5ee928 admin admin] PATH_INFO: `/v3/users/0e237565dc074c87a17c76c0934f0381` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:32.291192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673ac6c-0a29-41fa-a7ef-09543c5ee928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e237565dc074c87a17c76c0934f0381)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:32.291431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-2af2eebc-31cd-4107-87ce-015d9e6464f0 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:32.292755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2af2eebc-31cd-4107-87ce-015d9e6464f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:32.293116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673ac6c-0a29-41fa-a7ef-09543c5ee928 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:32.303469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 950/1885] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:32.311718 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882260f-4de7-4db4-bf75-edaa9380a502 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:32.312177 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882260f-4de7-4db4-bf75-edaa9380a502 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:32.312482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882260f-4de7-4db4-bf75-edaa9380a502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:32.332026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c882260f-4de7-4db4-bf75-edaa9380a502 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:32.333436 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c882260f-4de7-4db4-bf75-edaa9380a502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:32.341582 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 951/1886] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:32.345631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882260f-4de7-4db4-bf75-edaa9380a502 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:32.352207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7673ac6c-0a29-41fa-a7ef-09543c5ee928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e237565dc074c87a17c76c0934f0381'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:32.355567 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882260f-4de7-4db4-bf75-edaa9380a502 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:32.359470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7673ac6c-0a29-41fa-a7ef-09543c5ee928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e237565dc074c87a17c76c0934f0381'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:32.360182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7673ac6c-0a29-41fa-a7ef-09543c5ee928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e237565dc074c87a17c76c0934f0381'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:32.360623 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfb011-9c6b-423f-a4e0-e931d34be33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:32.361284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfb011-9c6b-423f-a4e0-e931d34be33c admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:32.361566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfb011-9c6b-423f-a4e0-e931d34be33c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:32.362124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfb011-9c6b-423f-a4e0-e931d34be33c admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:32.362699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfb011-9c6b-423f-a4e0-e931d34be33c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:32:32.363159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfb011-9c6b-423f-a4e0-e931d34be33c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:32.364919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfb011-9c6b-423f-a4e0-e931d34be33c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:32.373141 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7673ac6c-0a29-41fa-a7ef-09543c5ee928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e237565dc074c87a17c76c0934f0381'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:32.376883 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 952/1887] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:32:32.382527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfb011-9c6b-423f-a4e0-e931d34be33c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:32.383239 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7673ac6c-0a29-41fa-a7ef-09543c5ee928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e237565dc074c87a17c76c0934f0381'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:32.384591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-63bfb011-9c6b-423f-a4e0-e931d34be33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:32.390461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 936/1888] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:32 2022] DELETE /identity/v3/users/0e237565dc074c87a17c76c0934f0381 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:32.400360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfb011-9c6b-423f-a4e0-e931d34be33c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:32.476571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef158b-4c92-4a53-9fd4-8bac10c94029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:32.477351 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef158b-4c92-4a53-9fd4-8bac10c94029 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:32.477877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef158b-4c92-4a53-9fd4-8bac10c94029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:32.477877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef158b-4c92-4a53-9fd4-8bac10c94029 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:32.478602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef158b-4c92-4a53-9fd4-8bac10c94029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:32.480523 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef158b-4c92-4a53-9fd4-8bac10c94029 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:32.522894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 953/1889] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:32 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:32.525656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673ac6c-0a29-41fa-a7ef-09543c5ee928 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:32.542500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673ac6c-0a29-41fa-a7ef-09543c5ee928 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:32.740411 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77212f-8232-4a8f-b819-ab7fef4d9bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:32.742091 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77212f-8232-4a8f-b819-ab7fef4d9bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:32.742835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77212f-8232-4a8f-b819-ab7fef4d9bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:32.743211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77212f-8232-4a8f-b819-ab7fef4d9bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:32.744010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77212f-8232-4a8f-b819-ab7fef4d9bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:32.748176 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77212f-8232-4a8f-b819-ab7fef4d9bd0 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:32.791388 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 937/1890] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:32 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:32.792635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef158b-4c92-4a53-9fd4-8bac10c94029 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:32.806023 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef158b-4c92-4a53-9fd4-8bac10c94029 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:32.820781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b7910-4b1a-493d-9878-7ef00ece3f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:32.821482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b7910-4b1a-493d-9878-7ef00ece3f0b admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:32.821771 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b7910-4b1a-493d-9878-7ef00ece3f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:32.822050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b7910-4b1a-493d-9878-7ef00ece3f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:32.822828 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b7910-4b1a-493d-9878-7ef00ece3f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:32.824544 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b7910-4b1a-493d-9878-7ef00ece3f0b admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:32.842736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 954/1891] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:32.845653 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77212f-8232-4a8f-b819-ab7fef4d9bd0 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:32.861805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77212f-8232-4a8f-b819-ab7fef4d9bd0 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:32.871017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876f6e7-03c8-4c95-a6e5-3036d1f69fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:32.872122 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876f6e7-03c8-4c95-a6e5-3036d1f69fcf admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:32.872584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876f6e7-03c8-4c95-a6e5-3036d1f69fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:32.873021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876f6e7-03c8-4c95-a6e5-3036d1f69fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:32.874065 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876f6e7-03c8-4c95-a6e5-3036d1f69fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:32.876268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876f6e7-03c8-4c95-a6e5-3036d1f69fcf admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:32.889238 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 938/1892] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:32.893069 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b7910-4b1a-493d-9878-7ef00ece3f0b admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:32.908469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b7910-4b1a-493d-9878-7ef00ece3f0b admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:32.924893 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4b1b5-e4e6-4176-a0ad-09ce9d75316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:32.926102 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4b1b5-e4e6-4176-a0ad-09ce9d75316a admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:32.926371 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4b1b5-e4e6-4176-a0ad-09ce9d75316a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:32.926696 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4b1b5-e4e6-4176-a0ad-09ce9d75316a admin admin] PATH_INFO: `/v3/projects/d3558f5f0b5045ea9c8a6a572bbb6352/users/f1657ca892eb42adacc0c4f8d40cc22e/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:32.960923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4b1b5-e4e6-4176-a0ad-09ce9d75316a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3558f5f0b5045ea9c8a6a572bbb6352, user_id=f1657ca892eb42adacc0c4f8d40cc22e, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:32.963834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4b1b5-e4e6-4176-a0ad-09ce9d75316a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:33.006999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 955/1893] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:32 2022] PUT /identity/v3/projects/d3558f5f0b5045ea9c8a6a572bbb6352/users/f1657ca892eb42adacc0c4f8d40cc22e/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:33.018810 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9ad55-11b4-4e66-a5f2-552413dd85d7 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:33.019421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9ad55-11b4-4e66-a5f2-552413dd85d7 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:33.019676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9ad55-11b4-4e66-a5f2-552413dd85d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:33.060916 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-bfe9ad55-11b4-4e66-a5f2-552413dd85d7 None None] MFA Rules not processed for user `f1657ca892eb42adacc0c4f8d40cc22e`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:33.062230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bfe9ad55-11b4-4e66-a5f2-552413dd85d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:33.109077 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4b1b5-e4e6-4176-a0ad-09ce9d75316a admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:33.112009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-93e4b1b5-e4e6-4176-a0ad-09ce9d75316a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:33.150550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 939/1894] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:33.174612 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9ad55-11b4-4e66-a5f2-552413dd85d7 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:33.177161 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bfe9ad55-11b4-4e66-a5f2-552413dd85d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:33.205319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4b1b5-e4e6-4176-a0ad-09ce9d75316a admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:33.210697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7852b-2a81-4fe0-bb9f-db547db79bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:33.211978 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7852b-2a81-4fe0-bb9f-db547db79bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:33.212639 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7852b-2a81-4fe0-bb9f-db547db79bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:33.212909 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7852b-2a81-4fe0-bb9f-db547db79bcd admin admin] PATH_INFO: `/v3/projects/deb54e14df24431ba279fc3490f1448c` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:33.214251 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7852b-2a81-4fe0-bb9f-db547db79bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb54e14df24431ba279fc3490f1448c)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:33.216270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7852b-2a81-4fe0-bb9f-db547db79bcd admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:33.245808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9ad55-11b4-4e66-a5f2-552413dd85d7 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:33.252907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1611509-96c6-4d9a-ad1d-504145d6e04f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:33.254231 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1611509-96c6-4d9a-ad1d-504145d6e04f service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:33.255289 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1611509-96c6-4d9a-ad1d-504145d6e04f service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:33.257218 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1611509-96c6-4d9a-ad1d-504145d6e04f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:33.266586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1611509-96c6-4d9a-ad1d-504145d6e04f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:33.268075 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1611509-96c6-4d9a-ad1d-504145d6e04f service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:33.279464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 940/1895] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:33.290860 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f4b7852b-2a81-4fe0-bb9f-db547db79bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb54e14df24431ba279fc3490f1448c', 'request_id': 'req-f4b7852b-2a81-4fe0-bb9f-db547db79bcd'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:33.298809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f4b7852b-2a81-4fe0-bb9f-db547db79bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb54e14df24431ba279fc3490f1448c', 'request_id': 'req-f4b7852b-2a81-4fe0-bb9f-db547db79bcd'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:33.310682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f4b7852b-2a81-4fe0-bb9f-db547db79bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb54e14df24431ba279fc3490f1448c', 'request_id': 'req-f4b7852b-2a81-4fe0-bb9f-db547db79bcd'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:33.326621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f4b7852b-2a81-4fe0-bb9f-db547db79bcd admin admin] The token cache is being invalidate because project deb54e14df24431ba279fc3490f1448c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:33.326985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f4b7852b-2a81-4fe0-bb9f-db547db79bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:33.327907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f4b7852b-2a81-4fe0-bb9f-db547db79bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:33.333520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 956/1896] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:33 2022] DELETE /identity/v3/projects/deb54e14df24431ba279fc3490f1448c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:33.335519 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2201b7-0670-45f4-8727-390cc7df76f5 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:33.336174 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2201b7-0670-45f4-8727-390cc7df76f5 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:33.336532 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2201b7-0670-45f4-8727-390cc7df76f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:33.361143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-1e2201b7-0670-45f4-8727-390cc7df76f5 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:33.362591 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1e2201b7-0670-45f4-8727-390cc7df76f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:33.495056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf7316-0a5b-496e-a206-5bc9a16c4a07 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:33.495477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf7316-0a5b-496e-a206-5bc9a16c4a07 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:33.495865 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf7316-0a5b-496e-a206-5bc9a16c4a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:33.499539 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 941/1897] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:33.516879 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-9caf7316-0a5b-496e-a206-5bc9a16c4a07 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:33.519866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-9caf7316-0a5b-496e-a206-5bc9a16c4a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:33.526980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 957/1898] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:33.531184 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2201b7-0670-45f4-8727-390cc7df76f5 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:33.541692 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2201b7-0670-45f4-8727-390cc7df76f5 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:33.546585 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4741eb-d02d-49b8-82d2-dee294b9cc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:33.547786 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4741eb-d02d-49b8-82d2-dee294b9cc88 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:33.547786 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4741eb-d02d-49b8-82d2-dee294b9cc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:33.547786 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4741eb-d02d-49b8-82d2-dee294b9cc88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:33.548515 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4741eb-d02d-49b8-82d2-dee294b9cc88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:32:33.548826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4741eb-d02d-49b8-82d2-dee294b9cc88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:33.550498 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4741eb-d02d-49b8-82d2-dee294b9cc88 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:33.563247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 942/1899] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:32:33.567608 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf7316-0a5b-496e-a206-5bc9a16c4a07 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:33.579170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf7316-0a5b-496e-a206-5bc9a16c4a07 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:33.585036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e3c03-8a04-48e9-b436-32ec0cb8f420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:33.585954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e3c03-8a04-48e9-b436-32ec0cb8f420 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:33.586380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e3c03-8a04-48e9-b436-32ec0cb8f420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:33.586834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e3c03-8a04-48e9-b436-32ec0cb8f420 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:33.587675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e3c03-8a04-48e9-b436-32ec0cb8f420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:33.589709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e3c03-8a04-48e9-b436-32ec0cb8f420 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:33.626692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 958/1900] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:33 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:33.630239 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4741eb-d02d-49b8-82d2-dee294b9cc88 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:33.643087 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4741eb-d02d-49b8-82d2-dee294b9cc88 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:33.715858 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f469a-4e8a-4eb7-afcd-1dbe29b99238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:33.716606 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f469a-4e8a-4eb7-afcd-1dbe29b99238 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:33.716885 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f469a-4e8a-4eb7-afcd-1dbe29b99238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:33.717164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f469a-4e8a-4eb7-afcd-1dbe29b99238 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:33.717927 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f469a-4e8a-4eb7-afcd-1dbe29b99238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:33.719991 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f469a-4e8a-4eb7-afcd-1dbe29b99238 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:33.742639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 943/1901] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:33 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:33.746597 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e3c03-8a04-48e9-b436-32ec0cb8f420 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:33.757555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e3c03-8a04-48e9-b436-32ec0cb8f420 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:33.762801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823b707-ca85-4170-a3e8-19e46f451b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:33.763622 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823b707-ca85-4170-a3e8-19e46f451b4d admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:33.763830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823b707-ca85-4170-a3e8-19e46f451b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:33.764122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823b707-ca85-4170-a3e8-19e46f451b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:33.765972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823b707-ca85-4170-a3e8-19e46f451b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:33.766708 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823b707-ca85-4170-a3e8-19e46f451b4d admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:33.777936 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 959/1902] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:33.781823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f469a-4e8a-4eb7-afcd-1dbe29b99238 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:33.793267 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f469a-4e8a-4eb7-afcd-1dbe29b99238 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:33.797948 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d282c3-8204-43d7-bcc6-7570f70f9cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:33.798591 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d282c3-8204-43d7-bcc6-7570f70f9cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:33.798925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d282c3-8204-43d7-bcc6-7570f70f9cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:33.799205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d282c3-8204-43d7-bcc6-7570f70f9cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:33.799932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d282c3-8204-43d7-bcc6-7570f70f9cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:33.802824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d282c3-8204-43d7-bcc6-7570f70f9cc0 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:33.816530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 944/1903] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:33.818214 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823b707-ca85-4170-a3e8-19e46f451b4d admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:33.828425 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823b707-ca85-4170-a3e8-19e46f451b4d admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:33.833188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314d17c-ca8d-435a-b6a6-892de869c175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:33.834269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314d17c-ca8d-435a-b6a6-892de869c175 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:33.834545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314d17c-ca8d-435a-b6a6-892de869c175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:33.834816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314d17c-ca8d-435a-b6a6-892de869c175 admin admin] PATH_INFO: `/v3/projects/36639297c4424f318503b73100e0ed96/users/ec15857895f24a5d9321c51cea3c5ae3/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:33.850286 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314d17c-ca8d-435a-b6a6-892de869c175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36639297c4424f318503b73100e0ed96, user_id=ec15857895f24a5d9321c51cea3c5ae3, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:33.852972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314d17c-ca8d-435a-b6a6-892de869c175 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:33.866432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 960/1904] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:33 2022] PUT /identity/v3/projects/36639297c4424f318503b73100e0ed96/users/ec15857895f24a5d9321c51cea3c5ae3/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:33.877358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008595ff-a5cc-42a6-bbf9-38fec17caa70 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:33.877729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008595ff-a5cc-42a6-bbf9-38fec17caa70 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:33.878009 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008595ff-a5cc-42a6-bbf9-38fec17caa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:33.905991 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-008595ff-a5cc-42a6-bbf9-38fec17caa70 None None] MFA Rules not processed for user `ec15857895f24a5d9321c51cea3c5ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:33.907655 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-008595ff-a5cc-42a6-bbf9-38fec17caa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:33.975256 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 945/1905] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:33.979581 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314d17c-ca8d-435a-b6a6-892de869c175 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:34.049583 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314d17c-ca8d-435a-b6a6-892de869c175 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:34.054322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aaef0-fb79-46ec-a443-36d534c80467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:34.055104 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aaef0-fb79-46ec-a443-36d534c80467 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:34.055577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aaef0-fb79-46ec-a443-36d534c80467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:34.055703 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aaef0-fb79-46ec-a443-36d534c80467 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:34.056514 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aaef0-fb79-46ec-a443-36d534c80467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:34.058583 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aaef0-fb79-46ec-a443-36d534c80467 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:34.095219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 961/1906] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:33 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:34.100243 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008595ff-a5cc-42a6-bbf9-38fec17caa70 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:34.114923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008595ff-a5cc-42a6-bbf9-38fec17caa70 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:34.182029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b1748-909e-4417-b0fe-7a46e57c8c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:34.182718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b1748-909e-4417-b0fe-7a46e57c8c24 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:34.183004 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b1748-909e-4417-b0fe-7a46e57c8c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:34.183317 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b1748-909e-4417-b0fe-7a46e57c8c24 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:34.184009 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b1748-909e-4417-b0fe-7a46e57c8c24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:34.185945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b1748-909e-4417-b0fe-7a46e57c8c24 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:34.209241 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 946/1907] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:34 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:32:34.213305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aaef0-fb79-46ec-a443-36d534c80467 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:34.224174 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aaef0-fb79-46ec-a443-36d534c80467 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:34.228877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f96e4-06d6-43aa-b292-8f833a29f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:34.229543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f96e4-06d6-43aa-b292-8f833a29f446 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:34.229826 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f96e4-06d6-43aa-b292-8f833a29f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:34.230102 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f96e4-06d6-43aa-b292-8f833a29f446 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:34.230870 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f96e4-06d6-43aa-b292-8f833a29f446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:34.232465 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f96e4-06d6-43aa-b292-8f833a29f446 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:34.243480 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 962/1908] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:34.247741 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b1748-909e-4417-b0fe-7a46e57c8c24 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:34.258238 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b1748-909e-4417-b0fe-7a46e57c8c24 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:34.263192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fde379-2ac5-479c-9444-21430f509ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:34.264090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fde379-2ac5-479c-9444-21430f509ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:34.264373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fde379-2ac5-479c-9444-21430f509ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:34.264654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fde379-2ac5-479c-9444-21430f509ff1 admin admin] PATH_INFO: `/v3/projects/fc50babd69374e5f9dc1bed425c31cfc/users/95009ad63eb94aabbf954e8a5a9952e0/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:34.283196 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fde379-2ac5-479c-9444-21430f509ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc50babd69374e5f9dc1bed425c31cfc, user_id=95009ad63eb94aabbf954e8a5a9952e0, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:34.287238 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fde379-2ac5-479c-9444-21430f509ff1 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:34.307170 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 947/1909] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:34 2022] PUT /identity/v3/projects/fc50babd69374e5f9dc1bed425c31cfc/users/95009ad63eb94aabbf954e8a5a9952e0/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:34.308300 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f96e4-06d6-43aa-b292-8f833a29f446 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:34.319490 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f96e4-06d6-43aa-b292-8f833a29f446 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:34.383128 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcadef-b3c7-4e6a-8f7c-3f1c5355fa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:34.383809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcadef-b3c7-4e6a-8f7c-3f1c5355fa09 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:34.384097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcadef-b3c7-4e6a-8f7c-3f1c5355fa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:34.386561 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcadef-b3c7-4e6a-8f7c-3f1c5355fa09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:34.387328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcadef-b3c7-4e6a-8f7c-3f1c5355fa09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:34.389132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcadef-b3c7-4e6a-8f7c-3f1c5355fa09 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:34.401058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 963/1910] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:32:34.406096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fde379-2ac5-479c-9444-21430f509ff1 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:34.419919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fde379-2ac5-479c-9444-21430f509ff1 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:34.426788 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bbd9d-0918-414b-b0f7-e7d39cf3415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:34.427705 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bbd9d-0918-414b-b0f7-e7d39cf3415a admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:34.427994 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bbd9d-0918-414b-b0f7-e7d39cf3415a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:34.428282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bbd9d-0918-414b-b0f7-e7d39cf3415a admin admin] PATH_INFO: `/v3/projects/fc50babd69374e5f9dc1bed425c31cfc/users/95009ad63eb94aabbf954e8a5a9952e0/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:34.436905 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bbd9d-0918-414b-b0f7-e7d39cf3415a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc50babd69374e5f9dc1bed425c31cfc, user_id=95009ad63eb94aabbf954e8a5a9952e0, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:34.439822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bbd9d-0918-414b-b0f7-e7d39cf3415a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:34.456403 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 948/1911] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:34 2022] PUT /identity/v3/projects/fc50babd69374e5f9dc1bed425c31cfc/users/95009ad63eb94aabbf954e8a5a9952e0/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:34.467942 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24ce34-0f78-425d-aeb8-27d455dd6dcd None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:34.468232 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24ce34-0f78-425d-aeb8-27d455dd6dcd None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:34.468515 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24ce34-0f78-425d-aeb8-27d455dd6dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:34.499480 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-fc24ce34-0f78-425d-aeb8-27d455dd6dcd None None] MFA Rules not processed for user `95009ad63eb94aabbf954e8a5a9952e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:34.500811 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-fc24ce34-0f78-425d-aeb8-27d455dd6dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:34.580595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 964/1912] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:34.592815 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bbd9d-0918-414b-b0f7-e7d39cf3415a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:34.594590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6a4bbd9d-0918-414b-b0f7-e7d39cf3415a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:34.665929 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bbd9d-0918-414b-b0f7-e7d39cf3415a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:34.669631 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf18786-5741-4d68-82c4-652bf5aba111 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:34.670394 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf18786-5741-4d68-82c4-652bf5aba111 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:34.670746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf18786-5741-4d68-82c4-652bf5aba111 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:34.671210 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf18786-5741-4d68-82c4-652bf5aba111 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:34.680548 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf18786-5741-4d68-82c4-652bf5aba111 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:34.682147 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf18786-5741-4d68-82c4-652bf5aba111 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:34.692925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 949/1913] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:34.772984 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24ce34-0f78-425d-aeb8-27d455dd6dcd None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:34.774459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-fc24ce34-0f78-425d-aeb8-27d455dd6dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:34.786563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24ce34-0f78-425d-aeb8-27d455dd6dcd None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:34.790568 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9321c0-2e3a-4942-a71b-6e15e5dc2991 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:34.791331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9321c0-2e3a-4942-a71b-6e15e5dc2991 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:34.791487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9321c0-2e3a-4942-a71b-6e15e5dc2991 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:34.791763 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9321c0-2e3a-4942-a71b-6e15e5dc2991 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:34.849714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9321c0-2e3a-4942-a71b-6e15e5dc2991 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:34.851167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9321c0-2e3a-4942-a71b-6e15e5dc2991 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:34.860321 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 965/1914] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:38.591720 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf18786-5741-4d68-82c4-652bf5aba111 service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:38.656667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf18786-5741-4d68-82c4-652bf5aba111 service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:38.662527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79ca1f-40dd-4ff3-88de-80611c2df475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:38.663454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79ca1f-40dd-4ff3-88de-80611c2df475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:38.663754 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79ca1f-40dd-4ff3-88de-80611c2df475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:38.664056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79ca1f-40dd-4ff3-88de-80611c2df475 admin admin] PATH_INFO: `/v3/users/ec15857895f24a5d9321c51cea3c5ae3` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:38.665343 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79ca1f-40dd-4ff3-88de-80611c2df475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec15857895f24a5d9321c51cea3c5ae3)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:38.667409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79ca1f-40dd-4ff3-88de-80611c2df475 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:38.724027 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-2e79ca1f-40dd-4ff3-88de-80611c2df475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec15857895f24a5d9321c51cea3c5ae3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:38.733093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-2e79ca1f-40dd-4ff3-88de-80611c2df475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec15857895f24a5d9321c51cea3c5ae3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:38.734843 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-2e79ca1f-40dd-4ff3-88de-80611c2df475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec15857895f24a5d9321c51cea3c5ae3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:38.750060 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-2e79ca1f-40dd-4ff3-88de-80611c2df475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec15857895f24a5d9321c51cea3c5ae3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:38.759533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-2e79ca1f-40dd-4ff3-88de-80611c2df475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec15857895f24a5d9321c51cea3c5ae3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:38.769813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 950/1915] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:38 2022] DELETE /identity/v3/users/ec15857895f24a5d9321c51cea3c5ae3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:38.771514 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b85109-3d2a-4aa6-a606-76824f124053 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:38.771964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b85109-3d2a-4aa6-a606-76824f124053 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:38.772115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b85109-3d2a-4aa6-a606-76824f124053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:38.792447 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-b6b85109-3d2a-4aa6-a606-76824f124053 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:38.793652 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b6b85109-3d2a-4aa6-a606-76824f124053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:38.863736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 966/1916] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:38.873294 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79ca1f-40dd-4ff3-88de-80611c2df475 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:38.874723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-2e79ca1f-40dd-4ff3-88de-80611c2df475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:38.930441 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79ca1f-40dd-4ff3-88de-80611c2df475 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:38.934067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a9709-e290-44ec-b869-7535fb72b4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:38.934740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a9709-e290-44ec-b869-7535fb72b4cb service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:38.935023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a9709-e290-44ec-b869-7535fb72b4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:38.935301 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a9709-e290-44ec-b869-7535fb72b4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:38.946346 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a9709-e290-44ec-b869-7535fb72b4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:38.947702 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a9709-e290-44ec-b869-7535fb72b4cb service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:38.959097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 951/1917] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:39.315554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b85109-3d2a-4aa6-a606-76824f124053 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:39.317284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b6b85109-3d2a-4aa6-a606-76824f124053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:39.332076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b85109-3d2a-4aa6-a606-76824f124053 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:39.338138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:39.339041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:39.339324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:39.339943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c admin admin] PATH_INFO: `/v3/projects/36639297c4424f318503b73100e0ed96` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:39.340788 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=36639297c4424f318503b73100e0ed96)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:39.342737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:39.389797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36639297c4424f318503b73100e0ed96', 'request_id': 'req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:39.396818 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36639297c4424f318503b73100e0ed96', 'request_id': 'req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:39.403932 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36639297c4424f318503b73100e0ed96', 'request_id': 'req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:39.414890 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c admin admin] The token cache is being invalidate because project 36639297c4424f318503b73100e0ed96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:39.415175 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:39.415787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:39.417340 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 967/1918] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:39 2022] DELETE /identity/v3/projects/36639297c4424f318503b73100e0ed96 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:39.421438 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a9709-e290-44ec-b869-7535fb72b4cb service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:39.431102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a9709-e290-44ec-b869-7535fb72b4cb service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:39.486200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c77196-379a-4468-bef4-7a78ba876b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:39.487067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c77196-379a-4468-bef4-7a78ba876b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:39.487351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c77196-379a-4468-bef4-7a78ba876b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:39.487629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c77196-379a-4468-bef4-7a78ba876b9f admin admin] PATH_INFO: `/v3/users/95009ad63eb94aabbf954e8a5a9952e0` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:39.488840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c77196-379a-4468-bef4-7a78ba876b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=95009ad63eb94aabbf954e8a5a9952e0)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:39.490818 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c77196-379a-4468-bef4-7a78ba876b9f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:39.534456 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a6c77196-379a-4468-bef4-7a78ba876b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95009ad63eb94aabbf954e8a5a9952e0'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:39.541650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a6c77196-379a-4468-bef4-7a78ba876b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95009ad63eb94aabbf954e8a5a9952e0'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:39.542354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a6c77196-379a-4468-bef4-7a78ba876b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95009ad63eb94aabbf954e8a5a9952e0'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:39.554680 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a6c77196-379a-4468-bef4-7a78ba876b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95009ad63eb94aabbf954e8a5a9952e0'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:39.561576 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a6c77196-379a-4468-bef4-7a78ba876b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95009ad63eb94aabbf954e8a5a9952e0'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:39.568697 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 952/1919] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:39 2022] DELETE /identity/v3/users/95009ad63eb94aabbf954e8a5a9952e0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:39.832034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:39.833098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:39.849118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2735dd5-a7d2-4b59-80d7-515437bd0d9c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:39.908713 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79517768-281c-4695-af74-03a3bac4df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:39.910560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79517768-281c-4695-af74-03a3bac4df0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:39.910560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79517768-281c-4695-af74-03a3bac4df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:39.910819 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79517768-281c-4695-af74-03a3bac4df0d admin admin] PATH_INFO: `/v3/projects/fc50babd69374e5f9dc1bed425c31cfc` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:39.912193 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79517768-281c-4695-af74-03a3bac4df0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc50babd69374e5f9dc1bed425c31cfc)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:39.914145 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79517768-281c-4695-af74-03a3bac4df0d admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:39.963219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-79517768-281c-4695-af74-03a3bac4df0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc50babd69374e5f9dc1bed425c31cfc', 'request_id': 'req-79517768-281c-4695-af74-03a3bac4df0d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:39.969290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-79517768-281c-4695-af74-03a3bac4df0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc50babd69374e5f9dc1bed425c31cfc', 'request_id': 'req-79517768-281c-4695-af74-03a3bac4df0d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:39.976285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-79517768-281c-4695-af74-03a3bac4df0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc50babd69374e5f9dc1bed425c31cfc', 'request_id': 'req-79517768-281c-4695-af74-03a3bac4df0d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:39.986581 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-79517768-281c-4695-af74-03a3bac4df0d admin admin] The token cache is being invalidate because project fc50babd69374e5f9dc1bed425c31cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:39.986868 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-79517768-281c-4695-af74-03a3bac4df0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:39.987523 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-79517768-281c-4695-af74-03a3bac4df0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:39.989485 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 968/1920] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:39 2022] DELETE /identity/v3/projects/fc50babd69374e5f9dc1bed425c31cfc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:39.994483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2587e4-6ad2-44f1-84f5-fb1ee06fdf05 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:39.994964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2587e4-6ad2-44f1-84f5-fb1ee06fdf05 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:39.995090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2587e4-6ad2-44f1-84f5-fb1ee06fdf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:40.015084 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-2c2587e4-6ad2-44f1-84f5-fb1ee06fdf05 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:40.016280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-2c2587e4-6ad2-44f1-84f5-fb1ee06fdf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:40.075029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 953/1921] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:40.083259 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f60b5f-fb62-4ffb-86c3-637cce43b7a8 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:40.083553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f60b5f-fb62-4ffb-86c3-637cce43b7a8 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:40.083840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f60b5f-fb62-4ffb-86c3-637cce43b7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:40.102328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-e1f60b5f-fb62-4ffb-86c3-637cce43b7a8 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:40.103666 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e1f60b5f-fb62-4ffb-86c3-637cce43b7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:40.112037 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 969/1922] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:40.116746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2587e4-6ad2-44f1-84f5-fb1ee06fdf05 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:40.126730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2587e4-6ad2-44f1-84f5-fb1ee06fdf05 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:40.132100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a1298-8a54-496c-b045-f94ecde4e160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:40.132809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a1298-8a54-496c-b045-f94ecde4e160 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:40.133118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a1298-8a54-496c-b045-f94ecde4e160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:40.133425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a1298-8a54-496c-b045-f94ecde4e160 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:40.134243 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a1298-8a54-496c-b045-f94ecde4e160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:32:40.134590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a1298-8a54-496c-b045-f94ecde4e160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:40.136242 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a1298-8a54-496c-b045-f94ecde4e160 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:40.148379 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 954/1923] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:32:40.152752 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f60b5f-fb62-4ffb-86c3-637cce43b7a8 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:40.162419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f60b5f-fb62-4ffb-86c3-637cce43b7a8 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:40.167303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9352ade-2c19-440e-9489-e081e4c1e59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:40.167955 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9352ade-2c19-440e-9489-e081e4c1e59d admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:40.168231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9352ade-2c19-440e-9489-e081e4c1e59d admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:40.168613 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9352ade-2c19-440e-9489-e081e4c1e59d admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:40.169345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9352ade-2c19-440e-9489-e081e4c1e59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:40.171277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9352ade-2c19-440e-9489-e081e4c1e59d admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:40.199059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 970/1924] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:40 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:40.203439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a1298-8a54-496c-b045-f94ecde4e160 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:40.213350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a1298-8a54-496c-b045-f94ecde4e160 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:40.271366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7db49-e074-4351-bcb6-f20d48bcacec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:40.272047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7db49-e074-4351-bcb6-f20d48bcacec admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:40.272332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7db49-e074-4351-bcb6-f20d48bcacec admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:40.272611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7db49-e074-4351-bcb6-f20d48bcacec admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:40.273321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7db49-e074-4351-bcb6-f20d48bcacec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:40.275298 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7db49-e074-4351-bcb6-f20d48bcacec admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:40.295839 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 955/1925] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:40 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:32:40.301854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9352ade-2c19-440e-9489-e081e4c1e59d admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:40.312046 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9352ade-2c19-440e-9489-e081e4c1e59d admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:40.317224 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e060b8-dd29-4294-91d0-63efa29bea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:40.317877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e060b8-dd29-4294-91d0-63efa29bea1a admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:40.318154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e060b8-dd29-4294-91d0-63efa29bea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:40.318505 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e060b8-dd29-4294-91d0-63efa29bea1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:40.319222 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e060b8-dd29-4294-91d0-63efa29bea1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:40.320810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e060b8-dd29-4294-91d0-63efa29bea1a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:40.332069 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 971/1926] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:40.336181 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7db49-e074-4351-bcb6-f20d48bcacec admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:40.345847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7db49-e074-4351-bcb6-f20d48bcacec admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:40.351151 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ef77c-1484-4906-b8e7-a64285b57a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:40.352276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ef77c-1484-4906-b8e7-a64285b57a55 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:40.352276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ef77c-1484-4906-b8e7-a64285b57a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:40.352497 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ef77c-1484-4906-b8e7-a64285b57a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:40.353054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ef77c-1484-4906-b8e7-a64285b57a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:40.354689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ef77c-1484-4906-b8e7-a64285b57a55 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:40.369746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 956/1927] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:40.371186 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e060b8-dd29-4294-91d0-63efa29bea1a admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:40.382366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e060b8-dd29-4294-91d0-63efa29bea1a admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:40.387647 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79223da-3129-4e77-a080-c5ef622982ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:40.388632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79223da-3129-4e77-a080-c5ef622982ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:40.389016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79223da-3129-4e77-a080-c5ef622982ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:40.389524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79223da-3129-4e77-a080-c5ef622982ee admin admin] PATH_INFO: `/v3/projects/d19750b9b97946c0a7b32cda7839ca53/users/eebe29b742ee4dd19631cd0f03902275/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:40.405107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79223da-3129-4e77-a080-c5ef622982ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19750b9b97946c0a7b32cda7839ca53, user_id=eebe29b742ee4dd19631cd0f03902275, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:40.407916 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79223da-3129-4e77-a080-c5ef622982ee admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:40.423601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 972/1928] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:40 2022] PUT /identity/v3/projects/d19750b9b97946c0a7b32cda7839ca53/users/eebe29b742ee4dd19631cd0f03902275/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:40.435112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feefaa-8920-4968-a961-591c3f9cd1d0 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:40.435402 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feefaa-8920-4968-a961-591c3f9cd1d0 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:40.435890 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feefaa-8920-4968-a961-591c3f9cd1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:40.464087 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-95feefaa-8920-4968-a961-591c3f9cd1d0 None None] MFA Rules not processed for user `eebe29b742ee4dd19631cd0f03902275`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:40.465303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-95feefaa-8920-4968-a961-591c3f9cd1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:40.529602 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 957/1929] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:40.534084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79223da-3129-4e77-a080-c5ef622982ee admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:40.594130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79223da-3129-4e77-a080-c5ef622982ee admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:40.598946 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef356b-e0b7-469e-b2fd-c078b3d5f45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:40.599596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef356b-e0b7-469e-b2fd-c078b3d5f45c admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:40.599878 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef356b-e0b7-469e-b2fd-c078b3d5f45c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:40.600151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef356b-e0b7-469e-b2fd-c078b3d5f45c admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:40.600844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef356b-e0b7-469e-b2fd-c078b3d5f45c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:40.602797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef356b-e0b7-469e-b2fd-c078b3d5f45c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:40.628152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 973/1930] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:40 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:40.633038 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95feefaa-8920-4968-a961-591c3f9cd1d0 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:40.643773 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95feefaa-8920-4968-a961-591c3f9cd1d0 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:40.700029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6104f05-78ef-4f44-ba52-120d810f9f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:40.700736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6104f05-78ef-4f44-ba52-120d810f9f70 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:40.701023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6104f05-78ef-4f44-ba52-120d810f9f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:40.701556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6104f05-78ef-4f44-ba52-120d810f9f70 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:40.702291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6104f05-78ef-4f44-ba52-120d810f9f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:40.704219 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6104f05-78ef-4f44-ba52-120d810f9f70 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:40.723689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 958/1931] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:40 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:40.727761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef356b-e0b7-469e-b2fd-c078b3d5f45c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:40.737789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef356b-e0b7-469e-b2fd-c078b3d5f45c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:40.742514 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fdb5c-3015-4824-bcb6-ad1b61cf62ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:40.743162 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fdb5c-3015-4824-bcb6-ad1b61cf62ac admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:40.743436 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fdb5c-3015-4824-bcb6-ad1b61cf62ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:40.743706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fdb5c-3015-4824-bcb6-ad1b61cf62ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:40.744417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fdb5c-3015-4824-bcb6-ad1b61cf62ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:40.746004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fdb5c-3015-4824-bcb6-ad1b61cf62ac admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:40.756603 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 974/1932] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:40.760492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6104f05-78ef-4f44-ba52-120d810f9f70 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:40.771447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6104f05-78ef-4f44-ba52-120d810f9f70 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:40.776036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0918ab4-38e9-4ddf-adda-9173d659a471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:40.776688 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0918ab4-38e9-4ddf-adda-9173d659a471 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:40.776973 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0918ab4-38e9-4ddf-adda-9173d659a471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:40.777257 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0918ab4-38e9-4ddf-adda-9173d659a471 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:40.777996 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0918ab4-38e9-4ddf-adda-9173d659a471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:40.779640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0918ab4-38e9-4ddf-adda-9173d659a471 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:40.789528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 959/1933] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:40.793560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fdb5c-3015-4824-bcb6-ad1b61cf62ac admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:40.803906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fdb5c-3015-4824-bcb6-ad1b61cf62ac admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:40.808442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0200e5-ed4f-45c0-a534-1cf6129e9582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:40.809306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0200e5-ed4f-45c0-a534-1cf6129e9582 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:40.809586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0200e5-ed4f-45c0-a534-1cf6129e9582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:40.809856 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0200e5-ed4f-45c0-a534-1cf6129e9582 admin admin] PATH_INFO: `/v3/projects/4a1c8a2540c141ebb7d3d7584a42f07d/users/51f44b70ecb04fec96ddb07f2c463ffe/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:40.824528 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0200e5-ed4f-45c0-a534-1cf6129e9582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1c8a2540c141ebb7d3d7584a42f07d, user_id=51f44b70ecb04fec96ddb07f2c463ffe, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:40.827501 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0200e5-ed4f-45c0-a534-1cf6129e9582 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:40.839583 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 975/1934] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:40 2022] PUT /identity/v3/projects/4a1c8a2540c141ebb7d3d7584a42f07d/users/51f44b70ecb04fec96ddb07f2c463ffe/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:40.849868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a849c-fc8c-47fd-a265-e61caf678070 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:40.850133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a849c-fc8c-47fd-a265-e61caf678070 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:40.850453 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a849c-fc8c-47fd-a265-e61caf678070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:40.877637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-8a9a849c-fc8c-47fd-a265-e61caf678070 None None] MFA Rules not processed for user `51f44b70ecb04fec96ddb07f2c463ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:40.879494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-8a9a849c-fc8c-47fd-a265-e61caf678070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:40.943163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 960/1935] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:40.947588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0200e5-ed4f-45c0-a534-1cf6129e9582 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:41.006436 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0200e5-ed4f-45c0-a534-1cf6129e9582 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:41.011064 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708f37e-1242-4498-9d6e-f12371469c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:41.011718 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708f37e-1242-4498-9d6e-f12371469c2e admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:41.012000 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708f37e-1242-4498-9d6e-f12371469c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:41.012275 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708f37e-1242-4498-9d6e-f12371469c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:41.012964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708f37e-1242-4498-9d6e-f12371469c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:41.014901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708f37e-1242-4498-9d6e-f12371469c2e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:41.044731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 976/1936] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:40 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:41.045935 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a849c-fc8c-47fd-a265-e61caf678070 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:41.056971 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a849c-fc8c-47fd-a265-e61caf678070 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:41.115536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e2938-6869-4bf1-8861-d1d18d8dbe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:41.116249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e2938-6869-4bf1-8861-d1d18d8dbe60 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:41.116523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e2938-6869-4bf1-8861-d1d18d8dbe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:41.116956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e2938-6869-4bf1-8861-d1d18d8dbe60 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:41.118688 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e2938-6869-4bf1-8861-d1d18d8dbe60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:41.119621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e2938-6869-4bf1-8861-d1d18d8dbe60 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:41.148292 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 961/1937] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:41 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:41.149838 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708f37e-1242-4498-9d6e-f12371469c2e admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:41.161025 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708f37e-1242-4498-9d6e-f12371469c2e admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:41.165866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7088d8f-1e64-495e-9bde-210a60eb73e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:41.166573 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7088d8f-1e64-495e-9bde-210a60eb73e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:41.166857 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7088d8f-1e64-495e-9bde-210a60eb73e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:41.167133 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7088d8f-1e64-495e-9bde-210a60eb73e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:41.167857 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7088d8f-1e64-495e-9bde-210a60eb73e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:41.169459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7088d8f-1e64-495e-9bde-210a60eb73e1 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:41.181000 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 977/1938] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:41.185030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e2938-6869-4bf1-8861-d1d18d8dbe60 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:41.195728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e2938-6869-4bf1-8861-d1d18d8dbe60 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:41.200464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780ce5e-dbab-4cc5-80de-e3c0354aaa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:41.201666 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780ce5e-dbab-4cc5-80de-e3c0354aaa4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:41.201951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780ce5e-dbab-4cc5-80de-e3c0354aaa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:41.202293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780ce5e-dbab-4cc5-80de-e3c0354aaa4c admin admin] PATH_INFO: `/v3/projects/1d5febcedd34493abc9d3dfa51c749bc/users/b74e2c60101a45a9bcd93e5c7d722cef/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:41.218068 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780ce5e-dbab-4cc5-80de-e3c0354aaa4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5febcedd34493abc9d3dfa51c749bc, user_id=b74e2c60101a45a9bcd93e5c7d722cef, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:41.220883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780ce5e-dbab-4cc5-80de-e3c0354aaa4c admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:41.233629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 962/1939] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:41 2022] PUT /identity/v3/projects/1d5febcedd34493abc9d3dfa51c749bc/users/b74e2c60101a45a9bcd93e5c7d722cef/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:41.237542 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7088d8f-1e64-495e-9bde-210a60eb73e1 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:41.247642 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7088d8f-1e64-495e-9bde-210a60eb73e1 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:41.302467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcb9c0-1cc0-4544-9fd0-64e54d1c619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:41.303129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcb9c0-1cc0-4544-9fd0-64e54d1c619c admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:41.303409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcb9c0-1cc0-4544-9fd0-64e54d1c619c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:41.303681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcb9c0-1cc0-4544-9fd0-64e54d1c619c admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:41.304401 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcb9c0-1cc0-4544-9fd0-64e54d1c619c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:41.305999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcb9c0-1cc0-4544-9fd0-64e54d1c619c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:41.319500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 978/1940] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:41.320665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780ce5e-dbab-4cc5-80de-e3c0354aaa4c admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:41.332465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780ce5e-dbab-4cc5-80de-e3c0354aaa4c admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:41.337217 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54dd701-cc7a-47bf-9179-4d1bd0043283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:41.338313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dd701-cc7a-47bf-9179-4d1bd0043283 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:41.338629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dd701-cc7a-47bf-9179-4d1bd0043283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:41.338909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dd701-cc7a-47bf-9179-4d1bd0043283 admin admin] PATH_INFO: `/v3/projects/1d5febcedd34493abc9d3dfa51c749bc/users/b74e2c60101a45a9bcd93e5c7d722cef/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:41.340883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54dd701-cc7a-47bf-9179-4d1bd0043283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5febcedd34493abc9d3dfa51c749bc, user_id=b74e2c60101a45a9bcd93e5c7d722cef, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:41.343590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54dd701-cc7a-47bf-9179-4d1bd0043283 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:41.354494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 963/1941] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:41 2022] PUT /identity/v3/projects/1d5febcedd34493abc9d3dfa51c749bc/users/b74e2c60101a45a9bcd93e5c7d722cef/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:41.365925 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5a6ef-6073-4d27-abc4-4c70a9ea7086 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:41.366140 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5a6ef-6073-4d27-abc4-4c70a9ea7086 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:41.366471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5a6ef-6073-4d27-abc4-4c70a9ea7086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:41.396847 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-40d5a6ef-6073-4d27-abc4-4c70a9ea7086 None None] MFA Rules not processed for user `b74e2c60101a45a9bcd93e5c7d722cef`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:41.398093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-40d5a6ef-6073-4d27-abc4-4c70a9ea7086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:41.478671 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 979/1942] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:41.489786 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54dd701-cc7a-47bf-9179-4d1bd0043283 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:41.491595 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c54dd701-cc7a-47bf-9179-4d1bd0043283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:41.549178 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54dd701-cc7a-47bf-9179-4d1bd0043283 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:41.553891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad24c1-5871-4c14-9d34-f5ae36e5b5e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:41.554576 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad24c1-5871-4c14-9d34-f5ae36e5b5e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:41.554893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad24c1-5871-4c14-9d34-f5ae36e5b5e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:41.555172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad24c1-5871-4c14-9d34-f5ae36e5b5e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:41.564720 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad24c1-5871-4c14-9d34-f5ae36e5b5e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:41.567144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad24c1-5871-4c14-9d34-f5ae36e5b5e8 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:41.577118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 964/1943] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:41.620882 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5a6ef-6073-4d27-abc4-4c70a9ea7086 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:41.622327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-40d5a6ef-6073-4d27-abc4-4c70a9ea7086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:41.636286 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5a6ef-6073-4d27-abc4-4c70a9ea7086 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:41.640015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28ff8c-4abd-40bd-973e-c4f4920789bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:41.640659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28ff8c-4abd-40bd-973e-c4f4920789bb service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:41.640940 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28ff8c-4abd-40bd-973e-c4f4920789bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:41.641215 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28ff8c-4abd-40bd-973e-c4f4920789bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:41.697554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28ff8c-4abd-40bd-973e-c4f4920789bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:41.699028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28ff8c-4abd-40bd-973e-c4f4920789bb service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:41.708512 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 980/1944] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:32:49.283689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad24c1-5871-4c14-9d34-f5ae36e5b5e8 service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:49.285764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b1ad24c1-5871-4c14-9d34-f5ae36e5b5e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:49.357541 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad24c1-5871-4c14-9d34-f5ae36e5b5e8 service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:49.363354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75c53a-b297-470f-9aa7-29fde7614c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:49.365525 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75c53a-b297-470f-9aa7-29fde7614c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:49.365525 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75c53a-b297-470f-9aa7-29fde7614c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:49.365525 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75c53a-b297-470f-9aa7-29fde7614c30 admin admin] PATH_INFO: `/v3/users/4608183d849a434eb98261856c4d632d` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:49.366602 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75c53a-b297-470f-9aa7-29fde7614c30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4608183d849a434eb98261856c4d632d)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:49.368572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75c53a-b297-470f-9aa7-29fde7614c30 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:49.421116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0e75c53a-b297-470f-9aa7-29fde7614c30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4608183d849a434eb98261856c4d632d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:49.435363 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0e75c53a-b297-470f-9aa7-29fde7614c30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4608183d849a434eb98261856c4d632d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:49.436099 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0e75c53a-b297-470f-9aa7-29fde7614c30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4608183d849a434eb98261856c4d632d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:49.448791 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0e75c53a-b297-470f-9aa7-29fde7614c30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4608183d849a434eb98261856c4d632d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:49.456824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0e75c53a-b297-470f-9aa7-29fde7614c30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4608183d849a434eb98261856c4d632d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:49.463781 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 965/1945] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:49 2022] DELETE /identity/v3/users/4608183d849a434eb98261856c4d632d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:49.469017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c48a85-5702-43b4-a8c3-eb529afefbf6 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:49.469552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c48a85-5702-43b4-a8c3-eb529afefbf6 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:49.469744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c48a85-5702-43b4-a8c3-eb529afefbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:49.493820 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-d3c48a85-5702-43b4-a8c3-eb529afefbf6 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:49.495051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-d3c48a85-5702-43b4-a8c3-eb529afefbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:49.560489 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 981/1946] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:49.571415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75c53a-b297-470f-9aa7-29fde7614c30 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:49.573111 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0e75c53a-b297-470f-9aa7-29fde7614c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:49.641725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75c53a-b297-470f-9aa7-29fde7614c30 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:49.647965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935708b-1e9b-43b0-8e51-0e5a378737a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:49.648625 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935708b-1e9b-43b0-8e51-0e5a378737a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:49.648931 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935708b-1e9b-43b0-8e51-0e5a378737a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:49.649205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935708b-1e9b-43b0-8e51-0e5a378737a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:49.667872 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935708b-1e9b-43b0-8e51-0e5a378737a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:49.667872 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935708b-1e9b-43b0-8e51-0e5a378737a6 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:49.671993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 966/1947] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:49.852610 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c48a85-5702-43b4-a8c3-eb529afefbf6 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:49.854667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-d3c48a85-5702-43b4-a8c3-eb529afefbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:49.870394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c48a85-5702-43b4-a8c3-eb529afefbf6 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:49.881775 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3bf33-5cf3-47f7-a914-4ff9adf2e05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:49.882687 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3bf33-5cf3-47f7-a914-4ff9adf2e05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:49.882987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3bf33-5cf3-47f7-a914-4ff9adf2e05a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:49.883253 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3bf33-5cf3-47f7-a914-4ff9adf2e05a admin admin] PATH_INFO: `/v3/users/eebe29b742ee4dd19631cd0f03902275` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:49.884798 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3bf33-5cf3-47f7-a914-4ff9adf2e05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eebe29b742ee4dd19631cd0f03902275)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:49.886805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3bf33-5cf3-47f7-a914-4ff9adf2e05a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:49.946875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0db3bf33-5cf3-47f7-a914-4ff9adf2e05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eebe29b742ee4dd19631cd0f03902275'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:49.958049 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0db3bf33-5cf3-47f7-a914-4ff9adf2e05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eebe29b742ee4dd19631cd0f03902275'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:49.959770 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0db3bf33-5cf3-47f7-a914-4ff9adf2e05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eebe29b742ee4dd19631cd0f03902275'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:49.976175 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0db3bf33-5cf3-47f7-a914-4ff9adf2e05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eebe29b742ee4dd19631cd0f03902275'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:49.983990 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-0db3bf33-5cf3-47f7-a914-4ff9adf2e05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eebe29b742ee4dd19631cd0f03902275'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:49.991876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 982/1948] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:49 2022] DELETE /identity/v3/users/eebe29b742ee4dd19631cd0f03902275 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:49.997972 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a85e8-9b8a-43d8-b934-65b1cf38bba3 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:49.998337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a85e8-9b8a-43d8-b934-65b1cf38bba3 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:49.998583 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a85e8-9b8a-43d8-b934-65b1cf38bba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:50.017411 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-304a85e8-9b8a-43d8-b934-65b1cf38bba3 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:50.019119 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-304a85e8-9b8a-43d8-b934-65b1cf38bba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:50.034228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3bf33-5cf3-47f7-a914-4ff9adf2e05a admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:50.036176 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-0db3bf33-5cf3-47f7-a914-4ff9adf2e05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:50.093335 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 967/1949] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:50.103010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a85e8-9b8a-43d8-b934-65b1cf38bba3 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:50.104406 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-304a85e8-9b8a-43d8-b934-65b1cf38bba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:50.106458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3bf33-5cf3-47f7-a914-4ff9adf2e05a admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:50.111076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3eeaa-4783-422d-b644-ac955b8f9637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:50.111935 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3eeaa-4783-422d-b644-ac955b8f9637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:50.112217 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3eeaa-4783-422d-b644-ac955b8f9637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:50.113035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3eeaa-4783-422d-b644-ac955b8f9637 admin admin] PATH_INFO: `/v3/projects/a99db89d5866447e803708cf784c8498` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:50.114238 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3eeaa-4783-422d-b644-ac955b8f9637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a99db89d5866447e803708cf784c8498)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:50.116160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3eeaa-4783-422d-b644-ac955b8f9637 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:50.165320 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a85e8-9b8a-43d8-b934-65b1cf38bba3 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:50.170044 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-41d3eeaa-4783-422d-b644-ac955b8f9637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a99db89d5866447e803708cf784c8498', 'request_id': 'req-41d3eeaa-4783-422d-b644-ac955b8f9637'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:50.177074 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-41d3eeaa-4783-422d-b644-ac955b8f9637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a99db89d5866447e803708cf784c8498', 'request_id': 'req-41d3eeaa-4783-422d-b644-ac955b8f9637'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:50.184140 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-41d3eeaa-4783-422d-b644-ac955b8f9637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a99db89d5866447e803708cf784c8498', 'request_id': 'req-41d3eeaa-4783-422d-b644-ac955b8f9637'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:50.196068 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-41d3eeaa-4783-422d-b644-ac955b8f9637 admin admin] The token cache is being invalidate because project a99db89d5866447e803708cf784c8498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:50.196401 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-41d3eeaa-4783-422d-b644-ac955b8f9637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:50.197030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-41d3eeaa-4783-422d-b644-ac955b8f9637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:50.202167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 983/1950] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:50 2022] DELETE /identity/v3/projects/a99db89d5866447e803708cf784c8498 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:50.203634 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66341c55-7d23-4db0-8478-25f1b2eb7646 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:50.203926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66341c55-7d23-4db0-8478-25f1b2eb7646 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:50.204353 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66341c55-7d23-4db0-8478-25f1b2eb7646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:50.222838 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-66341c55-7d23-4db0-8478-25f1b2eb7646 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:50.223578 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a75234-c425-4e18-970a-75f07b2f58fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:50.224193 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-66341c55-7d23-4db0-8478-25f1b2eb7646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:50.224295 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a75234-c425-4e18-970a-75f07b2f58fd service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:50.224514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a75234-c425-4e18-970a-75f07b2f58fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:50.224792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a75234-c425-4e18-970a-75f07b2f58fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:50.226881 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f5a75234-c425-4e18-970a-75f07b2f58fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:50.282391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 984/1951] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:50.290979 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea3092-1c29-4f74-b2f5-80ada1731576 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:50.291133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a75234-c425-4e18-970a-75f07b2f58fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:50.291542 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea3092-1c29-4f74-b2f5-80ada1731576 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:50.291542 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea3092-1c29-4f74-b2f5-80ada1731576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:50.292371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a75234-c425-4e18-970a-75f07b2f58fd service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:50.303066 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 968/1952] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:32:50.309791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-12ea3092-1c29-4f74-b2f5-80ada1731576 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:50.311024 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-12ea3092-1c29-4f74-b2f5-80ada1731576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:50.319219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 985/1953] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:50.323420 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a75234-c425-4e18-970a-75f07b2f58fd service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:50.333496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a75234-c425-4e18-970a-75f07b2f58fd service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:50.338477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d58034-6f85-4106-b08f-00fcf3fea8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:50.339157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d58034-6f85-4106-b08f-00fcf3fea8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:50.339432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d58034-6f85-4106-b08f-00fcf3fea8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:50.339707 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d58034-6f85-4106-b08f-00fcf3fea8a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:50.340431 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d58034-6f85-4106-b08f-00fcf3fea8a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:32:50.340742 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d58034-6f85-4106-b08f-00fcf3fea8a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:50.342376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d58034-6f85-4106-b08f-00fcf3fea8a4 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:50.355243 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 969/1954] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:32:50.359759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea3092-1c29-4f74-b2f5-80ada1731576 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:50.370356 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea3092-1c29-4f74-b2f5-80ada1731576 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:50.375552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63e802-a9cc-42e1-89a5-e10604e597b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:50.376214 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63e802-a9cc-42e1-89a5-e10604e597b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:50.376538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63e802-a9cc-42e1-89a5-e10604e597b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:50.376813 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63e802-a9cc-42e1-89a5-e10604e597b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:50.377542 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63e802-a9cc-42e1-89a5-e10604e597b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:50.379558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63e802-a9cc-42e1-89a5-e10604e597b0 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:50.405182 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 986/1955] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:50 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:50.409900 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d58034-6f85-4106-b08f-00fcf3fea8a4 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:50.420686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d58034-6f85-4106-b08f-00fcf3fea8a4 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:50.483696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd5842-6594-43f3-965b-0ab60ef70943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:50.484380 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd5842-6594-43f3-965b-0ab60ef70943 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:50.484665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd5842-6594-43f3-965b-0ab60ef70943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:50.484939 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd5842-6594-43f3-965b-0ab60ef70943 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:50.485634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd5842-6594-43f3-965b-0ab60ef70943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:50.487882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd5842-6594-43f3-965b-0ab60ef70943 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:50.513476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 970/1956] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:50 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:50.514890 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63e802-a9cc-42e1-89a5-e10604e597b0 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:50.527413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63e802-a9cc-42e1-89a5-e10604e597b0 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:50.532274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7f901-7b08-4202-b61b-1bb4efe58354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:50.532968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f901-7b08-4202-b61b-1bb4efe58354 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:50.533643 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f901-7b08-4202-b61b-1bb4efe58354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:50.533643 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f901-7b08-4202-b61b-1bb4efe58354 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:50.534433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7f901-7b08-4202-b61b-1bb4efe58354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:50.535953 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7f901-7b08-4202-b61b-1bb4efe58354 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:50.548525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 987/1957] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:50.552679 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd5842-6594-43f3-965b-0ab60ef70943 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:50.563095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd5842-6594-43f3-965b-0ab60ef70943 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:50.568666 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f6fe6-ccbe-43ad-87e3-c5d025fb5725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:50.569390 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f6fe6-ccbe-43ad-87e3-c5d025fb5725 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:50.569681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f6fe6-ccbe-43ad-87e3-c5d025fb5725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:50.569969 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f6fe6-ccbe-43ad-87e3-c5d025fb5725 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:50.570733 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f6fe6-ccbe-43ad-87e3-c5d025fb5725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:50.572354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f6fe6-ccbe-43ad-87e3-c5d025fb5725 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:50.584005 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 971/1958] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:50.589079 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7f901-7b08-4202-b61b-1bb4efe58354 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:50.599011 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f6fe6-ccbe-43ad-87e3-c5d025fb5725 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:50.602090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7f901-7b08-4202-b61b-1bb4efe58354 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:50.603813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-4f7f6fe6-ccbe-43ad-87e3-c5d025fb5725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:50.608795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a2878-6254-4302-8687-152bcafd7d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:50.610021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a2878-6254-4302-8687-152bcafd7d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:50.610021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a2878-6254-4302-8687-152bcafd7d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:50.610461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a2878-6254-4302-8687-152bcafd7d9c admin admin] PATH_INFO: `/v3/projects/1a53518a5cf04b40945a29a21a8b3e71/users/7905b2fc940d498f99d7c4042398cffd/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:50.619133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f6fe6-ccbe-43ad-87e3-c5d025fb5725 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:50.625254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:50.626263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:50.626519 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:50.626807 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce admin admin] PATH_INFO: `/v3/projects/d19750b9b97946c0a7b32cda7839ca53` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:50.628607 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d19750b9b97946c0a7b32cda7839ca53)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:50.631237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:50.632969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a2878-6254-4302-8687-152bcafd7d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a53518a5cf04b40945a29a21a8b3e71, user_id=7905b2fc940d498f99d7c4042398cffd, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:50.636374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a2878-6254-4302-8687-152bcafd7d9c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:50.650029 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 988/1959] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:50 2022] PUT /identity/v3/projects/1a53518a5cf04b40945a29a21a8b3e71/users/7905b2fc940d498f99d7c4042398cffd/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:50.660397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d393844-a062-47f5-8f4e-cfae70d96708 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:50.660760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d393844-a062-47f5-8f4e-cfae70d96708 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:50.661070 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d393844-a062-47f5-8f4e-cfae70d96708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:50.683663 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd19750b9b97946c0a7b32cda7839ca53', 'request_id': 'req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:50.691539 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd19750b9b97946c0a7b32cda7839ca53', 'request_id': 'req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:50.699447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd19750b9b97946c0a7b32cda7839ca53', 'request_id': 'req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:50.699944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-5d393844-a062-47f5-8f4e-cfae70d96708 None None] MFA Rules not processed for user `7905b2fc940d498f99d7c4042398cffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:50.701405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5d393844-a062-47f5-8f4e-cfae70d96708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:50.711994 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce admin admin] The token cache is being invalidate because project d19750b9b97946c0a7b32cda7839ca53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:50.712290 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:50.713063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:50.715516 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 972/1960] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:50 2022] DELETE /identity/v3/projects/d19750b9b97946c0a7b32cda7839ca53 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:50.719259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:50.720622 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:50.776395 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 989/1961] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:50.788071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d393844-a062-47f5-8f4e-cfae70d96708 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:50.790107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5d393844-a062-47f5-8f4e-cfae70d96708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:50.790933 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0103da8-7e1a-4db0-bf73-cb2b6f8765ce admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:50.795834 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be91aae-a1f0-49b9-9e87-6aeb41c8e48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:50.796721 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be91aae-a1f0-49b9-9e87-6aeb41c8e48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:50.797004 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be91aae-a1f0-49b9-9e87-6aeb41c8e48d admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:50.797400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be91aae-a1f0-49b9-9e87-6aeb41c8e48d admin admin] PATH_INFO: `/v3/users/51f44b70ecb04fec96ddb07f2c463ffe` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:50.806347 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be91aae-a1f0-49b9-9e87-6aeb41c8e48d admin admin] RBAC: Authorizing `identity:delete_user(user_id=51f44b70ecb04fec96ddb07f2c463ffe)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:50.806347 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be91aae-a1f0-49b9-9e87-6aeb41c8e48d admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:50.860718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5be91aae-a1f0-49b9-9e87-6aeb41c8e48d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51f44b70ecb04fec96ddb07f2c463ffe'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:50.868492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5be91aae-a1f0-49b9-9e87-6aeb41c8e48d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51f44b70ecb04fec96ddb07f2c463ffe'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:50.869448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5be91aae-a1f0-49b9-9e87-6aeb41c8e48d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51f44b70ecb04fec96ddb07f2c463ffe'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:50.885123 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5be91aae-a1f0-49b9-9e87-6aeb41c8e48d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51f44b70ecb04fec96ddb07f2c463ffe'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:50.891549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d393844-a062-47f5-8f4e-cfae70d96708 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:50.896932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5be91aae-a1f0-49b9-9e87-6aeb41c8e48d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51f44b70ecb04fec96ddb07f2c463ffe'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:50.897530 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8e960-a43d-4585-9c7c-24ed191e8568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:50.898250 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8e960-a43d-4585-9c7c-24ed191e8568 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:50.898542 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8e960-a43d-4585-9c7c-24ed191e8568 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:50.898819 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8e960-a43d-4585-9c7c-24ed191e8568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:50.900711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-d1a8e960-a43d-4585-9c7c-24ed191e8568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:50.907923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 973/1962] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:50 2022] DELETE /identity/v3/users/51f44b70ecb04fec96ddb07f2c463ffe => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:50.917165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8e960-a43d-4585-9c7c-24ed191e8568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:50.918669 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8e960-a43d-4585-9c7c-24ed191e8568 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:50.931108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 990/1963] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:32:50.968723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be91aae-a1f0-49b9-9e87-6aeb41c8e48d admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:50.970301 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5be91aae-a1f0-49b9-9e87-6aeb41c8e48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:51.047933 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be91aae-a1f0-49b9-9e87-6aeb41c8e48d admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:51.060119 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca6cca-dc0d-4539-86d1-1a33148da17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:51.060942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca6cca-dc0d-4539-86d1-1a33148da17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:51.061231 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca6cca-dc0d-4539-86d1-1a33148da17b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:51.061509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca6cca-dc0d-4539-86d1-1a33148da17b admin admin] PATH_INFO: `/v3/users/7905b2fc940d498f99d7c4042398cffd` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:51.062959 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca6cca-dc0d-4539-86d1-1a33148da17b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7905b2fc940d498f99d7c4042398cffd)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:51.066306 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca6cca-dc0d-4539-86d1-1a33148da17b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:51.152141 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-09ca6cca-dc0d-4539-86d1-1a33148da17b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7905b2fc940d498f99d7c4042398cffd'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.162087 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-09ca6cca-dc0d-4539-86d1-1a33148da17b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7905b2fc940d498f99d7c4042398cffd'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.163234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-09ca6cca-dc0d-4539-86d1-1a33148da17b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7905b2fc940d498f99d7c4042398cffd'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.181742 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-09ca6cca-dc0d-4539-86d1-1a33148da17b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7905b2fc940d498f99d7c4042398cffd'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.198309 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-09ca6cca-dc0d-4539-86d1-1a33148da17b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7905b2fc940d498f99d7c4042398cffd'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.208983 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 974/1964] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:50 2022] DELETE /identity/v3/users/7905b2fc940d498f99d7c4042398cffd => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:51.214481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e2113-1ce5-4e64-b9fb-c85d350bdcde None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:51.214854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e2113-1ce5-4e64-b9fb-c85d350bdcde None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:51.215209 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e2113-1ce5-4e64-b9fb-c85d350bdcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:51.235503 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-fc6e2113-1ce5-4e64-b9fb-c85d350bdcde None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:51.236780 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-fc6e2113-1ce5-4e64-b9fb-c85d350bdcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:51.309133 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 991/1965] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:51.320352 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca6cca-dc0d-4539-86d1-1a33148da17b admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:51.321832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-09ca6cca-dc0d-4539-86d1-1a33148da17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:51.379843 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e2113-1ce5-4e64-b9fb-c85d350bdcde None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:51.381304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-fc6e2113-1ce5-4e64-b9fb-c85d350bdcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:51.389808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca6cca-dc0d-4539-86d1-1a33148da17b admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:51.394356 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc612a6b-a52d-4ddf-966a-d5d94efb197a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:51.394526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e2113-1ce5-4e64-b9fb-c85d350bdcde None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:51.394613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc612a6b-a52d-4ddf-966a-d5d94efb197a service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:51.394853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc612a6b-a52d-4ddf-966a-d5d94efb197a service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:51.395181 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc612a6b-a52d-4ddf-966a-d5d94efb197a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:51.399798 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e415d7-2162-4783-91a6-0d8e335865c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:51.400679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e415d7-2162-4783-91a6-0d8e335865c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:51.400965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e415d7-2162-4783-91a6-0d8e335865c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:51.401243 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e415d7-2162-4783-91a6-0d8e335865c7 admin admin] PATH_INFO: `/v3/projects/4a1c8a2540c141ebb7d3d7584a42f07d` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:51.402477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e415d7-2162-4783-91a6-0d8e335865c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a1c8a2540c141ebb7d3d7584a42f07d)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:51.404422 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e415d7-2162-4783-91a6-0d8e335865c7 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:51.405947 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc612a6b-a52d-4ddf-966a-d5d94efb197a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:51.407539 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc612a6b-a52d-4ddf-966a-d5d94efb197a service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:51.417490 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 975/1966] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:32:51.455492 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c2e415d7-2162-4783-91a6-0d8e335865c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a1c8a2540c141ebb7d3d7584a42f07d', 'request_id': 'req-c2e415d7-2162-4783-91a6-0d8e335865c7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.462303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c2e415d7-2162-4783-91a6-0d8e335865c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a1c8a2540c141ebb7d3d7584a42f07d', 'request_id': 'req-c2e415d7-2162-4783-91a6-0d8e335865c7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.470053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c2e415d7-2162-4783-91a6-0d8e335865c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a1c8a2540c141ebb7d3d7584a42f07d', 'request_id': 'req-c2e415d7-2162-4783-91a6-0d8e335865c7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.483545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c2e415d7-2162-4783-91a6-0d8e335865c7 admin admin] The token cache is being invalidate because project 4a1c8a2540c141ebb7d3d7584a42f07d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:51.483855 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c2e415d7-2162-4783-91a6-0d8e335865c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.484694 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c2e415d7-2162-4783-91a6-0d8e335865c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.486504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 992/1967] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:51 2022] DELETE /identity/v3/projects/4a1c8a2540c141ebb7d3d7584a42f07d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:51.491593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc612a6b-a52d-4ddf-966a-d5d94efb197a service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:51.501421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc612a6b-a52d-4ddf-966a-d5d94efb197a service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:51.561628 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c3366-9c01-414f-ad5e-a8f5af5e5eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:51.562621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c3366-9c01-414f-ad5e-a8f5af5e5eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:51.562973 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c3366-9c01-414f-ad5e-a8f5af5e5eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:51.563172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c3366-9c01-414f-ad5e-a8f5af5e5eae admin admin] PATH_INFO: `/v3/users/b74e2c60101a45a9bcd93e5c7d722cef` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:51.564558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c3366-9c01-414f-ad5e-a8f5af5e5eae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b74e2c60101a45a9bcd93e5c7d722cef)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:51.567268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c3366-9c01-414f-ad5e-a8f5af5e5eae admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:51.618750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-636c3366-9c01-414f-ad5e-a8f5af5e5eae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74e2c60101a45a9bcd93e5c7d722cef'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.625614 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-636c3366-9c01-414f-ad5e-a8f5af5e5eae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74e2c60101a45a9bcd93e5c7d722cef'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.626470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-636c3366-9c01-414f-ad5e-a8f5af5e5eae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74e2c60101a45a9bcd93e5c7d722cef'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.638898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-636c3366-9c01-414f-ad5e-a8f5af5e5eae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74e2c60101a45a9bcd93e5c7d722cef'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.647026 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-636c3366-9c01-414f-ad5e-a8f5af5e5eae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74e2c60101a45a9bcd93e5c7d722cef'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.653175 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 976/1968] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:32:51 2022] DELETE /identity/v3/users/b74e2c60101a45a9bcd93e5c7d722cef => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:51.691128 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e415d7-2162-4783-91a6-0d8e335865c7 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:51.692894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c2e415d7-2162-4783-91a6-0d8e335865c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:51.707441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e415d7-2162-4783-91a6-0d8e335865c7 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:51.772061 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:51.772955 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:51.773241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:51.773519 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781 admin admin] PATH_INFO: `/v3/projects/1a53518a5cf04b40945a29a21a8b3e71` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:51.774764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a53518a5cf04b40945a29a21a8b3e71)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:51.776786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:51.827088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a53518a5cf04b40945a29a21a8b3e71', 'request_id': 'req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.833200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a53518a5cf04b40945a29a21a8b3e71', 'request_id': 'req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.840599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a53518a5cf04b40945a29a21a8b3e71', 'request_id': 'req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.852689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781 admin admin] The token cache is being invalidate because project 1a53518a5cf04b40945a29a21a8b3e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:51.853112 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.854048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:51.856313 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 993/1969] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:51 2022] DELETE /identity/v3/projects/1a53518a5cf04b40945a29a21a8b3e71 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:51.861188 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ae28-e2c3-4ba9-a75b-602644452436 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:51.861533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ae28-e2c3-4ba9-a75b-602644452436 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:51.861822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ae28-e2c3-4ba9-a75b-602644452436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:51.881851 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-bfc5ae28-e2c3-4ba9-a75b-602644452436 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:51.883120 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bfc5ae28-e2c3-4ba9-a75b-602644452436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:51.949253 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:51.950699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:51.951708 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 977/1970] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:51.960349 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a901e3b-e8e9-4dee-9cf6-e60bf7400a50 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:51.960652 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a901e3b-e8e9-4dee-9cf6-e60bf7400a50 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:51.960937 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a901e3b-e8e9-4dee-9cf6-e60bf7400a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:51.969101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48beda-bcf6-4dd4-a2d5-60341d4dd781 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:51.974787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938aed5-d848-41ba-a0c4-c6d35c15aab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:51.975662 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938aed5-d848-41ba-a0c4-c6d35c15aab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:51.975967 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938aed5-d848-41ba-a0c4-c6d35c15aab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:51.976972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938aed5-d848-41ba-a0c4-c6d35c15aab1 admin admin] PATH_INFO: `/v3/projects/1d5febcedd34493abc9d3dfa51c749bc` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:51.977518 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938aed5-d848-41ba-a0c4-c6d35c15aab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5febcedd34493abc9d3dfa51c749bc)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:51.979549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938aed5-d848-41ba-a0c4-c6d35c15aab1 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:51.982800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-1a901e3b-e8e9-4dee-9cf6-e60bf7400a50 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:51.984116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1a901e3b-e8e9-4dee-9cf6-e60bf7400a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:51.993004 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 978/1971] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:51.996971 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a901e3b-e8e9-4dee-9cf6-e60bf7400a50 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:52.005889 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a901e3b-e8e9-4dee-9cf6-e60bf7400a50 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:52.011504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a8afc-5501-415f-bf51-f4c5da186370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:52.012165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a8afc-5501-415f-bf51-f4c5da186370 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.012477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a8afc-5501-415f-bf51-f4c5da186370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.012792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a8afc-5501-415f-bf51-f4c5da186370 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.013519 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a8afc-5501-415f-bf51-f4c5da186370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:32:52.013939 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a8afc-5501-415f-bf51-f4c5da186370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:52.015461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a8afc-5501-415f-bf51-f4c5da186370 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:52.027906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 979/1972] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:32:52.032151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4938aed5-d848-41ba-a0c4-c6d35c15aab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5febcedd34493abc9d3dfa51c749bc', 'request_id': 'req-4938aed5-d848-41ba-a0c4-c6d35c15aab1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:52.032367 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a8afc-5501-415f-bf51-f4c5da186370 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:52.039799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4938aed5-d848-41ba-a0c4-c6d35c15aab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5febcedd34493abc9d3dfa51c749bc', 'request_id': 'req-4938aed5-d848-41ba-a0c4-c6d35c15aab1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:52.044229 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a8afc-5501-415f-bf51-f4c5da186370 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:52.048394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4938aed5-d848-41ba-a0c4-c6d35c15aab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5febcedd34493abc9d3dfa51c749bc', 'request_id': 'req-4938aed5-d848-41ba-a0c4-c6d35c15aab1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:52.066760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4938aed5-d848-41ba-a0c4-c6d35c15aab1 admin admin] The token cache is being invalidate because project 1d5febcedd34493abc9d3dfa51c749bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:32:52.067049 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4938aed5-d848-41ba-a0c4-c6d35c15aab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:52.067938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4938aed5-d848-41ba-a0c4-c6d35c15aab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:32:52.071435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 994/1973] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:32:51 2022] DELETE /identity/v3/projects/1d5febcedd34493abc9d3dfa51c749bc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:52.077146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907af5a5-5117-4193-8f26-55ec49482095 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.077509 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907af5a5-5117-4193-8f26-55ec49482095 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.077922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907af5a5-5117-4193-8f26-55ec49482095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.105171 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-907af5a5-5117-4193-8f26-55ec49482095 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:52.110506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-907af5a5-5117-4193-8f26-55ec49482095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:52.112764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e8d8e-fe4f-4025-9fa4-ed260964f68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:52.113579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e8d8e-fe4f-4025-9fa4-ed260964f68b admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.113866 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e8d8e-fe4f-4025-9fa4-ed260964f68b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.114145 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e8d8e-fe4f-4025-9fa4-ed260964f68b admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.114871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e8d8e-fe4f-4025-9fa4-ed260964f68b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:52.116791 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e8d8e-fe4f-4025-9fa4-ed260964f68b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:52.121165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 995/1974] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:52.130463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9754a-e9c1-48e9-b315-75e198719a66 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.130776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9754a-e9c1-48e9-b315-75e198719a66 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.131119 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9754a-e9c1-48e9-b315-75e198719a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.150040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 980/1975] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:52 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:32:52.154481 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e8d8e-fe4f-4025-9fa4-ed260964f68b admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:52.156135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-1ce9754a-e9c1-48e9-b315-75e198719a66 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:52.156937 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-299e8d8e-fe4f-4025-9fa4-ed260964f68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:52.157259 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-1ce9754a-e9c1-48e9-b315-75e198719a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:52.241611 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 996/1976] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:52.248511 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9754a-e9c1-48e9-b315-75e198719a66 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:52.262400 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9754a-e9c1-48e9-b315-75e198719a66 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:52.263356 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e8d8e-fe4f-4025-9fa4-ed260964f68b admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:52.270598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b161545-f3b2-4b72-ab6d-f036256601a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:52.271299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b161545-f3b2-4b72-ab6d-f036256601a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.271584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b161545-f3b2-4b72-ab6d-f036256601a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.271869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b161545-f3b2-4b72-ab6d-f036256601a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.273157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b161545-f3b2-4b72-ab6d-f036256601a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:52.275425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b161545-f3b2-4b72-ab6d-f036256601a8 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:52.277286 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c74139-e8d5-461d-8a91-23ab5dc2eb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:52.278152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c74139-e8d5-461d-8a91-23ab5dc2eb80 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.278596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c74139-e8d5-461d-8a91-23ab5dc2eb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.279013 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c74139-e8d5-461d-8a91-23ab5dc2eb80 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.281405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c74139-e8d5-461d-8a91-23ab5dc2eb80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:32:52.281864 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c74139-e8d5-461d-8a91-23ab5dc2eb80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:52.283640 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c74139-e8d5-461d-8a91-23ab5dc2eb80 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:52.305787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 981/1977] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:52 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:52.309631 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b161545-f3b2-4b72-ab6d-f036256601a8 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:52.310157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 997/1978] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:32:52.315194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c74139-e8d5-461d-8a91-23ab5dc2eb80 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:52.324399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b161545-f3b2-4b72-ab6d-f036256601a8 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:52.329377 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c74139-e8d5-461d-8a91-23ab5dc2eb80 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:52.331832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc911e5-217c-4840-8f88-90a51b603c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:52.332738 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc911e5-217c-4840-8f88-90a51b603c79 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.333207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc911e5-217c-4840-8f88-90a51b603c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.333692 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc911e5-217c-4840-8f88-90a51b603c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.334749 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc911e5-217c-4840-8f88-90a51b603c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:52.336647 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc911e5-217c-4840-8f88-90a51b603c79 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:52.337015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1008ed-156a-4c6e-ab92-a95f9bec9702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:52.338093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1008ed-156a-4c6e-ab92-a95f9bec9702 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.338474 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1008ed-156a-4c6e-ab92-a95f9bec9702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.338820 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1008ed-156a-4c6e-ab92-a95f9bec9702 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.339665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1008ed-156a-4c6e-ab92-a95f9bec9702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:52.341679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1008ed-156a-4c6e-ab92-a95f9bec9702 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:52.348283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 982/1979] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:32:52.352896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc911e5-217c-4840-8f88-90a51b603c79 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:52.376090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc911e5-217c-4840-8f88-90a51b603c79 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:52.381523 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 998/1980] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:52 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:52.382868 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1008ed-156a-4c6e-ab92-a95f9bec9702 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:52.464293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcc66f-6f57-46bd-888f-088deddf4b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:52.465638 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcc66f-6f57-46bd-888f-088deddf4b7e admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.465941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcc66f-6f57-46bd-888f-088deddf4b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.466258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcc66f-6f57-46bd-888f-088deddf4b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.467007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcc66f-6f57-46bd-888f-088deddf4b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:52.468618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcc66f-6f57-46bd-888f-088deddf4b7e admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:52.475147 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1008ed-156a-4c6e-ab92-a95f9bec9702 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:52.479872 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 983/1981] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:32:52.483463 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcc66f-6f57-46bd-888f-088deddf4b7e admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:52.496386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcc66f-6f57-46bd-888f-088deddf4b7e admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:52.501812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c398778-38db-45a3-aad4-dd6a1b15ad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:52.503373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c398778-38db-45a3-aad4-dd6a1b15ad08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.503567 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb325dbc-01b2-437b-ba08-d02b565c0c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:52.503787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c398778-38db-45a3-aad4-dd6a1b15ad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.504131 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c398778-38db-45a3-aad4-dd6a1b15ad08 admin admin] PATH_INFO: `/v3/projects/828d5bf5df484f8c844e10924cabbe32/users/f8e456973fbc45c2b4c8c5ad8c982913/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.504738 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb325dbc-01b2-437b-ba08-d02b565c0c7f admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.505557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb325dbc-01b2-437b-ba08-d02b565c0c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.506500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb325dbc-01b2-437b-ba08-d02b565c0c7f admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.510109 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb325dbc-01b2-437b-ba08-d02b565c0c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:52.517084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb325dbc-01b2-437b-ba08-d02b565c0c7f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:52.523578 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c398778-38db-45a3-aad4-dd6a1b15ad08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=828d5bf5df484f8c844e10924cabbe32, user_id=f8e456973fbc45c2b4c8c5ad8c982913, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:52.527522 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c398778-38db-45a3-aad4-dd6a1b15ad08 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:52.546277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 984/1982] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:52 2022] PUT /identity/v3/projects/828d5bf5df484f8c844e10924cabbe32/users/f8e456973fbc45c2b4c8c5ad8c982913/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:52.549412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03da3b-6824-472c-8a39-69db94d544fe None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.549755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03da3b-6824-472c-8a39-69db94d544fe None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.550028 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03da3b-6824-472c-8a39-69db94d544fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.550872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 999/1983] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:52 2022] POST /identity/v3/users => generated 283 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:32:52.554851 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb325dbc-01b2-437b-ba08-d02b565c0c7f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:52.567736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb325dbc-01b2-437b-ba08-d02b565c0c7f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:52.568971 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-3b03da3b-6824-472c-8a39-69db94d544fe None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:52.570210 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3b03da3b-6824-472c-8a39-69db94d544fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:52.630046 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db0fc8-5c35-4e9e-9dbb-164766cf483f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:52.631045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db0fc8-5c35-4e9e-9dbb-164766cf483f admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.631326 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db0fc8-5c35-4e9e-9dbb-164766cf483f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.631642 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 985/1984] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:52.634346 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db0fc8-5c35-4e9e-9dbb-164766cf483f admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.635199 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db0fc8-5c35-4e9e-9dbb-164766cf483f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:52.636825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db0fc8-5c35-4e9e-9dbb-164766cf483f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:52.641074 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03da3b-6824-472c-8a39-69db94d544fe None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:52.642473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3b03da3b-6824-472c-8a39-69db94d544fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:52.648500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1000/1985] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:32:52.652207 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db0fc8-5c35-4e9e-9dbb-164766cf483f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:52.661722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db0fc8-5c35-4e9e-9dbb-164766cf483f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:52.666715 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528cb86-4965-497f-832a-e35613aa9477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:52.667367 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528cb86-4965-497f-832a-e35613aa9477 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.667651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528cb86-4965-497f-832a-e35613aa9477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.667932 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528cb86-4965-497f-832a-e35613aa9477 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.668652 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528cb86-4965-497f-832a-e35613aa9477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:52.670349 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528cb86-4965-497f-832a-e35613aa9477 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:52.680123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1001/1986] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:32:52.684063 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528cb86-4965-497f-832a-e35613aa9477 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:52.694730 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528cb86-4965-497f-832a-e35613aa9477 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:52.699986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cf6f4-62eb-41d2-8619-00314f9fb6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:52.700839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cf6f4-62eb-41d2-8619-00314f9fb6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.701407 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cf6f4-62eb-41d2-8619-00314f9fb6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.701678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cf6f4-62eb-41d2-8619-00314f9fb6f6 admin admin] PATH_INFO: `/v3/projects/2ca4bceda33641a5af3db6942c6bad6f/users/77d320f0763b4b7ebeb683044709e2c7/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.702386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03da3b-6824-472c-8a39-69db94d544fe None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:52.706830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1d817-c008-471b-9fcd-b15d37478ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:52.707932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1d817-c008-471b-9fcd-b15d37478ddc service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.708220 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1d817-c008-471b-9fcd-b15d37478ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.708499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1d817-c008-471b-9fcd-b15d37478ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.716839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2cf6f4-62eb-41d2-8619-00314f9fb6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca4bceda33641a5af3db6942c6bad6f, user_id=77d320f0763b4b7ebeb683044709e2c7, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:52.717822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1d817-c008-471b-9fcd-b15d37478ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:52.719295 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1d817-c008-471b-9fcd-b15d37478ddc service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:52.719579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2cf6f4-62eb-41d2-8619-00314f9fb6f6 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:52.730110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 986/1987] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:32:52.733252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1002/1988] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:52 2022] PUT /identity/v3/projects/2ca4bceda33641a5af3db6942c6bad6f/users/77d320f0763b4b7ebeb683044709e2c7/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:32:52.744329 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5843c3e-2884-464a-8e4b-69e709af87f7 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.744678 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5843c3e-2884-464a-8e4b-69e709af87f7 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.744957 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5843c3e-2884-464a-8e4b-69e709af87f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.775806 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-f5843c3e-2884-464a-8e4b-69e709af87f7 None None] MFA Rules not processed for user `77d320f0763b4b7ebeb683044709e2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:52.777135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f5843c3e-2884-464a-8e4b-69e709af87f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:52.846852 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 987/1989] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:52.849442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cf6f4-62eb-41d2-8619-00314f9fb6f6 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:52.911286 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cf6f4-62eb-41d2-8619-00314f9fb6f6 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:52.916132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033aac19-163b-4395-85cc-c21a08eea079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:52.916784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033aac19-163b-4395-85cc-c21a08eea079 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:52.917062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033aac19-163b-4395-85cc-c21a08eea079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:52.917335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033aac19-163b-4395-85cc-c21a08eea079 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:52.918045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033aac19-163b-4395-85cc-c21a08eea079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:52.919991 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033aac19-163b-4395-85cc-c21a08eea079 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:52.950364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1003/1990] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:32:52 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:52.951926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5843c3e-2884-464a-8e4b-69e709af87f7 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:52.963565 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5843c3e-2884-464a-8e4b-69e709af87f7 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:53.024516 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db320f-263b-4258-9681-c20976fa84ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:53.025197 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db320f-263b-4258-9681-c20976fa84ca admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:53.025477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db320f-263b-4258-9681-c20976fa84ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:53.025750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db320f-263b-4258-9681-c20976fa84ca admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:53.026504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db320f-263b-4258-9681-c20976fa84ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:53.028701 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db320f-263b-4258-9681-c20976fa84ca admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:53.049037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 988/1991] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:32:52 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:32:53.053840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033aac19-163b-4395-85cc-c21a08eea079 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:53.063919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033aac19-163b-4395-85cc-c21a08eea079 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:53.069360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3391c81-5816-4994-8b2f-cbae72f44ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:53.070028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3391c81-5816-4994-8b2f-cbae72f44ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:53.070316 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3391c81-5816-4994-8b2f-cbae72f44ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:53.070589 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3391c81-5816-4994-8b2f-cbae72f44ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:53.071308 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3391c81-5816-4994-8b2f-cbae72f44ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:53.072906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3391c81-5816-4994-8b2f-cbae72f44ac8 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:53.083999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1004/1992] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:32:53.088112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db320f-263b-4258-9681-c20976fa84ca admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:53.098385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db320f-263b-4258-9681-c20976fa84ca admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:53.103148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070ae8d-e3d5-47eb-9c3c-d1a3cc5dfef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:53.104044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070ae8d-e3d5-47eb-9c3c-d1a3cc5dfef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:53.104328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070ae8d-e3d5-47eb-9c3c-d1a3cc5dfef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:53.104613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070ae8d-e3d5-47eb-9c3c-d1a3cc5dfef4 admin admin] PATH_INFO: `/v3/projects/dd7d3cf5e8344e2d8c65bf259744bc96/users/d07d4c8b307f482f91069abe3696a28c/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:53.120991 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070ae8d-e3d5-47eb-9c3c-d1a3cc5dfef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7d3cf5e8344e2d8c65bf259744bc96, user_id=d07d4c8b307f482f91069abe3696a28c, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:53.124144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070ae8d-e3d5-47eb-9c3c-d1a3cc5dfef4 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:53.142425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 989/1993] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:53 2022] PUT /identity/v3/projects/dd7d3cf5e8344e2d8c65bf259744bc96/users/d07d4c8b307f482f91069abe3696a28c/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:53.143282 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3391c81-5816-4994-8b2f-cbae72f44ac8 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:53.154649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3391c81-5816-4994-8b2f-cbae72f44ac8 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:53.218896 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743b682-ebb3-4928-abf9-1753ad56aafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:53.219767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743b682-ebb3-4928-abf9-1753ad56aafb admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:53.220149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743b682-ebb3-4928-abf9-1753ad56aafb admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:53.220523 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743b682-ebb3-4928-abf9-1753ad56aafb admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:53.221344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743b682-ebb3-4928-abf9-1753ad56aafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:53.223665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743b682-ebb3-4928-abf9-1753ad56aafb admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:53.239316 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1005/1994] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:32:53.241109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070ae8d-e3d5-47eb-9c3c-d1a3cc5dfef4 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:53.273064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070ae8d-e3d5-47eb-9c3c-d1a3cc5dfef4 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:53.281261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8cf3c-1757-45f8-bd52-5b5b1b4ece9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:53.281885 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8cf3c-1757-45f8-bd52-5b5b1b4ece9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:53.282724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8cf3c-1757-45f8-bd52-5b5b1b4ece9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:53.283112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8cf3c-1757-45f8-bd52-5b5b1b4ece9a admin admin] PATH_INFO: `/v3/projects/dd7d3cf5e8344e2d8c65bf259744bc96/users/d07d4c8b307f482f91069abe3696a28c/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:53.287413 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8cf3c-1757-45f8-bd52-5b5b1b4ece9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7d3cf5e8344e2d8c65bf259744bc96, user_id=d07d4c8b307f482f91069abe3696a28c, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:53.290690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8cf3c-1757-45f8-bd52-5b5b1b4ece9a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:53.330552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 990/1995] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:32:53 2022] PUT /identity/v3/projects/dd7d3cf5e8344e2d8c65bf259744bc96/users/d07d4c8b307f482f91069abe3696a28c/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:32:53.342766 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5b556-8c90-48e7-b08e-699dafea2d32 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:53.343105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5b556-8c90-48e7-b08e-699dafea2d32 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:53.343649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5b556-8c90-48e7-b08e-699dafea2d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:53.428328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-9cd5b556-8c90-48e7-b08e-699dafea2d32 None None] MFA Rules not processed for user `d07d4c8b307f482f91069abe3696a28c`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:53.429741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-9cd5b556-8c90-48e7-b08e-699dafea2d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:53.561454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1006/1996] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:53 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:32:53.590266 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8cf3c-1757-45f8-bd52-5b5b1b4ece9a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:53.592550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c3e8cf3c-1757-45f8-bd52-5b5b1b4ece9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:53.676838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8cf3c-1757-45f8-bd52-5b5b1b4ece9a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:53.681668 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d4dce-3119-4304-b1e1-478ecc97d1a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:53.682477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d4dce-3119-4304-b1e1-478ecc97d1a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:53.682857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d4dce-3119-4304-b1e1-478ecc97d1a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:53.683230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d4dce-3119-4304-b1e1-478ecc97d1a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:53.696437 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d4dce-3119-4304-b1e1-478ecc97d1a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:53.698125 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d4dce-3119-4304-b1e1-478ecc97d1a6 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:53.709511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 991/1997] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:53 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:53.808609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5b556-8c90-48e7-b08e-699dafea2d32 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:53.823460 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5b556-8c90-48e7-b08e-699dafea2d32 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:53.828660 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04df65-dd5d-4f55-ac4c-f42dd5df5637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:53.829317 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04df65-dd5d-4f55-ac4c-f42dd5df5637 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:53.829603 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04df65-dd5d-4f55-ac4c-f42dd5df5637 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:53.829882 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04df65-dd5d-4f55-ac4c-f42dd5df5637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:53.877023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7d1ea-1220-4680-a0d6-5f53b31f13ba None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:53.877321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7d1ea-1220-4680-a0d6-5f53b31f13ba None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:53.877600 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7d1ea-1220-4680-a0d6-5f53b31f13ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:53.897628 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04df65-dd5d-4f55-ac4c-f42dd5df5637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:53.899187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04df65-dd5d-4f55-ac4c-f42dd5df5637 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:53.908902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1007/1998] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:32:53.913582 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-dcf7d1ea-1220-4680-a0d6-5f53b31f13ba None None] MFA Rules not processed for user `f8e456973fbc45c2b4c8c5ad8c982913`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:32:53.915211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-dcf7d1ea-1220-4680-a0d6-5f53b31f13ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:32:53.996611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 992/1999] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:32:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:32:54.154667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04df65-dd5d-4f55-ac4c-f42dd5df5637 service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:32:54.163566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04df65-dd5d-4f55-ac4c-f42dd5df5637 service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:32:54.167475 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98916d-8472-4e80-b00b-e34493768f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:32:54.168118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98916d-8472-4e80-b00b-e34493768f6c service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:32:54.168406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98916d-8472-4e80-b00b-e34493768f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:32:54.168703 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98916d-8472-4e80-b00b-e34493768f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:32:54.177600 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98916d-8472-4e80-b00b-e34493768f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:32:54.179116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98916d-8472-4e80-b00b-e34493768f6c service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:32:54.188227 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1008/2000] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:32:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:00.013129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da0bfd-97c1-454b-bd5b-9bffeb10f9cb None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:00.013610 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da0bfd-97c1-454b-bd5b-9bffeb10f9cb None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:00.013707 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da0bfd-97c1-454b-bd5b-9bffeb10f9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:00.031912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-50da0bfd-97c1-454b-bd5b-9bffeb10f9cb None None] MFA Rules not processed for user `f8e456973fbc45c2b4c8c5ad8c982913`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:00.033112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-50da0bfd-97c1-454b-bd5b-9bffeb10f9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:00.040855 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 993/2001] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:02.436163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98916d-8472-4e80-b00b-e34493768f6c service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:02.511008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98916d-8472-4e80-b00b-e34493768f6c service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:02.516027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6ec75-7d71-4219-8f39-9f64d8031eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:02.517204 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6ec75-7d71-4219-8f39-9f64d8031eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:02.517709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6ec75-7d71-4219-8f39-9f64d8031eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:02.518975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6ec75-7d71-4219-8f39-9f64d8031eb9 admin admin] PATH_INFO: `/v3/users/77d320f0763b4b7ebeb683044709e2c7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:02.520625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6ec75-7d71-4219-8f39-9f64d8031eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d320f0763b4b7ebeb683044709e2c7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:02.522995 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6ec75-7d71-4219-8f39-9f64d8031eb9 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:02.576436 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6cb6ec75-7d71-4219-8f39-9f64d8031eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d320f0763b4b7ebeb683044709e2c7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:02.584668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6cb6ec75-7d71-4219-8f39-9f64d8031eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d320f0763b4b7ebeb683044709e2c7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:02.585318 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6cb6ec75-7d71-4219-8f39-9f64d8031eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d320f0763b4b7ebeb683044709e2c7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:02.599874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6cb6ec75-7d71-4219-8f39-9f64d8031eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d320f0763b4b7ebeb683044709e2c7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:02.606929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6cb6ec75-7d71-4219-8f39-9f64d8031eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d320f0763b4b7ebeb683044709e2c7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:02.614899 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1009/2002] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:02 2022] DELETE /identity/v3/users/77d320f0763b4b7ebeb683044709e2c7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:02.619152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01d8c7-c9ad-4785-bc5a-e44f9774bff5 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:02.619618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01d8c7-c9ad-4785-bc5a-e44f9774bff5 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:02.619725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01d8c7-c9ad-4785-bc5a-e44f9774bff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:02.643069 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-5a01d8c7-c9ad-4785-bc5a-e44f9774bff5 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:02.644909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5a01d8c7-c9ad-4785-bc5a-e44f9774bff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:02.719084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6ec75-7d71-4219-8f39-9f64d8031eb9 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:02.720543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6cb6ec75-7d71-4219-8f39-9f64d8031eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:02.725618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 994/2003] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:02.731932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01d8c7-c9ad-4785-bc5a-e44f9774bff5 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:02.733264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5a01d8c7-c9ad-4785-bc5a-e44f9774bff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:02.741974 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6ec75-7d71-4219-8f39-9f64d8031eb9 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:02.747249 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4f30f-75d9-4a56-a7ca-e1cdc32e3663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:02.748187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4f30f-75d9-4a56-a7ca-e1cdc32e3663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:02.748509 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4f30f-75d9-4a56-a7ca-e1cdc32e3663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:02.748794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4f30f-75d9-4a56-a7ca-e1cdc32e3663 admin admin] PATH_INFO: `/v3/users/f1657ca892eb42adacc0c4f8d40cc22e` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:02.750110 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4f30f-75d9-4a56-a7ca-e1cdc32e3663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1657ca892eb42adacc0c4f8d40cc22e)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:02.752302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4f30f-75d9-4a56-a7ca-e1cdc32e3663 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:02.799101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01d8c7-c9ad-4785-bc5a-e44f9774bff5 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:02.803821 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506d0ca-f8a5-4911-a450-31e669a6bfdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:02.804552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506d0ca-f8a5-4911-a450-31e669a6bfdc service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:02.804905 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506d0ca-f8a5-4911-a450-31e669a6bfdc service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:02.805252 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506d0ca-f8a5-4911-a450-31e669a6bfdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:02.805927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d2a4f30f-75d9-4a56-a7ca-e1cdc32e3663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1657ca892eb42adacc0c4f8d40cc22e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:02.813887 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d2a4f30f-75d9-4a56-a7ca-e1cdc32e3663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1657ca892eb42adacc0c4f8d40cc22e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:02.814557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d2a4f30f-75d9-4a56-a7ca-e1cdc32e3663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1657ca892eb42adacc0c4f8d40cc22e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:02.816260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506d0ca-f8a5-4911-a450-31e669a6bfdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:02.818024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506d0ca-f8a5-4911-a450-31e669a6bfdc service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:02.828221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d2a4f30f-75d9-4a56-a7ca-e1cdc32e3663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1657ca892eb42adacc0c4f8d40cc22e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:02.829366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 995/2004] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:33:02.842117 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d2a4f30f-75d9-4a56-a7ca-e1cdc32e3663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1657ca892eb42adacc0c4f8d40cc22e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:02.851015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1010/2005] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:02 2022] DELETE /identity/v3/users/f1657ca892eb42adacc0c4f8d40cc22e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:33:02.855685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e927903-e07f-4b8e-8b94-0783d934fc8c None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:02.855988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e927903-e07f-4b8e-8b94-0783d934fc8c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:02.856276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e927903-e07f-4b8e-8b94-0783d934fc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:02.876141 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-6e927903-e07f-4b8e-8b94-0783d934fc8c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:02.878305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6e927903-e07f-4b8e-8b94-0783d934fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:02.959545 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 996/2006] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:02.985791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4f30f-75d9-4a56-a7ca-e1cdc32e3663 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:02.987411 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-d2a4f30f-75d9-4a56-a7ca-e1cdc32e3663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:03.090074 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4f30f-75d9-4a56-a7ca-e1cdc32e3663 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:03.094023 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef249cf-121c-40e8-b9a1-ad771ffb415d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:03.094734 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef249cf-121c-40e8-b9a1-ad771ffb415d service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:03.095014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef249cf-121c-40e8-b9a1-ad771ffb415d service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:03.095304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef249cf-121c-40e8-b9a1-ad771ffb415d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:03.107401 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef249cf-121c-40e8-b9a1-ad771ffb415d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:03.115549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef249cf-121c-40e8-b9a1-ad771ffb415d service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:03.134090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1011/2007] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:03.285310 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e927903-e07f-4b8e-8b94-0783d934fc8c None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:03.287795 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6e927903-e07f-4b8e-8b94-0783d934fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:03.302781 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e927903-e07f-4b8e-8b94-0783d934fc8c None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:03.312471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a05e4-58f0-44a3-9337-de13fd41c726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:03.317699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a05e4-58f0-44a3-9337-de13fd41c726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:03.319833 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a05e4-58f0-44a3-9337-de13fd41c726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:03.320163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a05e4-58f0-44a3-9337-de13fd41c726 admin admin] PATH_INFO: `/v3/projects/2ca4bceda33641a5af3db6942c6bad6f` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:03.323610 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a05e4-58f0-44a3-9337-de13fd41c726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca4bceda33641a5af3db6942c6bad6f)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:03.326330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a05e4-58f0-44a3-9337-de13fd41c726 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:03.387151 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-974a05e4-58f0-44a3-9337-de13fd41c726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca4bceda33641a5af3db6942c6bad6f', 'request_id': 'req-974a05e4-58f0-44a3-9337-de13fd41c726'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:03.394751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-974a05e4-58f0-44a3-9337-de13fd41c726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca4bceda33641a5af3db6942c6bad6f', 'request_id': 'req-974a05e4-58f0-44a3-9337-de13fd41c726'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:03.412599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-974a05e4-58f0-44a3-9337-de13fd41c726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca4bceda33641a5af3db6942c6bad6f', 'request_id': 'req-974a05e4-58f0-44a3-9337-de13fd41c726'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:03.432803 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-974a05e4-58f0-44a3-9337-de13fd41c726 admin admin] The token cache is being invalidate because project 2ca4bceda33641a5af3db6942c6bad6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:03.433097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-974a05e4-58f0-44a3-9337-de13fd41c726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:03.433834 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-974a05e4-58f0-44a3-9337-de13fd41c726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:03.437271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 997/2008] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:03 2022] DELETE /identity/v3/projects/2ca4bceda33641a5af3db6942c6bad6f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:03.442636 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef249cf-121c-40e8-b9a1-ad771ffb415d service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:03.468740 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef249cf-121c-40e8-b9a1-ad771ffb415d service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:03.550888 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea21f3-0cde-44f1-b123-2bab41e39046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:03.551783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea21f3-0cde-44f1-b123-2bab41e39046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:03.552155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea21f3-0cde-44f1-b123-2bab41e39046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:03.552660 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea21f3-0cde-44f1-b123-2bab41e39046 admin admin] PATH_INFO: `/v3/users/d07d4c8b307f482f91069abe3696a28c` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:03.554352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea21f3-0cde-44f1-b123-2bab41e39046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07d4c8b307f482f91069abe3696a28c)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:03.556983 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea21f3-0cde-44f1-b123-2bab41e39046 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:03.592603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a05e4-58f0-44a3-9337-de13fd41c726 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:03.594215 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-974a05e4-58f0-44a3-9337-de13fd41c726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:03.612470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a05e4-58f0-44a3-9337-de13fd41c726 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:03.618164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c8ea21f3-0cde-44f1-b123-2bab41e39046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07d4c8b307f482f91069abe3696a28c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:03.628232 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c8ea21f3-0cde-44f1-b123-2bab41e39046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07d4c8b307f482f91069abe3696a28c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:03.629144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c8ea21f3-0cde-44f1-b123-2bab41e39046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07d4c8b307f482f91069abe3696a28c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:03.632506 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4626868-9bfd-47a3-9067-d84eab393fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:03.634658 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4626868-9bfd-47a3-9067-d84eab393fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:03.635099 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4626868-9bfd-47a3-9067-d84eab393fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:03.636492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4626868-9bfd-47a3-9067-d84eab393fdf admin admin] PATH_INFO: `/v3/projects/d3558f5f0b5045ea9c8a6a572bbb6352` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:03.639528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4626868-9bfd-47a3-9067-d84eab393fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3558f5f0b5045ea9c8a6a572bbb6352)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:03.646306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c8ea21f3-0cde-44f1-b123-2bab41e39046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07d4c8b307f482f91069abe3696a28c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:03.655157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c8ea21f3-0cde-44f1-b123-2bab41e39046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07d4c8b307f482f91069abe3696a28c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:03.656256 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4626868-9bfd-47a3-9067-d84eab393fdf admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:03.666412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1012/2009] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:03 2022] DELETE /identity/v3/users/d07d4c8b307f482f91069abe3696a28c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:03.743953 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-c4626868-9bfd-47a3-9067-d84eab393fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3558f5f0b5045ea9c8a6a572bbb6352', 'request_id': 'req-c4626868-9bfd-47a3-9067-d84eab393fdf'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:03.751789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-c4626868-9bfd-47a3-9067-d84eab393fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3558f5f0b5045ea9c8a6a572bbb6352', 'request_id': 'req-c4626868-9bfd-47a3-9067-d84eab393fdf'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:03.761211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-c4626868-9bfd-47a3-9067-d84eab393fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3558f5f0b5045ea9c8a6a572bbb6352', 'request_id': 'req-c4626868-9bfd-47a3-9067-d84eab393fdf'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:03.782646 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-c4626868-9bfd-47a3-9067-d84eab393fdf admin admin] The token cache is being invalidate because project d3558f5f0b5045ea9c8a6a572bbb6352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:03.783093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-c4626868-9bfd-47a3-9067-d84eab393fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:03.784542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-c4626868-9bfd-47a3-9067-d84eab393fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:03.786603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 998/2010] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:03 2022] DELETE /identity/v3/projects/d3558f5f0b5045ea9c8a6a572bbb6352 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:03.791841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe58da3-373e-40dc-b296-50679d6a1cb5 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:03.791841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe58da3-373e-40dc-b296-50679d6a1cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:03.792163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe58da3-373e-40dc-b296-50679d6a1cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:03.818940 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-4fe58da3-373e-40dc-b296-50679d6a1cb5 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:03.821254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-4fe58da3-373e-40dc-b296-50679d6a1cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:03.937647 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1013/2011] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:33:03.946574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd521443-8ea1-4a68-ae28-4b6bf1a6a917 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:03.947133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd521443-8ea1-4a68-ae28-4b6bf1a6a917 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:03.947488 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd521443-8ea1-4a68-ae28-4b6bf1a6a917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:03.979155 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-cd521443-8ea1-4a68-ae28-4b6bf1a6a917 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:03.981226 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-cd521443-8ea1-4a68-ae28-4b6bf1a6a917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:04.001502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 999/2012] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:33:04.007602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe58da3-373e-40dc-b296-50679d6a1cb5 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.021971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe58da3-373e-40dc-b296-50679d6a1cb5 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.028313 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca236ca-7787-45fc-a3e8-9683114b45ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.029135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca236ca-7787-45fc-a3e8-9683114b45ef admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.029422 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca236ca-7787-45fc-a3e8-9683114b45ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.029702 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca236ca-7787-45fc-a3e8-9683114b45ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.032083 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca236ca-7787-45fc-a3e8-9683114b45ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:33:04.032626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca236ca-7787-45fc-a3e8-9683114b45ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.036573 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca236ca-7787-45fc-a3e8-9683114b45ef admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.053429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1014/2013] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:33:04.057684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd521443-8ea1-4a68-ae28-4b6bf1a6a917 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.068803 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd521443-8ea1-4a68-ae28-4b6bf1a6a917 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.075369 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b481b-0756-422e-ae4a-937a7035125e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.076438 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b481b-0756-422e-ae4a-937a7035125e admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.076785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b481b-0756-422e-ae4a-937a7035125e admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.077136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b481b-0756-422e-ae4a-937a7035125e admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.077915 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b481b-0756-422e-ae4a-937a7035125e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.083619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b481b-0756-422e-ae4a-937a7035125e admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.132748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1000/2014] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:04 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:04.133952 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca236ca-7787-45fc-a3e8-9683114b45ef admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.150117 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca236ca-7787-45fc-a3e8-9683114b45ef admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.238570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ccc06-97ec-4f5f-9317-ccbf2ae00894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.239500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ccc06-97ec-4f5f-9317-ccbf2ae00894 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.239938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ccc06-97ec-4f5f-9317-ccbf2ae00894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.240334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ccc06-97ec-4f5f-9317-ccbf2ae00894 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.241252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ccc06-97ec-4f5f-9317-ccbf2ae00894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.243599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ccc06-97ec-4f5f-9317-ccbf2ae00894 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.272439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1015/2015] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:04 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:04.280667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b481b-0756-422e-ae4a-937a7035125e admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.294583 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b481b-0756-422e-ae4a-937a7035125e admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.302544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f283c34-288a-40ec-b94b-54e655992b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.303304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f283c34-288a-40ec-b94b-54e655992b33 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.303595 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f283c34-288a-40ec-b94b-54e655992b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.304454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f283c34-288a-40ec-b94b-54e655992b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.305954 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f283c34-288a-40ec-b94b-54e655992b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.307674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f283c34-288a-40ec-b94b-54e655992b33 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.320175 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1001/2016] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:33:04.326292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ccc06-97ec-4f5f-9317-ccbf2ae00894 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.331659 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f283c34-288a-40ec-b94b-54e655992b33 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.334087 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3f283c34-288a-40ec-b94b-54e655992b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:04.343326 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ccc06-97ec-4f5f-9317-ccbf2ae00894 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.350989 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77da745-c682-4752-803d-62250eae9492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.352056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77da745-c682-4752-803d-62250eae9492 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.352445 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77da745-c682-4752-803d-62250eae9492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.352933 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77da745-c682-4752-803d-62250eae9492 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.353757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77da745-c682-4752-803d-62250eae9492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.361245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f283c34-288a-40ec-b94b-54e655992b33 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.368394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77da745-c682-4752-803d-62250eae9492 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.370158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f85f58-ca34-46de-b6a1-97846ce85b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.371405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f85f58-ca34-46de-b6a1-97846ce85b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.371714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f85f58-ca34-46de-b6a1-97846ce85b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.372018 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f85f58-ca34-46de-b6a1-97846ce85b51 admin admin] PATH_INFO: `/v3/projects/dd7d3cf5e8344e2d8c65bf259744bc96` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.373468 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f85f58-ca34-46de-b6a1-97846ce85b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd7d3cf5e8344e2d8c65bf259744bc96)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.375452 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f85f58-ca34-46de-b6a1-97846ce85b51 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.387450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1016/2017] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:04.391309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77da745-c682-4752-803d-62250eae9492 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.406130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77da745-c682-4752-803d-62250eae9492 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.414030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7e051-7279-4e29-93af-4ee60705014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.415161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7e051-7279-4e29-93af-4ee60705014e admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.416663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7e051-7279-4e29-93af-4ee60705014e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.416956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7e051-7279-4e29-93af-4ee60705014e admin admin] PATH_INFO: `/v3/projects/12d8501bd82446ffa9232a4e108593fd/users/bee5ea9fc5054f4fb725ce43883f453e/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.440554 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-09f85f58-ca34-46de-b6a1-97846ce85b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd7d3cf5e8344e2d8c65bf259744bc96', 'request_id': 'req-09f85f58-ca34-46de-b6a1-97846ce85b51'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:04.442917 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7e051-7279-4e29-93af-4ee60705014e admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d8501bd82446ffa9232a4e108593fd, user_id=bee5ea9fc5054f4fb725ce43883f453e, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.447960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7e051-7279-4e29-93af-4ee60705014e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.449184 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-09f85f58-ca34-46de-b6a1-97846ce85b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd7d3cf5e8344e2d8c65bf259744bc96', 'request_id': 'req-09f85f58-ca34-46de-b6a1-97846ce85b51'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:04.461154 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-09f85f58-ca34-46de-b6a1-97846ce85b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd7d3cf5e8344e2d8c65bf259744bc96', 'request_id': 'req-09f85f58-ca34-46de-b6a1-97846ce85b51'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:04.466915 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1017/2018] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:04 2022] PUT /identity/v3/projects/12d8501bd82446ffa9232a4e108593fd/users/bee5ea9fc5054f4fb725ce43883f453e/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:04.472702 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-09f85f58-ca34-46de-b6a1-97846ce85b51 admin admin] The token cache is being invalidate because project dd7d3cf5e8344e2d8c65bf259744bc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:04.473070 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-09f85f58-ca34-46de-b6a1-97846ce85b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:04.473835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-09f85f58-ca34-46de-b6a1-97846ce85b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:04.475765 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1002/2019] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:04 2022] DELETE /identity/v3/projects/dd7d3cf5e8344e2d8c65bf259744bc96 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:04.481947 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eabfa9-5dc9-46b1-a3b5-3f48c445c4c0 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.482108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f064fd1-17de-4ab5-a5d9-2210d1dce65f None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.482578 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f064fd1-17de-4ab5-a5d9-2210d1dce65f None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.482924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f064fd1-17de-4ab5-a5d9-2210d1dce65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.485558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eabfa9-5dc9-46b1-a3b5-3f48c445c4c0 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.486045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eabfa9-5dc9-46b1-a3b5-3f48c445c4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.505709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-0f064fd1-17de-4ab5-a5d9-2210d1dce65f None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:04.507054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0f064fd1-17de-4ab5-a5d9-2210d1dce65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:04.515297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c4eabfa9-5dc9-46b1-a3b5-3f48c445c4c0 None None] MFA Rules not processed for user `bee5ea9fc5054f4fb725ce43883f453e`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:04.516557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c4eabfa9-5dc9-46b1-a3b5-3f48c445c4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:04.572209 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1003/2020] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:04.579944 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb403dd-6110-4062-8493-a7e425d3ec3b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.581558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb403dd-6110-4062-8493-a7e425d3ec3b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.581861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb403dd-6110-4062-8493-a7e425d3ec3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.594247 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1018/2021] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:04.597306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eabfa9-5dc9-46b1-a3b5-3f48c445c4c0 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.599700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c4eabfa9-5dc9-46b1-a3b5-3f48c445c4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:04.604198 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7fb403dd-6110-4062-8493-a7e425d3ec3b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:04.605384 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7fb403dd-6110-4062-8493-a7e425d3ec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:04.615910 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1004/2022] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:33:04.617039 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eabfa9-5dc9-46b1-a3b5-3f48c445c4c0 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.619915 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb403dd-6110-4062-8493-a7e425d3ec3b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.623182 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89f458-c5f5-4421-a9da-e46d0af73e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.623878 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89f458-c5f5-4421-a9da-e46d0af73e66 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.624163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89f458-c5f5-4421-a9da-e46d0af73e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.624439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89f458-c5f5-4421-a9da-e46d0af73e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.625130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89f458-c5f5-4421-a9da-e46d0af73e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.627112 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89f458-c5f5-4421-a9da-e46d0af73e66 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.631627 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb403dd-6110-4062-8493-a7e425d3ec3b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.636900 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b73f31-eb63-4340-b3ad-1ff58980649f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.637799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b73f31-eb63-4340-b3ad-1ff58980649f admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.638148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b73f31-eb63-4340-b3ad-1ff58980649f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.638524 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b73f31-eb63-4340-b3ad-1ff58980649f admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.639467 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b73f31-eb63-4340-b3ad-1ff58980649f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:33:04.639911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b73f31-eb63-4340-b3ad-1ff58980649f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.641699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b73f31-eb63-4340-b3ad-1ff58980649f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.659671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1005/2023] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:33:04.660937 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b73f31-eb63-4340-b3ad-1ff58980649f admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.661855 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1019/2024] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:04 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:04.665603 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89f458-c5f5-4421-a9da-e46d0af73e66 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.679475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b73f31-eb63-4340-b3ad-1ff58980649f admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.744548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89f458-c5f5-4421-a9da-e46d0af73e66 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.749704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5c799-f8cd-4e78-a6cf-8d245eaad480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.750418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5c799-f8cd-4e78-a6cf-8d245eaad480 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.751132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5c799-f8cd-4e78-a6cf-8d245eaad480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.751132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5c799-f8cd-4e78-a6cf-8d245eaad480 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.751864 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5c799-f8cd-4e78-a6cf-8d245eaad480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.754262 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5c799-f8cd-4e78-a6cf-8d245eaad480 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.758095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135e1b2-3a99-4bae-ba46-98100087fe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.758997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135e1b2-3a99-4bae-ba46-98100087fe44 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.759258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135e1b2-3a99-4bae-ba46-98100087fe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.759539 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135e1b2-3a99-4bae-ba46-98100087fe44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.760246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135e1b2-3a99-4bae-ba46-98100087fe44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.762303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135e1b2-3a99-4bae-ba46-98100087fe44 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.778790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1020/2025] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:04 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:33:04.779853 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5c799-f8cd-4e78-a6cf-8d245eaad480 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.792061 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5c799-f8cd-4e78-a6cf-8d245eaad480 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.797280 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab608ade-65c4-4b2c-818a-9533669621ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.798233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab608ade-65c4-4b2c-818a-9533669621ba admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.798361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1006/2026] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:04 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:04.798463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab608ade-65c4-4b2c-818a-9533669621ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.798585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab608ade-65c4-4b2c-818a-9533669621ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.799877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab608ade-65c4-4b2c-818a-9533669621ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.801508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab608ade-65c4-4b2c-818a-9533669621ba admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.803301 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135e1b2-3a99-4bae-ba46-98100087fe44 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.814327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1021/2027] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:04.818814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab608ade-65c4-4b2c-818a-9533669621ba admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.833143 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab608ade-65c4-4b2c-818a-9533669621ba admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.877745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135e1b2-3a99-4bae-ba46-98100087fe44 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.883074 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166329dc-bf80-457d-a876-2cce07f73553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.883749 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166329dc-bf80-457d-a876-2cce07f73553 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.884031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166329dc-bf80-457d-a876-2cce07f73553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.884315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166329dc-bf80-457d-a876-2cce07f73553 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.885007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166329dc-bf80-457d-a876-2cce07f73553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.886980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166329dc-bf80-457d-a876-2cce07f73553 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.905920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37770df9-c5e2-440e-9860-06d0bc6b6a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.906891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37770df9-c5e2-440e-9860-06d0bc6b6a14 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.907179 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37770df9-c5e2-440e-9860-06d0bc6b6a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.907464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37770df9-c5e2-440e-9860-06d0bc6b6a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.908439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37770df9-c5e2-440e-9860-06d0bc6b6a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.910665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37770df9-c5e2-440e-9860-06d0bc6b6a14 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.911135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1007/2028] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:04 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:33:04.914962 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166329dc-bf80-457d-a876-2cce07f73553 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.922132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1022/2029] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:33:04.925809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166329dc-bf80-457d-a876-2cce07f73553 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.926325 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37770df9-c5e2-440e-9860-06d0bc6b6a14 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.932047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae160-21e9-46ea-83e5-7d4cc2931e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.932864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae160-21e9-46ea-83e5-7d4cc2931e2a admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.933151 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae160-21e9-46ea-83e5-7d4cc2931e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.933418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae160-21e9-46ea-83e5-7d4cc2931e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.934149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ae160-21e9-46ea-83e5-7d4cc2931e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.935835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ae160-21e9-46ea-83e5-7d4cc2931e2a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.937537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37770df9-c5e2-440e-9860-06d0bc6b6a14 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.943237 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075079bc-f7b9-43e8-8f4e-4313236265c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.944357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075079bc-f7b9-43e8-8f4e-4313236265c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.944472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075079bc-f7b9-43e8-8f4e-4313236265c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.944871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075079bc-f7b9-43e8-8f4e-4313236265c4 admin admin] PATH_INFO: `/v3/projects/8d6b312b380043debd9abb8556c00f37/users/9f800bca0ab34e5794a0a586b11312e1/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.946840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1008/2030] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:33:04.950487 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae160-21e9-46ea-83e5-7d4cc2931e2a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.961672 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae160-21e9-46ea-83e5-7d4cc2931e2a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:04.966469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075079bc-f7b9-43e8-8f4e-4313236265c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6b312b380043debd9abb8556c00f37, user_id=9f800bca0ab34e5794a0a586b11312e1, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.967420 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb41a1-88d4-4e01-89ed-62ecc9f4822d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:04.968094 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb41a1-88d4-4e01-89ed-62ecc9f4822d admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.968378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb41a1-88d4-4e01-89ed-62ecc9f4822d admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.968656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb41a1-88d4-4e01-89ed-62ecc9f4822d admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.969001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075079bc-f7b9-43e8-8f4e-4313236265c4 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.969442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb41a1-88d4-4e01-89ed-62ecc9f4822d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:04.971489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb41a1-88d4-4e01-89ed-62ecc9f4822d admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:04.983069 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1009/2031] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:33:04.985572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1023/2032] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:04 2022] PUT /identity/v3/projects/8d6b312b380043debd9abb8556c00f37/users/9f800bca0ab34e5794a0a586b11312e1/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:33:04.988259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb41a1-88d4-4e01-89ed-62ecc9f4822d admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:04.997885 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa119ebe-ae62-4577-88b2-93992696f1ae None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:04.998866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa119ebe-ae62-4577-88b2-93992696f1ae None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:04.999191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa119ebe-ae62-4577-88b2-93992696f1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:04.999729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb41a1-88d4-4e01-89ed-62ecc9f4822d admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:05.031056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-fa119ebe-ae62-4577-88b2-93992696f1ae None None] MFA Rules not processed for user `9f800bca0ab34e5794a0a586b11312e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:05.032303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-fa119ebe-ae62-4577-88b2-93992696f1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:05.063025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b2e4c-d22f-4d7d-9c2f-c0910ab3fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:05.063936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b2e4c-d22f-4d7d-9c2f-c0910ab3fee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.064212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b2e4c-d22f-4d7d-9c2f-c0910ab3fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.064486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b2e4c-d22f-4d7d-9c2f-c0910ab3fee7 admin admin] PATH_INFO: `/v3/projects/c450ebb058164e419fe818cc16d23ca6/users/ca0505575b124975bad4dbaf1095b5ab/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.085739 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b2e4c-d22f-4d7d-9c2f-c0910ab3fee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c450ebb058164e419fe818cc16d23ca6, user_id=ca0505575b124975bad4dbaf1095b5ab, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:05.088306 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b2e4c-d22f-4d7d-9c2f-c0910ab3fee7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:05.106918 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1024/2033] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:05.107115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1010/2034] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:04 2022] PUT /identity/v3/projects/c450ebb058164e419fe818cc16d23ca6/users/ca0505575b124975bad4dbaf1095b5ab/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:05.111387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa119ebe-ae62-4577-88b2-93992696f1ae None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:05.115850 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f255c-bdf2-48b8-a745-d3361ac40398 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.116599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f255c-bdf2-48b8-a745-d3361ac40398 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.117187 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f255c-bdf2-48b8-a745-d3361ac40398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.123817 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa119ebe-ae62-4577-88b2-93992696f1ae None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:05.148698 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-c96f255c-bdf2-48b8-a745-d3361ac40398 None None] MFA Rules not processed for user `ca0505575b124975bad4dbaf1095b5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:05.150512 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c96f255c-bdf2-48b8-a745-d3361ac40398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:05.184949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97566477-6cb8-4a02-b32b-8aa505ed1918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:05.185618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97566477-6cb8-4a02-b32b-8aa505ed1918 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.185896 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97566477-6cb8-4a02-b32b-8aa505ed1918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.186167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97566477-6cb8-4a02-b32b-8aa505ed1918 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.186889 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97566477-6cb8-4a02-b32b-8aa505ed1918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:05.188864 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97566477-6cb8-4a02-b32b-8aa505ed1918 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:05.217564 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1025/2035] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:05 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:05.222438 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97566477-6cb8-4a02-b32b-8aa505ed1918 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:05.223805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1011/2036] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:05.228053 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f255c-bdf2-48b8-a745-d3361ac40398 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:05.239611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f255c-bdf2-48b8-a745-d3361ac40398 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:05.321059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15868d-c516-4564-83ce-0d0e21c441dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:05.321339 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97566477-6cb8-4a02-b32b-8aa505ed1918 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:05.321747 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15868d-c516-4564-83ce-0d0e21c441dc admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.322029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15868d-c516-4564-83ce-0d0e21c441dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.322394 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15868d-c516-4564-83ce-0d0e21c441dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.323357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15868d-c516-4564-83ce-0d0e21c441dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:05.325526 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15868d-c516-4564-83ce-0d0e21c441dc admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:05.327730 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54892cb-92e4-4e3c-b461-c24e43fbe583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:05.328578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54892cb-92e4-4e3c-b461-c24e43fbe583 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.329010 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54892cb-92e4-4e3c-b461-c24e43fbe583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.329433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54892cb-92e4-4e3c-b461-c24e43fbe583 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.330708 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54892cb-92e4-4e3c-b461-c24e43fbe583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:05.333574 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54892cb-92e4-4e3c-b461-c24e43fbe583 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:05.366299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1012/2037] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:05 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:33:05.367411 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15868d-c516-4564-83ce-0d0e21c441dc admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:05.369543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1026/2038] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:05 2022] POST /identity/v3/users => generated 298 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:05.374986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54892cb-92e4-4e3c-b461-c24e43fbe583 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:05.392520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54892cb-92e4-4e3c-b461-c24e43fbe583 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:05.466092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15868d-c516-4564-83ce-0d0e21c441dc admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:05.472132 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89044e87-2843-48ba-8579-ea30e464434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:05.472841 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044e87-2843-48ba-8579-ea30e464434b admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.473302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044e87-2843-48ba-8579-ea30e464434b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.473658 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044e87-2843-48ba-8579-ea30e464434b admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.474321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89044e87-2843-48ba-8579-ea30e464434b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:05.476310 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89044e87-2843-48ba-8579-ea30e464434b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:05.478484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd6e55-4935-4329-8e20-963edfede690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:05.478484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd6e55-4935-4329-8e20-963edfede690 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.478484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd6e55-4935-4329-8e20-963edfede690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.478484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd6e55-4935-4329-8e20-963edfede690 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.479345 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd6e55-4935-4329-8e20-963edfede690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:05.481124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd6e55-4935-4329-8e20-963edfede690 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:05.492992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1027/2039] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:05.496943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd6e55-4935-4329-8e20-963edfede690 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:05.499915 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1013/2040] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:05 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:05.504502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89044e87-2843-48ba-8579-ea30e464434b admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:05.509350 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd6e55-4935-4329-8e20-963edfede690 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:05.516048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd06e97-76d9-42d1-b15a-e4ae630f51a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:05.517573 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89044e87-2843-48ba-8579-ea30e464434b admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:05.518746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd06e97-76d9-42d1-b15a-e4ae630f51a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.519036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd06e97-76d9-42d1-b15a-e4ae630f51a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.519432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd06e97-76d9-42d1-b15a-e4ae630f51a4 admin admin] PATH_INFO: `/v3/projects/35f1471c305b41b9986bd382a954dff8/users/90da5112c7784592ac2697519e592363/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.523635 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aefc4b-238c-4e75-b370-4874bf63bd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:05.524699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aefc4b-238c-4e75-b370-4874bf63bd23 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.524699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aefc4b-238c-4e75-b370-4874bf63bd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.524889 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aefc4b-238c-4e75-b370-4874bf63bd23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.525640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aefc4b-238c-4e75-b370-4874bf63bd23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:05.527701 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aefc4b-238c-4e75-b370-4874bf63bd23 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:05.539636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1014/2041] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:33:05.543334 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aefc4b-238c-4e75-b370-4874bf63bd23 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:05.544307 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd06e97-76d9-42d1-b15a-e4ae630f51a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f1471c305b41b9986bd382a954dff8, user_id=90da5112c7784592ac2697519e592363, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:05.547667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd06e97-76d9-42d1-b15a-e4ae630f51a4 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:05.555125 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aefc4b-238c-4e75-b370-4874bf63bd23 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:05.560673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8c5dd-1212-4cae-b799-298be6dce85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:05.561591 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8c5dd-1212-4cae-b799-298be6dce85c admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.561949 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8c5dd-1212-4cae-b799-298be6dce85c admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.562797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8c5dd-1212-4cae-b799-298be6dce85c admin admin] PATH_INFO: `/v3/projects/629cb7b7886546c6be284d3c1638bd43/users/d1db6813fc3d4773bc6935588ed72e4a/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.564522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1028/2042] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:05 2022] PUT /identity/v3/projects/35f1471c305b41b9986bd382a954dff8/users/90da5112c7784592ac2697519e592363/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:33:05.570391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd06e97-76d9-42d1-b15a-e4ae630f51a4 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:05.583434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8c5dd-1212-4cae-b799-298be6dce85c admin admin] RBAC: Authorizing `identity:create_grant(project_id=629cb7b7886546c6be284d3c1638bd43, user_id=d1db6813fc3d4773bc6935588ed72e4a, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:05.586803 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8c5dd-1212-4cae-b799-298be6dce85c admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:05.605359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1015/2043] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:05 2022] PUT /identity/v3/projects/629cb7b7886546c6be284d3c1638bd43/users/d1db6813fc3d4773bc6935588ed72e4a/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:33:05.609884 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8c5dd-1212-4cae-b799-298be6dce85c admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:05.641872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd06e97-76d9-42d1-b15a-e4ae630f51a4 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:05.683324 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8c5dd-1212-4cae-b799-298be6dce85c admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:05.688951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cd129-51bb-4a21-9ea0-46bada923505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:05.690641 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cd129-51bb-4a21-9ea0-46bada923505 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.690831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cd129-51bb-4a21-9ea0-46bada923505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.691410 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cd129-51bb-4a21-9ea0-46bada923505 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.692159 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cd129-51bb-4a21-9ea0-46bada923505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:05.693814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cd129-51bb-4a21-9ea0-46bada923505 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:05.704904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de758f0-86e9-4fe0-ad12-a2501a42c4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:05.708463 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1016/2044] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:33:05.708594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de758f0-86e9-4fe0-ad12-a2501a42c4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.708594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de758f0-86e9-4fe0-ad12-a2501a42c4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.708594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de758f0-86e9-4fe0-ad12-a2501a42c4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.708594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de758f0-86e9-4fe0-ad12-a2501a42c4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:05.709865 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de758f0-86e9-4fe0-ad12-a2501a42c4a6 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:05.711129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cd129-51bb-4a21-9ea0-46bada923505 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:05.721157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cd129-51bb-4a21-9ea0-46bada923505 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:05.723282 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1029/2045] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:05.724174 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de758f0-86e9-4fe0-ad12-a2501a42c4a6 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:05.726593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cbcbb-1159-4132-96a7-dbe009287bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:05.727498 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cbcbb-1159-4132-96a7-dbe009287bca admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.727770 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cbcbb-1159-4132-96a7-dbe009287bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.728220 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cbcbb-1159-4132-96a7-dbe009287bca admin admin] PATH_INFO: `/v3/projects/629cb7b7886546c6be284d3c1638bd43/users/d1db6813fc3d4773bc6935588ed72e4a/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.731067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cbcbb-1159-4132-96a7-dbe009287bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=629cb7b7886546c6be284d3c1638bd43, user_id=d1db6813fc3d4773bc6935588ed72e4a, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:05.733819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cbcbb-1159-4132-96a7-dbe009287bca admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:05.735349 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de758f0-86e9-4fe0-ad12-a2501a42c4a6 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:05.741687 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91f2c2-1462-4601-8a7c-f09fac49bd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:05.742614 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91f2c2-1462-4601-8a7c-f09fac49bd91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.742908 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91f2c2-1462-4601-8a7c-f09fac49bd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.743219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91f2c2-1462-4601-8a7c-f09fac49bd91 admin admin] PATH_INFO: `/v3/projects/35f1471c305b41b9986bd382a954dff8/users/90da5112c7784592ac2697519e592363/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.745412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91f2c2-1462-4601-8a7c-f09fac49bd91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f1471c305b41b9986bd382a954dff8, user_id=90da5112c7784592ac2697519e592363, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:05.746446 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1017/2046] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:05 2022] PUT /identity/v3/projects/629cb7b7886546c6be284d3c1638bd43/users/d1db6813fc3d4773bc6935588ed72e4a/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:05.748299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91f2c2-1462-4601-8a7c-f09fac49bd91 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:05.757213 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c55c59-88bf-4c74-bdbb-96e8d58bac59 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.757601 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c55c59-88bf-4c74-bdbb-96e8d58bac59 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.758108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c55c59-88bf-4c74-bdbb-96e8d58bac59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.760823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1030/2047] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:05 2022] PUT /identity/v3/projects/35f1471c305b41b9986bd382a954dff8/users/90da5112c7784592ac2697519e592363/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:05.771089 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd6119-427b-4947-b092-d13e25ecc651 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:05.771381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd6119-427b-4947-b092-d13e25ecc651 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:05.771664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd6119-427b-4947-b092-d13e25ecc651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:05.793325 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-83c55c59-88bf-4c74-bdbb-96e8d58bac59 None None] MFA Rules not processed for user `d1db6813fc3d4773bc6935588ed72e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:05.794249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-83c55c59-88bf-4c74-bdbb-96e8d58bac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:05.829314 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-4bdd6119-427b-4947-b092-d13e25ecc651 None None] MFA Rules not processed for user `90da5112c7784592ac2697519e592363`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:05.830874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-4bdd6119-427b-4947-b092-d13e25ecc651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:05.934433 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1018/2048] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:33:05.945597 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c55c59-88bf-4c74-bdbb-96e8d58bac59 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:05.947679 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-83c55c59-88bf-4c74-bdbb-96e8d58bac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:05.961005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1031/2049] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:33:05.974620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd6119-427b-4947-b092-d13e25ecc651 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:05.976194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-4bdd6119-427b-4947-b092-d13e25ecc651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:06.044308 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c55c59-88bf-4c74-bdbb-96e8d58bac59 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:06.048191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd6119-427b-4947-b092-d13e25ecc651 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:06.048336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824bd2b-86d5-4533-8f30-45662f531719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:06.048934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824bd2b-86d5-4533-8f30-45662f531719 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:06.049615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824bd2b-86d5-4533-8f30-45662f531719 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:06.050367 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824bd2b-86d5-4533-8f30-45662f531719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:06.052948 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0a00d-bb75-4a94-bcdc-939e05751b73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:06.053827 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0a00d-bb75-4a94-bcdc-939e05751b73 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:06.054195 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0a00d-bb75-4a94-bcdc-939e05751b73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:06.054665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0a00d-bb75-4a94-bcdc-939e05751b73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:06.060957 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824bd2b-86d5-4533-8f30-45662f531719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:06.063197 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824bd2b-86d5-4533-8f30-45662f531719 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:06.090037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1019/2050] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:33:06.123634 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0a00d-bb75-4a94-bcdc-939e05751b73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:06.125724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0a00d-bb75-4a94-bcdc-939e05751b73 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:06.150290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1032/2051] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:06.887539 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824bd2b-86d5-4533-8f30-45662f531719 service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:06.963835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824bd2b-86d5-4533-8f30-45662f531719 service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:06.968371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0c251-309e-43e6-9cfd-9d708b3d8878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:06.969304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c251-309e-43e6-9cfd-9d708b3d8878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:06.969651 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c251-309e-43e6-9cfd-9d708b3d8878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:06.970105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c251-309e-43e6-9cfd-9d708b3d8878 admin admin] PATH_INFO: `/v3/users/ca0505575b124975bad4dbaf1095b5ab` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:06.971993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0c251-309e-43e6-9cfd-9d708b3d8878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca0505575b124975bad4dbaf1095b5ab)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:06.974073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0c251-309e-43e6-9cfd-9d708b3d8878 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:07.020776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-19d0c251-309e-43e6-9cfd-9d708b3d8878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca0505575b124975bad4dbaf1095b5ab'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:07.027476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-19d0c251-309e-43e6-9cfd-9d708b3d8878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca0505575b124975bad4dbaf1095b5ab'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:07.028157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-19d0c251-309e-43e6-9cfd-9d708b3d8878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca0505575b124975bad4dbaf1095b5ab'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:07.041587 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-19d0c251-309e-43e6-9cfd-9d708b3d8878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca0505575b124975bad4dbaf1095b5ab'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:07.050086 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-19d0c251-309e-43e6-9cfd-9d708b3d8878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca0505575b124975bad4dbaf1095b5ab'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:07.056654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1020/2052] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:06 2022] DELETE /identity/v3/users/ca0505575b124975bad4dbaf1095b5ab => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:07.060904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e22c8-0081-476e-bf3e-fd1296910db4 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:07.061354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e22c8-0081-476e-bf3e-fd1296910db4 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:07.061446 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e22c8-0081-476e-bf3e-fd1296910db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:07.079137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-035e22c8-0081-476e-bf3e-fd1296910db4 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:07.081107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-035e22c8-0081-476e-bf3e-fd1296910db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:07.136791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1033/2053] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:07.146862 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0c251-309e-43e6-9cfd-9d708b3d8878 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:07.148233 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-19d0c251-309e-43e6-9cfd-9d708b3d8878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:07.207043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0c251-309e-43e6-9cfd-9d708b3d8878 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:07.210667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1370fc0-7f22-4d25-865f-97317397bfb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:07.211313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1370fc0-7f22-4d25-865f-97317397bfb7 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:07.211592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1370fc0-7f22-4d25-865f-97317397bfb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:07.211862 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1370fc0-7f22-4d25-865f-97317397bfb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:07.220700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1370fc0-7f22-4d25-865f-97317397bfb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:07.222739 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1370fc0-7f22-4d25-865f-97317397bfb7 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:07.231797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1021/2054] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:33:07.498466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e22c8-0081-476e-bf3e-fd1296910db4 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:07.500096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-035e22c8-0081-476e-bf3e-fd1296910db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:07.512252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e22c8-0081-476e-bf3e-fd1296910db4 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:07.518891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:07.519764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:07.520047 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:07.520325 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c admin admin] PATH_INFO: `/v3/projects/c450ebb058164e419fe818cc16d23ca6` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:07.521643 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c450ebb058164e419fe818cc16d23ca6)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:07.523608 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:07.571302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c450ebb058164e419fe818cc16d23ca6', 'request_id': 'req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:07.577549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c450ebb058164e419fe818cc16d23ca6', 'request_id': 'req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:07.584835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c450ebb058164e419fe818cc16d23ca6', 'request_id': 'req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:07.595902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c admin admin] The token cache is being invalidate because project c450ebb058164e419fe818cc16d23ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:07.597357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:07.598003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:07.599583 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1034/2055] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:07 2022] DELETE /identity/v3/projects/c450ebb058164e419fe818cc16d23ca6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:07.603802 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1370fc0-7f22-4d25-865f-97317397bfb7 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:07.615077 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1370fc0-7f22-4d25-865f-97317397bfb7 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:07.684460 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d56ffc-65d7-49f5-90a7-b77ef706c66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:07.685350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d56ffc-65d7-49f5-90a7-b77ef706c66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:07.685628 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d56ffc-65d7-49f5-90a7-b77ef706c66f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:07.685902 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d56ffc-65d7-49f5-90a7-b77ef706c66f admin admin] PATH_INFO: `/v3/users/d1db6813fc3d4773bc6935588ed72e4a` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:07.687137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d56ffc-65d7-49f5-90a7-b77ef706c66f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1db6813fc3d4773bc6935588ed72e4a)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:07.689095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d56ffc-65d7-49f5-90a7-b77ef706c66f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:07.748485 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-24d56ffc-65d7-49f5-90a7-b77ef706c66f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1db6813fc3d4773bc6935588ed72e4a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:07.757807 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-24d56ffc-65d7-49f5-90a7-b77ef706c66f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1db6813fc3d4773bc6935588ed72e4a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:07.758894 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-24d56ffc-65d7-49f5-90a7-b77ef706c66f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1db6813fc3d4773bc6935588ed72e4a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:07.774328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-24d56ffc-65d7-49f5-90a7-b77ef706c66f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1db6813fc3d4773bc6935588ed72e4a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:07.784697 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-24d56ffc-65d7-49f5-90a7-b77ef706c66f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1db6813fc3d4773bc6935588ed72e4a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:07.795838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1022/2056] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:07 2022] DELETE /identity/v3/users/d1db6813fc3d4773bc6935588ed72e4a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:07.923600 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:07.925896 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:07.994377 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98507797-58e2-4e5b-a4a5-b6eb9cbbc02c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:08.043528 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2eb55-31f3-44c9-90c7-e3da22beca39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:08.044183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2eb55-31f3-44c9-90c7-e3da22beca39 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:08.044462 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2eb55-31f3-44c9-90c7-e3da22beca39 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:08.044734 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2eb55-31f3-44c9-90c7-e3da22beca39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:08.046591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e3c2eb55-31f3-44c9-90c7-e3da22beca39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:08.106648 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2eb55-31f3-44c9-90c7-e3da22beca39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:08.108104 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2eb55-31f3-44c9-90c7-e3da22beca39 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:08.118596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1035/2057] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:08.179810 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d56ffc-65d7-49f5-90a7-b77ef706c66f admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:08.181287 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-24d56ffc-65d7-49f5-90a7-b77ef706c66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:08.264291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d56ffc-65d7-49f5-90a7-b77ef706c66f admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:08.270201 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dbca8-f914-40f7-a59a-9880f43265b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:08.271174 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dbca8-f914-40f7-a59a-9880f43265b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:08.271562 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dbca8-f914-40f7-a59a-9880f43265b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:08.271934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dbca8-f914-40f7-a59a-9880f43265b4 admin admin] PATH_INFO: `/v3/projects/629cb7b7886546c6be284d3c1638bd43` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:08.277569 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dbca8-f914-40f7-a59a-9880f43265b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629cb7b7886546c6be284d3c1638bd43)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:08.279684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17dbca8-f914-40f7-a59a-9880f43265b4 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:08.340039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f17dbca8-f914-40f7-a59a-9880f43265b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629cb7b7886546c6be284d3c1638bd43', 'request_id': 'req-f17dbca8-f914-40f7-a59a-9880f43265b4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:08.346440 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f17dbca8-f914-40f7-a59a-9880f43265b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629cb7b7886546c6be284d3c1638bd43', 'request_id': 'req-f17dbca8-f914-40f7-a59a-9880f43265b4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:08.354291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f17dbca8-f914-40f7-a59a-9880f43265b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629cb7b7886546c6be284d3c1638bd43', 'request_id': 'req-f17dbca8-f914-40f7-a59a-9880f43265b4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:08.367205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f17dbca8-f914-40f7-a59a-9880f43265b4 admin admin] The token cache is being invalidate because project 629cb7b7886546c6be284d3c1638bd43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:08.367478 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f17dbca8-f914-40f7-a59a-9880f43265b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:08.368305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f17dbca8-f914-40f7-a59a-9880f43265b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:08.369853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1023/2058] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:08 2022] DELETE /identity/v3/projects/629cb7b7886546c6be284d3c1638bd43 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:08.375616 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639e699-6ab0-42ed-ac98-850638e8c414 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:08.375928 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639e699-6ab0-42ed-ac98-850638e8c414 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:08.376208 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639e699-6ab0-42ed-ac98-850638e8c414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:08.394205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-9639e699-6ab0-42ed-ac98-850638e8c414 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:08.395629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-9639e699-6ab0-42ed-ac98-850638e8c414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:08.457241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1036/2059] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:08.465897 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1d61-8b64-4c3b-96c6-c40e7c244b8c None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:08.466336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1d61-8b64-4c3b-96c6-c40e7c244b8c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:08.466707 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1d61-8b64-4c3b-96c6-c40e7c244b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:08.486144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-00be1d61-8b64-4c3b-96c6-c40e7c244b8c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:08.487515 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-00be1d61-8b64-4c3b-96c6-c40e7c244b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:08.495338 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1024/2060] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:33:08.499662 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639e699-6ab0-42ed-ac98-850638e8c414 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:08.510268 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639e699-6ab0-42ed-ac98-850638e8c414 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:08.514827 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc082b9-5c43-49a2-90e3-b332bcdf857d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:08.515487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc082b9-5c43-49a2-90e3-b332bcdf857d admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:08.515767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc082b9-5c43-49a2-90e3-b332bcdf857d admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:08.516054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc082b9-5c43-49a2-90e3-b332bcdf857d admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:08.516750 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc082b9-5c43-49a2-90e3-b332bcdf857d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:33:08.517051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc082b9-5c43-49a2-90e3-b332bcdf857d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:08.519442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc082b9-5c43-49a2-90e3-b332bcdf857d admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:08.531446 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1037/2061] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:33:08.536038 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be1d61-8b64-4c3b-96c6-c40e7c244b8c None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:08.546024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be1d61-8b64-4c3b-96c6-c40e7c244b8c None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:08.552557 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5dcce-6e0d-4623-8ea9-5e2a2bb30638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:08.553226 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5dcce-6e0d-4623-8ea9-5e2a2bb30638 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:08.553509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5dcce-6e0d-4623-8ea9-5e2a2bb30638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:08.553783 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5dcce-6e0d-4623-8ea9-5e2a2bb30638 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:08.554546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5dcce-6e0d-4623-8ea9-5e2a2bb30638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:08.556984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5dcce-6e0d-4623-8ea9-5e2a2bb30638 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:08.590374 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1025/2062] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:08 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:08.594823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc082b9-5c43-49a2-90e3-b332bcdf857d admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:08.605616 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc082b9-5c43-49a2-90e3-b332bcdf857d admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:08.666504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a5a28-035d-48f1-9747-47062030d469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:08.667155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a5a28-035d-48f1-9747-47062030d469 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:08.667435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a5a28-035d-48f1-9747-47062030d469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:08.667704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a5a28-035d-48f1-9747-47062030d469 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:08.668418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a5a28-035d-48f1-9747-47062030d469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:08.670547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a5a28-035d-48f1-9747-47062030d469 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:08.691221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1038/2063] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:08 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:08.695543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5dcce-6e0d-4623-8ea9-5e2a2bb30638 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:08.708136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5dcce-6e0d-4623-8ea9-5e2a2bb30638 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:08.713021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41687e-e696-4864-9607-019be8169e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:08.713685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41687e-e696-4864-9607-019be8169e3b admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:08.713972 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41687e-e696-4864-9607-019be8169e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:08.714354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41687e-e696-4864-9607-019be8169e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:08.715090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41687e-e696-4864-9607-019be8169e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:08.716696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41687e-e696-4864-9607-019be8169e3b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:08.746019 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1026/2064] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:08.749986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a5a28-035d-48f1-9747-47062030d469 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:08.764192 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a5a28-035d-48f1-9747-47062030d469 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:08.770892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133058c1-2efd-4e03-af4c-9c78000d689f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:08.771834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133058c1-2efd-4e03-af4c-9c78000d689f admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:08.772300 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133058c1-2efd-4e03-af4c-9c78000d689f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:08.772785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133058c1-2efd-4e03-af4c-9c78000d689f admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:08.773977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133058c1-2efd-4e03-af4c-9c78000d689f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:08.776849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133058c1-2efd-4e03-af4c-9c78000d689f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:08.797675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1039/2065] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:33:08.798629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41687e-e696-4864-9607-019be8169e3b admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:08.809342 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41687e-e696-4864-9607-019be8169e3b admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:08.815118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5062dc-d70d-4d9c-83a3-050c0c217dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:08.816075 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5062dc-d70d-4d9c-83a3-050c0c217dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:08.816364 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5062dc-d70d-4d9c-83a3-050c0c217dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:08.816652 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5062dc-d70d-4d9c-83a3-050c0c217dd4 admin admin] PATH_INFO: `/v3/projects/917e8d65a8a04a14856ab1c1c73f7f46/users/55983f08b7234c5ab54a6e1b6fe5139e/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:08.819198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133058c1-2efd-4e03-af4c-9c78000d689f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:08.821238 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-133058c1-2efd-4e03-af4c-9c78000d689f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:08.843812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5062dc-d70d-4d9c-83a3-050c0c217dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917e8d65a8a04a14856ab1c1c73f7f46, user_id=55983f08b7234c5ab54a6e1b6fe5139e, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:08.847527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5062dc-d70d-4d9c-83a3-050c0c217dd4 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:08.872268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1027/2066] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:08 2022] PUT /identity/v3/projects/917e8d65a8a04a14856ab1c1c73f7f46/users/55983f08b7234c5ab54a6e1b6fe5139e/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:08.883620 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c0a83-1a48-4665-8237-dde708fd17f8 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:08.883920 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c0a83-1a48-4665-8237-dde708fd17f8 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:08.884884 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c0a83-1a48-4665-8237-dde708fd17f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:08.904042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133058c1-2efd-4e03-af4c-9c78000d689f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:08.915610 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-753c0a83-1a48-4665-8237-dde708fd17f8 None None] MFA Rules not processed for user `55983f08b7234c5ab54a6e1b6fe5139e`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:08.917219 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-753c0a83-1a48-4665-8237-dde708fd17f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:08.978265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11db20c-3086-442b-bf60-500d7c005a63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:08.979288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11db20c-3086-442b-bf60-500d7c005a63 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:08.979795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11db20c-3086-442b-bf60-500d7c005a63 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:08.980326 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11db20c-3086-442b-bf60-500d7c005a63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:08.984844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a11db20c-3086-442b-bf60-500d7c005a63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:09.075514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1028/2067] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:09.097563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c0a83-1a48-4665-8237-dde708fd17f8 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:09.100190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-753c0a83-1a48-4665-8237-dde708fd17f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:09.128018 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c0a83-1a48-4665-8237-dde708fd17f8 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:09.131992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11db20c-3086-442b-bf60-500d7c005a63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:09.134018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11db20c-3086-442b-bf60-500d7c005a63 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:09.140469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058cecd-9f73-4700-a792-505bbb943cd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:09.141274 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058cecd-9f73-4700-a792-505bbb943cd1 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:09.141656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058cecd-9f73-4700-a792-505bbb943cd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:09.142026 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058cecd-9f73-4700-a792-505bbb943cd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:09.161401 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1040/2068] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:33:09.163233 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058cecd-9f73-4700-a792-505bbb943cd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:09.164933 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058cecd-9f73-4700-a792-505bbb943cd1 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:09.176791 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1029/2069] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:09.207610 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11db20c-3086-442b-bf60-500d7c005a63 service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:09.313892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11db20c-3086-442b-bf60-500d7c005a63 service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:09.319719 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdac26-55fc-489e-b566-41d31a46f59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:09.320931 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdac26-55fc-489e-b566-41d31a46f59c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:09.321360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdac26-55fc-489e-b566-41d31a46f59c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:09.321900 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdac26-55fc-489e-b566-41d31a46f59c admin admin] PATH_INFO: `/v3/users/55983f08b7234c5ab54a6e1b6fe5139e` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:09.323526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdac26-55fc-489e-b566-41d31a46f59c admin admin] RBAC: Authorizing `identity:delete_user(user_id=55983f08b7234c5ab54a6e1b6fe5139e)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:09.337552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdac26-55fc-489e-b566-41d31a46f59c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:09.402618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e1bdac26-55fc-489e-b566-41d31a46f59c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55983f08b7234c5ab54a6e1b6fe5139e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:09.412677 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e1bdac26-55fc-489e-b566-41d31a46f59c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55983f08b7234c5ab54a6e1b6fe5139e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:09.413432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e1bdac26-55fc-489e-b566-41d31a46f59c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55983f08b7234c5ab54a6e1b6fe5139e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:09.426277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e1bdac26-55fc-489e-b566-41d31a46f59c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55983f08b7234c5ab54a6e1b6fe5139e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:09.434282 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e1bdac26-55fc-489e-b566-41d31a46f59c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55983f08b7234c5ab54a6e1b6fe5139e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:09.441914 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1041/2070] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:09 2022] DELETE /identity/v3/users/55983f08b7234c5ab54a6e1b6fe5139e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:09.446406 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cc2a7-5f83-4386-a15b-2262392b442c None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:09.446871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cc2a7-5f83-4386-a15b-2262392b442c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:09.446964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cc2a7-5f83-4386-a15b-2262392b442c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:09.467534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-e13cc2a7-5f83-4386-a15b-2262392b442c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:09.468795 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e13cc2a7-5f83-4386-a15b-2262392b442c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:09.538519 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1030/2071] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:33:09.550396 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdac26-55fc-489e-b566-41d31a46f59c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:09.552134 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e1bdac26-55fc-489e-b566-41d31a46f59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:09.629328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdac26-55fc-489e-b566-41d31a46f59c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:09.633858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ce402-ef45-4501-808a-f1eb67df6967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:09.634827 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ce402-ef45-4501-808a-f1eb67df6967 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:09.635398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ce402-ef45-4501-808a-f1eb67df6967 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:09.635711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ce402-ef45-4501-808a-f1eb67df6967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:09.646968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ce402-ef45-4501-808a-f1eb67df6967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:09.648465 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ce402-ef45-4501-808a-f1eb67df6967 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:09.660415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1042/2072] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:10.011681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cc2a7-5f83-4386-a15b-2262392b442c None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:10.013201 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e13cc2a7-5f83-4386-a15b-2262392b442c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:10.027135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cc2a7-5f83-4386-a15b-2262392b442c None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:10.031818 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f447f-4b57-479a-a856-defa197302db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:10.033216 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f447f-4b57-479a-a856-defa197302db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:10.033789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f447f-4b57-479a-a856-defa197302db admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:10.034102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f447f-4b57-479a-a856-defa197302db admin admin] PATH_INFO: `/v3/projects/917e8d65a8a04a14856ab1c1c73f7f46` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:10.035368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f447f-4b57-479a-a856-defa197302db admin admin] RBAC: Authorizing `identity:delete_project(project_id=917e8d65a8a04a14856ab1c1c73f7f46)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:10.037305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f447f-4b57-479a-a856-defa197302db admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:10.085471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-341f447f-4b57-479a-a856-defa197302db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917e8d65a8a04a14856ab1c1c73f7f46', 'request_id': 'req-341f447f-4b57-479a-a856-defa197302db'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:10.091661 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-341f447f-4b57-479a-a856-defa197302db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917e8d65a8a04a14856ab1c1c73f7f46', 'request_id': 'req-341f447f-4b57-479a-a856-defa197302db'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:10.098903 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-341f447f-4b57-479a-a856-defa197302db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917e8d65a8a04a14856ab1c1c73f7f46', 'request_id': 'req-341f447f-4b57-479a-a856-defa197302db'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:10.109284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-341f447f-4b57-479a-a856-defa197302db admin admin] The token cache is being invalidate because project 917e8d65a8a04a14856ab1c1c73f7f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:10.109574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-341f447f-4b57-479a-a856-defa197302db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:10.110252 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-341f447f-4b57-479a-a856-defa197302db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:10.112351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1031/2073] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:10 2022] DELETE /identity/v3/projects/917e8d65a8a04a14856ab1c1c73f7f46 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:10.117443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72564209-25d2-4d3b-986d-11d045b47adb None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:10.117756 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72564209-25d2-4d3b-986d-11d045b47adb None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:10.118035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72564209-25d2-4d3b-986d-11d045b47adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:10.135775 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-72564209-25d2-4d3b-986d-11d045b47adb None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:10.136969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-72564209-25d2-4d3b-986d-11d045b47adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:10.195084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1043/2074] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:10.203091 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203bbb9-646c-48d5-b42e-8a9c0d0631b2 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:10.203386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203bbb9-646c-48d5-b42e-8a9c0d0631b2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:10.203670 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203bbb9-646c-48d5-b42e-8a9c0d0631b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:10.221835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-9203bbb9-646c-48d5-b42e-8a9c0d0631b2 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:10.223064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-9203bbb9-646c-48d5-b42e-8a9c0d0631b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:10.230983 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1032/2075] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:10.235027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72564209-25d2-4d3b-986d-11d045b47adb None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:10.245248 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72564209-25d2-4d3b-986d-11d045b47adb None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:10.249776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f3ce7-11d0-479b-8ac3-e1b33d6e5395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:10.250462 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3ce7-11d0-479b-8ac3-e1b33d6e5395 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:10.250746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3ce7-11d0-479b-8ac3-e1b33d6e5395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:10.251025 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3ce7-11d0-479b-8ac3-e1b33d6e5395 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:10.251752 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f3ce7-11d0-479b-8ac3-e1b33d6e5395 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:33:10.252060 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f3ce7-11d0-479b-8ac3-e1b33d6e5395 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:10.254541 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f3ce7-11d0-479b-8ac3-e1b33d6e5395 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:10.266028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1044/2076] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:33:10.270287 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203bbb9-646c-48d5-b42e-8a9c0d0631b2 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:10.279395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203bbb9-646c-48d5-b42e-8a9c0d0631b2 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:10.284096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4190cb-2c0e-471e-bced-3aa72f59b7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:10.284734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4190cb-2c0e-471e-bced-3aa72f59b7ff admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:10.285024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4190cb-2c0e-471e-bced-3aa72f59b7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:10.285302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4190cb-2c0e-471e-bced-3aa72f59b7ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:10.286033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4190cb-2c0e-471e-bced-3aa72f59b7ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:10.287985 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4190cb-2c0e-471e-bced-3aa72f59b7ff admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:10.313056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1033/2077] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:10 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:10.317307 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f3ce7-11d0-479b-8ac3-e1b33d6e5395 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:10.327472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f3ce7-11d0-479b-8ac3-e1b33d6e5395 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:10.386068 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cda27-0483-4560-b89c-1297cc3c23d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:10.386923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cda27-0483-4560-b89c-1297cc3c23d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:10.387466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cda27-0483-4560-b89c-1297cc3c23d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:10.387820 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cda27-0483-4560-b89c-1297cc3c23d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:10.388590 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cda27-0483-4560-b89c-1297cc3c23d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:10.390622 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cda27-0483-4560-b89c-1297cc3c23d6 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:10.412356 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1045/2078] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:10 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:10.416506 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4190cb-2c0e-471e-bced-3aa72f59b7ff admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:10.437184 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4190cb-2c0e-471e-bced-3aa72f59b7ff admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:10.444625 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a74aa-28c0-4635-a1a2-1eb9720d18db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:10.445589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a74aa-28c0-4635-a1a2-1eb9720d18db admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:10.446783 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a74aa-28c0-4635-a1a2-1eb9720d18db admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:10.447685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a74aa-28c0-4635-a1a2-1eb9720d18db admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:10.448739 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a74aa-28c0-4635-a1a2-1eb9720d18db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:10.452372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a74aa-28c0-4635-a1a2-1eb9720d18db admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:10.467159 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1034/2079] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:10.470722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cda27-0483-4560-b89c-1297cc3c23d6 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:10.489903 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cda27-0483-4560-b89c-1297cc3c23d6 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:10.496627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f7ea6-f325-495d-8a9f-6b2fa12104be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:10.497513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f7ea6-f325-495d-8a9f-6b2fa12104be admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:10.497954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f7ea6-f325-495d-8a9f-6b2fa12104be admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:10.498646 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f7ea6-f325-495d-8a9f-6b2fa12104be admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:10.500014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f7ea6-f325-495d-8a9f-6b2fa12104be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:10.504405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f7ea6-f325-495d-8a9f-6b2fa12104be admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:10.529761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1046/2080] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:10.531442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a74aa-28c0-4635-a1a2-1eb9720d18db admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:10.548771 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a74aa-28c0-4635-a1a2-1eb9720d18db admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:10.554045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6936e8-1a98-4122-8577-48ae6aeda120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:10.555033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6936e8-1a98-4122-8577-48ae6aeda120 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:10.555358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6936e8-1a98-4122-8577-48ae6aeda120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:10.555646 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6936e8-1a98-4122-8577-48ae6aeda120 admin admin] PATH_INFO: `/v3/projects/b95ef48c8e9f4b09b58bf8b91d4d4f50/users/d3de9a589be94c1bbc3916bf132b5205/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:10.583840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6936e8-1a98-4122-8577-48ae6aeda120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95ef48c8e9f4b09b58bf8b91d4d4f50, user_id=d3de9a589be94c1bbc3916bf132b5205, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:10.586606 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6936e8-1a98-4122-8577-48ae6aeda120 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:10.603853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1035/2081] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:10 2022] PUT /identity/v3/projects/b95ef48c8e9f4b09b58bf8b91d4d4f50/users/d3de9a589be94c1bbc3916bf132b5205/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:33:10.617526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688da56-780e-4f7b-82d4-941640671f95 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:10.617942 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688da56-780e-4f7b-82d4-941640671f95 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:10.618403 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688da56-780e-4f7b-82d4-941640671f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:10.647606 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-0688da56-780e-4f7b-82d4-941640671f95 None None] MFA Rules not processed for user `d3de9a589be94c1bbc3916bf132b5205`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:10.648889 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-0688da56-780e-4f7b-82d4-941640671f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:10.726326 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1047/2082] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:10.735314 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6936e8-1a98-4122-8577-48ae6aeda120 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:10.737271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1b6936e8-1a98-4122-8577-48ae6aeda120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:10.793504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6936e8-1a98-4122-8577-48ae6aeda120 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:10.797299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af464d2-d2c8-404d-bbcc-cf5589feeb9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:10.797941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af464d2-d2c8-404d-bbcc-cf5589feeb9e service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:10.798266 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af464d2-d2c8-404d-bbcc-cf5589feeb9e service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:10.798547 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af464d2-d2c8-404d-bbcc-cf5589feeb9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:10.807441 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af464d2-d2c8-404d-bbcc-cf5589feeb9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:10.808951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af464d2-d2c8-404d-bbcc-cf5589feeb9e service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:10.818498 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1036/2083] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:10.839082 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688da56-780e-4f7b-82d4-941640671f95 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:10.898987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688da56-780e-4f7b-82d4-941640671f95 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:10.903524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baeeadf-6d15-44d7-9b1d-1984059e2a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:10.904363 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeeadf-6d15-44d7-9b1d-1984059e2a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:10.904638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeeadf-6d15-44d7-9b1d-1984059e2a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:10.904909 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeeadf-6d15-44d7-9b1d-1984059e2a10 admin admin] PATH_INFO: `/v3/users/d3de9a589be94c1bbc3916bf132b5205` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:10.906086 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baeeadf-6d15-44d7-9b1d-1984059e2a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3de9a589be94c1bbc3916bf132b5205)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:10.908034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baeeadf-6d15-44d7-9b1d-1984059e2a10 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:10.953338 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3baeeadf-6d15-44d7-9b1d-1984059e2a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3de9a589be94c1bbc3916bf132b5205'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:10.959970 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3baeeadf-6d15-44d7-9b1d-1984059e2a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3de9a589be94c1bbc3916bf132b5205'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:10.960646 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3baeeadf-6d15-44d7-9b1d-1984059e2a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3de9a589be94c1bbc3916bf132b5205'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:10.971940 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3baeeadf-6d15-44d7-9b1d-1984059e2a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3de9a589be94c1bbc3916bf132b5205'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:10.978522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3baeeadf-6d15-44d7-9b1d-1984059e2a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3de9a589be94c1bbc3916bf132b5205'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:10.984516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1048/2084] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:10 2022] DELETE /identity/v3/users/d3de9a589be94c1bbc3916bf132b5205 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:10.989710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435f637-93ea-45fa-a223-1d5a2a0142ae None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:10.989998 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435f637-93ea-45fa-a223-1d5a2a0142ae None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:10.990303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435f637-93ea-45fa-a223-1d5a2a0142ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:11.008144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-c435f637-93ea-45fa-a223-1d5a2a0142ae None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:11.009341 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c435f637-93ea-45fa-a223-1d5a2a0142ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:11.068261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1037/2085] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:11.078008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baeeadf-6d15-44d7-9b1d-1984059e2a10 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:11.079519 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-3baeeadf-6d15-44d7-9b1d-1984059e2a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:11.136035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baeeadf-6d15-44d7-9b1d-1984059e2a10 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:11.139819 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c01fa7-1757-4294-a631-2d5e8a05c8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:11.140463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c01fa7-1757-4294-a631-2d5e8a05c8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:11.140748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c01fa7-1757-4294-a631-2d5e8a05c8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:11.141025 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c01fa7-1757-4294-a631-2d5e8a05c8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:11.150481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c01fa7-1757-4294-a631-2d5e8a05c8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:11.151930 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c01fa7-1757-4294-a631-2d5e8a05c8a1 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:11.162319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1049/2086] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:33:11.419442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435f637-93ea-45fa-a223-1d5a2a0142ae None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:11.420950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c435f637-93ea-45fa-a223-1d5a2a0142ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:11.435491 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435f637-93ea-45fa-a223-1d5a2a0142ae None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:11.440530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187988e-13e4-4ca5-a174-e7a783551be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:11.441495 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187988e-13e4-4ca5-a174-e7a783551be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:11.441778 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187988e-13e4-4ca5-a174-e7a783551be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:11.442055 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187988e-13e4-4ca5-a174-e7a783551be7 admin admin] PATH_INFO: `/v3/projects/b95ef48c8e9f4b09b58bf8b91d4d4f50` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:11.443311 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187988e-13e4-4ca5-a174-e7a783551be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95ef48c8e9f4b09b58bf8b91d4d4f50)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:11.445308 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187988e-13e4-4ca5-a174-e7a783551be7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:11.492585 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8187988e-13e4-4ca5-a174-e7a783551be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95ef48c8e9f4b09b58bf8b91d4d4f50', 'request_id': 'req-8187988e-13e4-4ca5-a174-e7a783551be7'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:11.498832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8187988e-13e4-4ca5-a174-e7a783551be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95ef48c8e9f4b09b58bf8b91d4d4f50', 'request_id': 'req-8187988e-13e4-4ca5-a174-e7a783551be7'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:11.506415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8187988e-13e4-4ca5-a174-e7a783551be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95ef48c8e9f4b09b58bf8b91d4d4f50', 'request_id': 'req-8187988e-13e4-4ca5-a174-e7a783551be7'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:11.516599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8187988e-13e4-4ca5-a174-e7a783551be7 admin admin] The token cache is being invalidate because project b95ef48c8e9f4b09b58bf8b91d4d4f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:11.516889 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8187988e-13e4-4ca5-a174-e7a783551be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:11.517512 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8187988e-13e4-4ca5-a174-e7a783551be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:11.519904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1038/2087] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:11 2022] DELETE /identity/v3/projects/b95ef48c8e9f4b09b58bf8b91d4d4f50 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:13.140664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c01fa7-1757-4294-a631-2d5e8a05c8a1 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:13.142057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-82c01fa7-1757-4294-a631-2d5e8a05c8a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:13.154830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c01fa7-1757-4294-a631-2d5e8a05c8a1 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:13.215429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dc819-c586-49d9-9458-d4dd2010115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:13.216302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dc819-c586-49d9-9458-d4dd2010115b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:13.216581 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dc819-c586-49d9-9458-d4dd2010115b admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:13.216853 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dc819-c586-49d9-9458-d4dd2010115b admin admin] PATH_INFO: `/v3/users/bee5ea9fc5054f4fb725ce43883f453e` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:13.218047 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51dc819-c586-49d9-9458-d4dd2010115b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee5ea9fc5054f4fb725ce43883f453e)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:13.220022 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51dc819-c586-49d9-9458-d4dd2010115b admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:13.266266 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c51dc819-c586-49d9-9458-d4dd2010115b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee5ea9fc5054f4fb725ce43883f453e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:13.273843 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c51dc819-c586-49d9-9458-d4dd2010115b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee5ea9fc5054f4fb725ce43883f453e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:13.274483 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c51dc819-c586-49d9-9458-d4dd2010115b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee5ea9fc5054f4fb725ce43883f453e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:13.286188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c51dc819-c586-49d9-9458-d4dd2010115b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee5ea9fc5054f4fb725ce43883f453e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:13.292923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c51dc819-c586-49d9-9458-d4dd2010115b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee5ea9fc5054f4fb725ce43883f453e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:13.299357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1050/2088] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:13 2022] DELETE /identity/v3/users/bee5ea9fc5054f4fb725ce43883f453e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:13.303798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca202ab9-a778-42a4-9600-3e6f2db87c75 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:13.304289 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca202ab9-a778-42a4-9600-3e6f2db87c75 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:13.304414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca202ab9-a778-42a4-9600-3e6f2db87c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:13.322572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-ca202ab9-a778-42a4-9600-3e6f2db87c75 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:13.323756 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ca202ab9-a778-42a4-9600-3e6f2db87c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:13.395808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1039/2089] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:13.406665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dc819-c586-49d9-9458-d4dd2010115b admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:13.408938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c51dc819-c586-49d9-9458-d4dd2010115b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:13.479723 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dc819-c586-49d9-9458-d4dd2010115b admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:13.483463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d354170-c0e2-430a-99d0-87f043d60338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:13.484244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d354170-c0e2-430a-99d0-87f043d60338 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:13.484529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d354170-c0e2-430a-99d0-87f043d60338 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:13.484920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d354170-c0e2-430a-99d0-87f043d60338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:13.496208 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d354170-c0e2-430a-99d0-87f043d60338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:13.497711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d354170-c0e2-430a-99d0-87f043d60338 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:13.508588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1051/2090] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:13.792007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca202ab9-a778-42a4-9600-3e6f2db87c75 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:13.793882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ca202ab9-a778-42a4-9600-3e6f2db87c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:13.808909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca202ab9-a778-42a4-9600-3e6f2db87c75 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:13.813559 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366edce0-492d-4a05-a4ee-409a82d5bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:13.814497 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366edce0-492d-4a05-a4ee-409a82d5bb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:13.815931 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366edce0-492d-4a05-a4ee-409a82d5bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:13.816233 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366edce0-492d-4a05-a4ee-409a82d5bb2b admin admin] PATH_INFO: `/v3/projects/12d8501bd82446ffa9232a4e108593fd` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:13.817589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366edce0-492d-4a05-a4ee-409a82d5bb2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d8501bd82446ffa9232a4e108593fd)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:13.819450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366edce0-492d-4a05-a4ee-409a82d5bb2b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:13.874852 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-366edce0-492d-4a05-a4ee-409a82d5bb2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d8501bd82446ffa9232a4e108593fd', 'request_id': 'req-366edce0-492d-4a05-a4ee-409a82d5bb2b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:13.882418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-366edce0-492d-4a05-a4ee-409a82d5bb2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d8501bd82446ffa9232a4e108593fd', 'request_id': 'req-366edce0-492d-4a05-a4ee-409a82d5bb2b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:13.892517 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-366edce0-492d-4a05-a4ee-409a82d5bb2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d8501bd82446ffa9232a4e108593fd', 'request_id': 'req-366edce0-492d-4a05-a4ee-409a82d5bb2b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:13.903984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-366edce0-492d-4a05-a4ee-409a82d5bb2b admin admin] The token cache is being invalidate because project 12d8501bd82446ffa9232a4e108593fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:13.904283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-366edce0-492d-4a05-a4ee-409a82d5bb2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:13.904923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-366edce0-492d-4a05-a4ee-409a82d5bb2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:13.906593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1040/2091] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:13 2022] DELETE /identity/v3/projects/12d8501bd82446ffa9232a4e108593fd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:13.911805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d354170-c0e2-430a-99d0-87f043d60338 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:13.921877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d354170-c0e2-430a-99d0-87f043d60338 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:13.988632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56bc91-8430-4833-92e9-7e84d5facf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:13.990384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56bc91-8430-4833-92e9-7e84d5facf2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:13.990992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56bc91-8430-4833-92e9-7e84d5facf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:13.991410 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56bc91-8430-4833-92e9-7e84d5facf2e admin admin] PATH_INFO: `/v3/users/9f800bca0ab34e5794a0a586b11312e1` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:13.992803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56bc91-8430-4833-92e9-7e84d5facf2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f800bca0ab34e5794a0a586b11312e1)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:13.994898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56bc91-8430-4833-92e9-7e84d5facf2e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:14.056863 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4b56bc91-8430-4833-92e9-7e84d5facf2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f800bca0ab34e5794a0a586b11312e1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:14.067175 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4b56bc91-8430-4833-92e9-7e84d5facf2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f800bca0ab34e5794a0a586b11312e1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:14.067812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4b56bc91-8430-4833-92e9-7e84d5facf2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f800bca0ab34e5794a0a586b11312e1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:14.087177 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4b56bc91-8430-4833-92e9-7e84d5facf2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f800bca0ab34e5794a0a586b11312e1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:14.094545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4b56bc91-8430-4833-92e9-7e84d5facf2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f800bca0ab34e5794a0a586b11312e1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:14.102389 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1052/2092] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:13 2022] DELETE /identity/v3/users/9f800bca0ab34e5794a0a586b11312e1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:14.649648 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366edce0-492d-4a05-a4ee-409a82d5bb2b admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:14.651190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-366edce0-492d-4a05-a4ee-409a82d5bb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:14.664467 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366edce0-492d-4a05-a4ee-409a82d5bb2b admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:14.725979 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e6c23-b0d1-4e50-9737-8f5361b03e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:14.726917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e6c23-b0d1-4e50-9737-8f5361b03e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:14.727202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e6c23-b0d1-4e50-9737-8f5361b03e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:14.727481 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e6c23-b0d1-4e50-9737-8f5361b03e93 admin admin] PATH_INFO: `/v3/projects/8d6b312b380043debd9abb8556c00f37` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:14.728710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e6c23-b0d1-4e50-9737-8f5361b03e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6b312b380043debd9abb8556c00f37)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:14.730674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e6c23-b0d1-4e50-9737-8f5361b03e93 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:14.776199 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-992e6c23-b0d1-4e50-9737-8f5361b03e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6b312b380043debd9abb8556c00f37', 'request_id': 'req-992e6c23-b0d1-4e50-9737-8f5361b03e93'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:14.782162 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-992e6c23-b0d1-4e50-9737-8f5361b03e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6b312b380043debd9abb8556c00f37', 'request_id': 'req-992e6c23-b0d1-4e50-9737-8f5361b03e93'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:14.789701 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-992e6c23-b0d1-4e50-9737-8f5361b03e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6b312b380043debd9abb8556c00f37', 'request_id': 'req-992e6c23-b0d1-4e50-9737-8f5361b03e93'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:14.799636 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-992e6c23-b0d1-4e50-9737-8f5361b03e93 admin admin] The token cache is being invalidate because project 8d6b312b380043debd9abb8556c00f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:14.799918 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-992e6c23-b0d1-4e50-9737-8f5361b03e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:14.800546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-992e6c23-b0d1-4e50-9737-8f5361b03e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:14.802102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1041/2093] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:14 2022] DELETE /identity/v3/projects/8d6b312b380043debd9abb8556c00f37 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:14.805972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56bc91-8430-4833-92e9-7e84d5facf2e admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:14.807443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-4b56bc91-8430-4833-92e9-7e84d5facf2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:14.820104 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56bc91-8430-4833-92e9-7e84d5facf2e admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:14.875010 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34e4c1-f63e-4042-acd6-3da61bdcf2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:14.875872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34e4c1-f63e-4042-acd6-3da61bdcf2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:14.876151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34e4c1-f63e-4042-acd6-3da61bdcf2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:14.876428 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34e4c1-f63e-4042-acd6-3da61bdcf2ac admin admin] PATH_INFO: `/v3/users/90da5112c7784592ac2697519e592363` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:14.878612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34e4c1-f63e-4042-acd6-3da61bdcf2ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=90da5112c7784592ac2697519e592363)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:14.880546 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34e4c1-f63e-4042-acd6-3da61bdcf2ac admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:14.924340 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9e34e4c1-f63e-4042-acd6-3da61bdcf2ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90da5112c7784592ac2697519e592363'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:14.932144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9e34e4c1-f63e-4042-acd6-3da61bdcf2ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90da5112c7784592ac2697519e592363'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:14.932805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9e34e4c1-f63e-4042-acd6-3da61bdcf2ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90da5112c7784592ac2697519e592363'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:14.944820 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9e34e4c1-f63e-4042-acd6-3da61bdcf2ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90da5112c7784592ac2697519e592363'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:14.951659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9e34e4c1-f63e-4042-acd6-3da61bdcf2ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90da5112c7784592ac2697519e592363'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:14.958209 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1053/2094] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:14 2022] DELETE /identity/v3/users/90da5112c7784592ac2697519e592363 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:15.235207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e6c23-b0d1-4e50-9737-8f5361b03e93 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:15.237672 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-992e6c23-b0d1-4e50-9737-8f5361b03e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:15.262727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e6c23-b0d1-4e50-9737-8f5361b03e93 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:15.333921 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fd75a-aa7c-4b12-9479-1d43437fc02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:15.334811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fd75a-aa7c-4b12-9479-1d43437fc02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:15.335092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fd75a-aa7c-4b12-9479-1d43437fc02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:15.335359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fd75a-aa7c-4b12-9479-1d43437fc02e admin admin] PATH_INFO: `/v3/projects/35f1471c305b41b9986bd382a954dff8` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:15.336649 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fd75a-aa7c-4b12-9479-1d43437fc02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f1471c305b41b9986bd382a954dff8)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:15.338631 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fd75a-aa7c-4b12-9479-1d43437fc02e admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:15.385998 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e61fd75a-aa7c-4b12-9479-1d43437fc02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f1471c305b41b9986bd382a954dff8', 'request_id': 'req-e61fd75a-aa7c-4b12-9479-1d43437fc02e'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:15.392080 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e61fd75a-aa7c-4b12-9479-1d43437fc02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f1471c305b41b9986bd382a954dff8', 'request_id': 'req-e61fd75a-aa7c-4b12-9479-1d43437fc02e'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:15.399291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e61fd75a-aa7c-4b12-9479-1d43437fc02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f1471c305b41b9986bd382a954dff8', 'request_id': 'req-e61fd75a-aa7c-4b12-9479-1d43437fc02e'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:15.410540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e61fd75a-aa7c-4b12-9479-1d43437fc02e admin admin] The token cache is being invalidate because project 35f1471c305b41b9986bd382a954dff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:15.410826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e61fd75a-aa7c-4b12-9479-1d43437fc02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:15.411473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-e61fd75a-aa7c-4b12-9479-1d43437fc02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:15.413011 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1042/2095] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:15 2022] DELETE /identity/v3/projects/35f1471c305b41b9986bd382a954dff8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:15.417994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8141e57-cef3-4cad-9bf0-6702c0414218 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:15.418320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8141e57-cef3-4cad-9bf0-6702c0414218 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:15.418600 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8141e57-cef3-4cad-9bf0-6702c0414218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:15.437113 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-e8141e57-cef3-4cad-9bf0-6702c0414218 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:15.438342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e8141e57-cef3-4cad-9bf0-6702c0414218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:15.496189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1054/2096] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:15.504984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75dd59-3e7b-4f71-8406-3d89e783f753 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:15.505268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75dd59-3e7b-4f71-8406-3d89e783f753 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:15.505545 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75dd59-3e7b-4f71-8406-3d89e783f753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:15.524134 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-6d75dd59-3e7b-4f71-8406-3d89e783f753 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:15.525313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6d75dd59-3e7b-4f71-8406-3d89e783f753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:15.533160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1043/2097] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:15.538091 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8141e57-cef3-4cad-9bf0-6702c0414218 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:15.554744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8141e57-cef3-4cad-9bf0-6702c0414218 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:15.559366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4673c0d-e5b6-48ea-bd45-a3cca2848e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:15.560018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4673c0d-e5b6-48ea-bd45-a3cca2848e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:15.560299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4673c0d-e5b6-48ea-bd45-a3cca2848e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:15.560578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4673c0d-e5b6-48ea-bd45-a3cca2848e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:15.561296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4673c0d-e5b6-48ea-bd45-a3cca2848e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:33:15.561602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4673c0d-e5b6-48ea-bd45-a3cca2848e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:15.563259 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4673c0d-e5b6-48ea-bd45-a3cca2848e76 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:15.574711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1055/2098] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:33:15.579207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75dd59-3e7b-4f71-8406-3d89e783f753 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:15.588991 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75dd59-3e7b-4f71-8406-3d89e783f753 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:15.594631 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcae51-3591-4540-a8eb-affe243c8404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:15.595306 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcae51-3591-4540-a8eb-affe243c8404 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:15.595586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcae51-3591-4540-a8eb-affe243c8404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:15.596614 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcae51-3591-4540-a8eb-affe243c8404 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:15.597315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcae51-3591-4540-a8eb-affe243c8404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:15.599283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcae51-3591-4540-a8eb-affe243c8404 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:15.623598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1044/2099] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:15 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:15.628207 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4673c0d-e5b6-48ea-bd45-a3cca2848e76 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:15.638112 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4673c0d-e5b6-48ea-bd45-a3cca2848e76 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:15.694701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6593d-5781-4840-bce6-b46b7b5d3c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:15.695378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6593d-5781-4840-bce6-b46b7b5d3c47 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:15.695694 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6593d-5781-4840-bce6-b46b7b5d3c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:15.695976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6593d-5781-4840-bce6-b46b7b5d3c47 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:15.696671 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6593d-5781-4840-bce6-b46b7b5d3c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:15.698700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6593d-5781-4840-bce6-b46b7b5d3c47 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:15.719155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1056/2100] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:15 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:15.722800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcae51-3591-4540-a8eb-affe243c8404 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:15.734528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcae51-3591-4540-a8eb-affe243c8404 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:15.740941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07439b1e-f447-4a08-9bfa-16fd5c3069a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:15.742685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07439b1e-f447-4a08-9bfa-16fd5c3069a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:15.743154 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07439b1e-f447-4a08-9bfa-16fd5c3069a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:15.743154 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07439b1e-f447-4a08-9bfa-16fd5c3069a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:15.743883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07439b1e-f447-4a08-9bfa-16fd5c3069a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:15.745519 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07439b1e-f447-4a08-9bfa-16fd5c3069a2 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:15.762625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6593d-5781-4840-bce6-b46b7b5d3c47 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:15.762960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1045/2101] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:15.775393 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6593d-5781-4840-bce6-b46b7b5d3c47 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:15.780447 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728df00-418d-4466-80ee-677ef1bd1884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:15.781109 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728df00-418d-4466-80ee-677ef1bd1884 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:15.781393 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728df00-418d-4466-80ee-677ef1bd1884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:15.781670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728df00-418d-4466-80ee-677ef1bd1884 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:15.782435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728df00-418d-4466-80ee-677ef1bd1884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:15.784598 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728df00-418d-4466-80ee-677ef1bd1884 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:15.796083 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1057/2102] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:15.800131 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07439b1e-f447-4a08-9bfa-16fd5c3069a2 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:15.810547 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07439b1e-f447-4a08-9bfa-16fd5c3069a2 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:15.817435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d457d92-f65e-4761-89ef-30fe316e10f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:15.818427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d457d92-f65e-4761-89ef-30fe316e10f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:15.818713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d457d92-f65e-4761-89ef-30fe316e10f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:15.818993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d457d92-f65e-4761-89ef-30fe316e10f8 admin admin] PATH_INFO: `/v3/projects/68d4fe680eb142d68362e8c4b9135a86/users/0dcb8c8b6df94a778327294839cc74d6/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:15.835272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d457d92-f65e-4761-89ef-30fe316e10f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d4fe680eb142d68362e8c4b9135a86, user_id=0dcb8c8b6df94a778327294839cc74d6, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:15.838134 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d457d92-f65e-4761-89ef-30fe316e10f8 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:15.854079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1046/2103] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:15 2022] PUT /identity/v3/projects/68d4fe680eb142d68362e8c4b9135a86/users/0dcb8c8b6df94a778327294839cc74d6/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:15.865148 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51aca6-24ac-4b32-80c5-bc4ada5c36f9 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:15.865663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51aca6-24ac-4b32-80c5-bc4ada5c36f9 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:15.865791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51aca6-24ac-4b32-80c5-bc4ada5c36f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:15.911974 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-fc51aca6-24ac-4b32-80c5-bc4ada5c36f9 None None] MFA Rules not processed for user `0dcb8c8b6df94a778327294839cc74d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:15.913261 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-fc51aca6-24ac-4b32-80c5-bc4ada5c36f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:15.982273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1058/2104] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:15.994081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d457d92-f65e-4761-89ef-30fe316e10f8 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:15.995812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3d457d92-f65e-4761-89ef-30fe316e10f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:16.053185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d457d92-f65e-4761-89ef-30fe316e10f8 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:16.056812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee071599-d910-4793-991d-32dbafb5279e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:16.057461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee071599-d910-4793-991d-32dbafb5279e service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:16.057744 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee071599-d910-4793-991d-32dbafb5279e service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:16.058022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee071599-d910-4793-991d-32dbafb5279e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:16.066374 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee071599-d910-4793-991d-32dbafb5279e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:16.067808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee071599-d910-4793-991d-32dbafb5279e service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:16.077001 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1047/2105] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:18.645787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51aca6-24ac-4b32-80c5-bc4ada5c36f9 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:18.707455 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51aca6-24ac-4b32-80c5-bc4ada5c36f9 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:18.711919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffc776-40f8-4353-9d44-9b5f629f8535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:18.712781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffc776-40f8-4353-9d44-9b5f629f8535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:18.713101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffc776-40f8-4353-9d44-9b5f629f8535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:18.713377 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffc776-40f8-4353-9d44-9b5f629f8535 admin admin] PATH_INFO: `/v3/users/0dcb8c8b6df94a778327294839cc74d6` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:18.714598 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffc776-40f8-4353-9d44-9b5f629f8535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dcb8c8b6df94a778327294839cc74d6)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:18.716526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffc776-40f8-4353-9d44-9b5f629f8535 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:18.771161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-26ffc776-40f8-4353-9d44-9b5f629f8535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dcb8c8b6df94a778327294839cc74d6'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:18.782096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-26ffc776-40f8-4353-9d44-9b5f629f8535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dcb8c8b6df94a778327294839cc74d6'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:18.783009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-26ffc776-40f8-4353-9d44-9b5f629f8535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dcb8c8b6df94a778327294839cc74d6'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:18.797076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-26ffc776-40f8-4353-9d44-9b5f629f8535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dcb8c8b6df94a778327294839cc74d6'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:18.804823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-26ffc776-40f8-4353-9d44-9b5f629f8535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dcb8c8b6df94a778327294839cc74d6'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:18.811654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1059/2106] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:18 2022] DELETE /identity/v3/users/0dcb8c8b6df94a778327294839cc74d6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:18.817473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2226a7-41b5-4133-b958-79e1b3e382bd None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:18.817976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2226a7-41b5-4133-b958-79e1b3e382bd None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:18.818059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2226a7-41b5-4133-b958-79e1b3e382bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:18.837158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-ff2226a7-41b5-4133-b958-79e1b3e382bd None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:18.838483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ff2226a7-41b5-4133-b958-79e1b3e382bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:18.900249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1048/2107] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:18.910024 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffc776-40f8-4353-9d44-9b5f629f8535 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:18.911559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-26ffc776-40f8-4353-9d44-9b5f629f8535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:18.966245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffc776-40f8-4353-9d44-9b5f629f8535 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:18.969827 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672430b-6620-4b2e-aa0b-b942f71f9f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:18.970524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672430b-6620-4b2e-aa0b-b942f71f9f9e service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:18.970817 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672430b-6620-4b2e-aa0b-b942f71f9f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:18.970817 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672430b-6620-4b2e-aa0b-b942f71f9f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:18.979875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672430b-6620-4b2e-aa0b-b942f71f9f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:18.981291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672430b-6620-4b2e-aa0b-b942f71f9f9e service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:18.990522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1060/2108] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:19.289761 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2226a7-41b5-4133-b958-79e1b3e382bd None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:19.291303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ff2226a7-41b5-4133-b958-79e1b3e382bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:19.305726 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2226a7-41b5-4133-b958-79e1b3e382bd None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:19.310667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbc9ef-674d-4706-a5c3-b72595996fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:19.311725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbc9ef-674d-4706-a5c3-b72595996fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:19.312008 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbc9ef-674d-4706-a5c3-b72595996fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:19.312287 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbc9ef-674d-4706-a5c3-b72595996fc1 admin admin] PATH_INFO: `/v3/projects/68d4fe680eb142d68362e8c4b9135a86` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:19.313540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbc9ef-674d-4706-a5c3-b72595996fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68d4fe680eb142d68362e8c4b9135a86)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:19.316503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbc9ef-674d-4706-a5c3-b72595996fc1 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:19.363447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-69dbc9ef-674d-4706-a5c3-b72595996fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68d4fe680eb142d68362e8c4b9135a86', 'request_id': 'req-69dbc9ef-674d-4706-a5c3-b72595996fc1'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:19.369497 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-69dbc9ef-674d-4706-a5c3-b72595996fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68d4fe680eb142d68362e8c4b9135a86', 'request_id': 'req-69dbc9ef-674d-4706-a5c3-b72595996fc1'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:19.377695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-69dbc9ef-674d-4706-a5c3-b72595996fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68d4fe680eb142d68362e8c4b9135a86', 'request_id': 'req-69dbc9ef-674d-4706-a5c3-b72595996fc1'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:19.389714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-69dbc9ef-674d-4706-a5c3-b72595996fc1 admin admin] The token cache is being invalidate because project 68d4fe680eb142d68362e8c4b9135a86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:19.390003 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-69dbc9ef-674d-4706-a5c3-b72595996fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:19.390691 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-69dbc9ef-674d-4706-a5c3-b72595996fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:19.392276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1049/2109] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:19 2022] DELETE /identity/v3/projects/68d4fe680eb142d68362e8c4b9135a86 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:24.612559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672430b-6620-4b2e-aa0b-b942f71f9f9e service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:24.614227 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b672430b-6620-4b2e-aa0b-b942f71f9f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:24.628537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672430b-6620-4b2e-aa0b-b942f71f9f9e service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:24.686608 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a494837-dcc8-4d3b-835b-954f7a460d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:24.687473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a494837-dcc8-4d3b-835b-954f7a460d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:24.687810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a494837-dcc8-4d3b-835b-954f7a460d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:24.688012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a494837-dcc8-4d3b-835b-954f7a460d83 admin admin] PATH_INFO: `/v3/users/e486c10649534700bc59d220bd272b42` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:24.689648 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a494837-dcc8-4d3b-835b-954f7a460d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e486c10649534700bc59d220bd272b42)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:24.691626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a494837-dcc8-4d3b-835b-954f7a460d83 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:24.739125 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9a494837-dcc8-4d3b-835b-954f7a460d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e486c10649534700bc59d220bd272b42'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:24.746079 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9a494837-dcc8-4d3b-835b-954f7a460d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e486c10649534700bc59d220bd272b42'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:24.746725 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9a494837-dcc8-4d3b-835b-954f7a460d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e486c10649534700bc59d220bd272b42'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:24.758167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9a494837-dcc8-4d3b-835b-954f7a460d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e486c10649534700bc59d220bd272b42'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:24.764685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9a494837-dcc8-4d3b-835b-954f7a460d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e486c10649534700bc59d220bd272b42'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:24.770644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1061/2110] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:24 2022] DELETE /identity/v3/users/e486c10649534700bc59d220bd272b42 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:24.938806 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbc9ef-674d-4706-a5c3-b72595996fc1 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:24.940477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-69dbc9ef-674d-4706-a5c3-b72595996fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:24.954666 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbc9ef-674d-4706-a5c3-b72595996fc1 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:25.019867 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c74e77-38e9-41c7-a743-c24bfeac0660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:25.020738 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c74e77-38e9-41c7-a743-c24bfeac0660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:25.021025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c74e77-38e9-41c7-a743-c24bfeac0660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:25.021310 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c74e77-38e9-41c7-a743-c24bfeac0660 admin admin] PATH_INFO: `/v3/projects/8c90a3a91c33407880ad6020ca05f267` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:25.022548 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c74e77-38e9-41c7-a743-c24bfeac0660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c90a3a91c33407880ad6020ca05f267)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:25.024473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c74e77-38e9-41c7-a743-c24bfeac0660 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:25.069907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-87c74e77-38e9-41c7-a743-c24bfeac0660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c90a3a91c33407880ad6020ca05f267', 'request_id': 'req-87c74e77-38e9-41c7-a743-c24bfeac0660'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:25.076181 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-87c74e77-38e9-41c7-a743-c24bfeac0660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c90a3a91c33407880ad6020ca05f267', 'request_id': 'req-87c74e77-38e9-41c7-a743-c24bfeac0660'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:25.084174 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-87c74e77-38e9-41c7-a743-c24bfeac0660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c90a3a91c33407880ad6020ca05f267', 'request_id': 'req-87c74e77-38e9-41c7-a743-c24bfeac0660'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:25.094612 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-87c74e77-38e9-41c7-a743-c24bfeac0660 admin admin] The token cache is being invalidate because project 8c90a3a91c33407880ad6020ca05f267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:25.094900 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-87c74e77-38e9-41c7-a743-c24bfeac0660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:25.096733 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-87c74e77-38e9-41c7-a743-c24bfeac0660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:25.098674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1050/2111] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:24 2022] DELETE /identity/v3/projects/8c90a3a91c33407880ad6020ca05f267 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:25.103610 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce2e2c-3070-492b-bcd2-3c82cdc5ede0 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:25.103904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce2e2c-3070-492b-bcd2-3c82cdc5ede0 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:25.104187 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce2e2c-3070-492b-bcd2-3c82cdc5ede0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:25.122438 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-77ce2e2c-3070-492b-bcd2-3c82cdc5ede0 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:25.123640 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-77ce2e2c-3070-492b-bcd2-3c82cdc5ede0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:25.182124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1062/2112] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:25.190673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b122ae-477c-4965-9e4a-ae93a34946f3 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:25.190968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b122ae-477c-4965-9e4a-ae93a34946f3 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:25.191261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b122ae-477c-4965-9e4a-ae93a34946f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:25.211787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-a9b122ae-477c-4965-9e4a-ae93a34946f3 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:25.212979 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a9b122ae-477c-4965-9e4a-ae93a34946f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:25.221496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1051/2113] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:33:25.225783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce2e2c-3070-492b-bcd2-3c82cdc5ede0 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:25.235615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce2e2c-3070-492b-bcd2-3c82cdc5ede0 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:25.240247 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fd097-c50c-4da9-8d5c-f1bd7becba7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:25.240893 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fd097-c50c-4da9-8d5c-f1bd7becba7e admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:25.241175 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fd097-c50c-4da9-8d5c-f1bd7becba7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:25.241471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fd097-c50c-4da9-8d5c-f1bd7becba7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:25.242199 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fd097-c50c-4da9-8d5c-f1bd7becba7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:33:25.242520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fd097-c50c-4da9-8d5c-f1bd7becba7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:25.244137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fd097-c50c-4da9-8d5c-f1bd7becba7e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:25.256158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1063/2114] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:33:25.260397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b122ae-477c-4965-9e4a-ae93a34946f3 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:25.270112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b122ae-477c-4965-9e4a-ae93a34946f3 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:25.274835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717d939-4082-45d2-83f7-721897085127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:25.275478 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717d939-4082-45d2-83f7-721897085127 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:25.275762 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717d939-4082-45d2-83f7-721897085127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:25.276036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717d939-4082-45d2-83f7-721897085127 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:25.276732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717d939-4082-45d2-83f7-721897085127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:25.278681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717d939-4082-45d2-83f7-721897085127 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:25.305441 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1052/2115] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:25 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:33:25.309654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fd097-c50c-4da9-8d5c-f1bd7becba7e admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:25.320078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fd097-c50c-4da9-8d5c-f1bd7becba7e admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:25.377015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59166b6-5773-48d1-8fff-cc4fd7f329e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:25.377782 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59166b6-5773-48d1-8fff-cc4fd7f329e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:25.378301 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59166b6-5773-48d1-8fff-cc4fd7f329e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:25.378461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59166b6-5773-48d1-8fff-cc4fd7f329e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:25.379166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59166b6-5773-48d1-8fff-cc4fd7f329e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:25.381143 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59166b6-5773-48d1-8fff-cc4fd7f329e3 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:25.403199 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1064/2116] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:25 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:33:25.407173 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717d939-4082-45d2-83f7-721897085127 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:25.417887 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717d939-4082-45d2-83f7-721897085127 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:25.422549 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e717b-1495-4bee-a686-045273de9734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:25.423245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e717b-1495-4bee-a686-045273de9734 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:25.423579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e717b-1495-4bee-a686-045273de9734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:25.423921 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e717b-1495-4bee-a686-045273de9734 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:25.424654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e717b-1495-4bee-a686-045273de9734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:25.426290 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e717b-1495-4bee-a686-045273de9734 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:25.437036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1053/2117] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:25.441503 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59166b6-5773-48d1-8fff-cc4fd7f329e3 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:25.452331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59166b6-5773-48d1-8fff-cc4fd7f329e3 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:25.460603 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa74faf-d6c0-45fe-acc9-7c90ded4ae80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:25.461509 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa74faf-d6c0-45fe-acc9-7c90ded4ae80 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:25.461861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa74faf-d6c0-45fe-acc9-7c90ded4ae80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:25.462153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa74faf-d6c0-45fe-acc9-7c90ded4ae80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:25.462987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa74faf-d6c0-45fe-acc9-7c90ded4ae80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:25.464633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa74faf-d6c0-45fe-acc9-7c90ded4ae80 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:25.475681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1065/2118] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:25.479944 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e717b-1495-4bee-a686-045273de9734 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:25.491127 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e717b-1495-4bee-a686-045273de9734 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:25.495703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324a901-e290-46af-89ba-375faa7c14dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:25.496574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324a901-e290-46af-89ba-375faa7c14dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:25.496857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324a901-e290-46af-89ba-375faa7c14dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:25.497135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324a901-e290-46af-89ba-375faa7c14dc admin admin] PATH_INFO: `/v3/projects/51ce3660177a435a96fd7596f1c54f58/users/f28c1c9167484bccb089788d7f0de316/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:25.511810 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324a901-e290-46af-89ba-375faa7c14dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ce3660177a435a96fd7596f1c54f58, user_id=f28c1c9167484bccb089788d7f0de316, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:25.514570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324a901-e290-46af-89ba-375faa7c14dc admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:25.528273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1054/2119] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:25 2022] PUT /identity/v3/projects/51ce3660177a435a96fd7596f1c54f58/users/f28c1c9167484bccb089788d7f0de316/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:25.538968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e3863-92b9-48e1-a743-e5cae2be75d2 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:25.539260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e3863-92b9-48e1-a743-e5cae2be75d2 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:25.539541 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e3863-92b9-48e1-a743-e5cae2be75d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:25.565945 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-fe9e3863-92b9-48e1-a743-e5cae2be75d2 None None] MFA Rules not processed for user `f28c1c9167484bccb089788d7f0de316`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:25.567214 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-fe9e3863-92b9-48e1-a743-e5cae2be75d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:25.629883 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1066/2120] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:25.641819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324a901-e290-46af-89ba-375faa7c14dc admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:25.644293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f324a901-e290-46af-89ba-375faa7c14dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:25.717512 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324a901-e290-46af-89ba-375faa7c14dc admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:25.723483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d234d2e-8342-4f96-8f17-a9fb7f7e4ea0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:25.724132 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d234d2e-8342-4f96-8f17-a9fb7f7e4ea0 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:25.724415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d234d2e-8342-4f96-8f17-a9fb7f7e4ea0 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:25.724690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d234d2e-8342-4f96-8f17-a9fb7f7e4ea0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:25.732732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d234d2e-8342-4f96-8f17-a9fb7f7e4ea0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:25.734379 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d234d2e-8342-4f96-8f17-a9fb7f7e4ea0 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:25.743775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1055/2121] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:25.940256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e3863-92b9-48e1-a743-e5cae2be75d2 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:26.001052 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e3863-92b9-48e1-a743-e5cae2be75d2 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:26.005659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd637ed-650f-4c62-bd71-f21a67ae8388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:26.006555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd637ed-650f-4c62-bd71-f21a67ae8388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:26.006834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd637ed-650f-4c62-bd71-f21a67ae8388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:26.007106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd637ed-650f-4c62-bd71-f21a67ae8388 admin admin] PATH_INFO: `/v3/users/f28c1c9167484bccb089788d7f0de316` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:26.008274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd637ed-650f-4c62-bd71-f21a67ae8388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f28c1c9167484bccb089788d7f0de316)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:26.010259 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd637ed-650f-4c62-bd71-f21a67ae8388 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:26.057458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4dd637ed-650f-4c62-bd71-f21a67ae8388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f28c1c9167484bccb089788d7f0de316'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:26.065627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4dd637ed-650f-4c62-bd71-f21a67ae8388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f28c1c9167484bccb089788d7f0de316'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:26.066535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4dd637ed-650f-4c62-bd71-f21a67ae8388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f28c1c9167484bccb089788d7f0de316'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:26.079130 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4dd637ed-650f-4c62-bd71-f21a67ae8388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f28c1c9167484bccb089788d7f0de316'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:26.086586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-4dd637ed-650f-4c62-bd71-f21a67ae8388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f28c1c9167484bccb089788d7f0de316'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:26.092465 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1067/2122] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:25 2022] DELETE /identity/v3/users/f28c1c9167484bccb089788d7f0de316 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:26.097758 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968481a-8271-494b-b837-faec9addd302 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:26.098276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968481a-8271-494b-b837-faec9addd302 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:26.098383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968481a-8271-494b-b837-faec9addd302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:26.114681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-3968481a-8271-494b-b837-faec9addd302 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:26.115882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3968481a-8271-494b-b837-faec9addd302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:26.172924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1056/2123] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:26.182834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd637ed-650f-4c62-bd71-f21a67ae8388 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:26.184233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-4dd637ed-650f-4c62-bd71-f21a67ae8388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:26.246511 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd637ed-650f-4c62-bd71-f21a67ae8388 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:26.250371 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff430c88-77d2-4b9e-a53a-7e8f14dd4615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:26.251211 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430c88-77d2-4b9e-a53a-7e8f14dd4615 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:26.251966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430c88-77d2-4b9e-a53a-7e8f14dd4615 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:26.252246 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430c88-77d2-4b9e-a53a-7e8f14dd4615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:26.261752 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff430c88-77d2-4b9e-a53a-7e8f14dd4615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:26.263214 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff430c88-77d2-4b9e-a53a-7e8f14dd4615 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:26.273097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1068/2124] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:26.541444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968481a-8271-494b-b837-faec9addd302 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:26.543170 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3968481a-8271-494b-b837-faec9addd302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:26.556288 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968481a-8271-494b-b837-faec9addd302 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:26.561008 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885693c5-8dcb-4d17-8b61-d0be1741bb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:26.562067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885693c5-8dcb-4d17-8b61-d0be1741bb3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:26.562397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885693c5-8dcb-4d17-8b61-d0be1741bb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:26.562681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885693c5-8dcb-4d17-8b61-d0be1741bb3f admin admin] PATH_INFO: `/v3/projects/51ce3660177a435a96fd7596f1c54f58` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:26.563893 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885693c5-8dcb-4d17-8b61-d0be1741bb3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ce3660177a435a96fd7596f1c54f58)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:26.566070 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885693c5-8dcb-4d17-8b61-d0be1741bb3f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:26.617428 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-885693c5-8dcb-4d17-8b61-d0be1741bb3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ce3660177a435a96fd7596f1c54f58', 'request_id': 'req-885693c5-8dcb-4d17-8b61-d0be1741bb3f'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:26.623692 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-885693c5-8dcb-4d17-8b61-d0be1741bb3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ce3660177a435a96fd7596f1c54f58', 'request_id': 'req-885693c5-8dcb-4d17-8b61-d0be1741bb3f'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:26.632166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-885693c5-8dcb-4d17-8b61-d0be1741bb3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ce3660177a435a96fd7596f1c54f58', 'request_id': 'req-885693c5-8dcb-4d17-8b61-d0be1741bb3f'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:26.645260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-885693c5-8dcb-4d17-8b61-d0be1741bb3f admin admin] The token cache is being invalidate because project 51ce3660177a435a96fd7596f1c54f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:26.645560 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-885693c5-8dcb-4d17-8b61-d0be1741bb3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:26.646262 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-885693c5-8dcb-4d17-8b61-d0be1741bb3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:26.650387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1057/2125] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:26 2022] DELETE /identity/v3/projects/51ce3660177a435a96fd7596f1c54f58 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:26.652941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b1a37-3a3c-4837-b4f7-9c6a5eebda1c None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:26.653413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b1a37-3a3c-4837-b4f7-9c6a5eebda1c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:26.653658 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b1a37-3a3c-4837-b4f7-9c6a5eebda1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:26.671809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-ad7b1a37-3a3c-4837-b4f7-9c6a5eebda1c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:26.673005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ad7b1a37-3a3c-4837-b4f7-9c6a5eebda1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:26.730537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1069/2126] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:33:26.739077 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae436ea-1880-4c36-91a5-5345a5568fb6 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:26.739371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae436ea-1880-4c36-91a5-5345a5568fb6 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:26.739655 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae436ea-1880-4c36-91a5-5345a5568fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:26.758397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-aae436ea-1880-4c36-91a5-5345a5568fb6 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:26.759580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-aae436ea-1880-4c36-91a5-5345a5568fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:26.767502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1058/2127] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:26.771652 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b1a37-3a3c-4837-b4f7-9c6a5eebda1c None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:26.780882 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b1a37-3a3c-4837-b4f7-9c6a5eebda1c None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:26.785492 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf221985-6e91-4329-b121-4c40ef5480f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:26.786074 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf221985-6e91-4329-b121-4c40ef5480f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:26.786383 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf221985-6e91-4329-b121-4c40ef5480f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:26.786657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf221985-6e91-4329-b121-4c40ef5480f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:26.787371 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf221985-6e91-4329-b121-4c40ef5480f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:33:26.787671 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf221985-6e91-4329-b121-4c40ef5480f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:26.789245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf221985-6e91-4329-b121-4c40ef5480f0 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:26.801246 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1070/2128] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:33:26.805621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae436ea-1880-4c36-91a5-5345a5568fb6 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:26.817550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae436ea-1880-4c36-91a5-5345a5568fb6 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:26.822235 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b3f8d-a0c0-4b2a-a1a3-070d15f365ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:26.822896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b3f8d-a0c0-4b2a-a1a3-070d15f365ab admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:26.823176 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b3f8d-a0c0-4b2a-a1a3-070d15f365ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:26.823447 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b3f8d-a0c0-4b2a-a1a3-070d15f365ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:26.824150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b3f8d-a0c0-4b2a-a1a3-070d15f365ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:26.826616 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b3f8d-a0c0-4b2a-a1a3-070d15f365ab admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:26.856095 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1059/2129] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:26 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:33:26.860255 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf221985-6e91-4329-b121-4c40ef5480f0 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:26.871115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf221985-6e91-4329-b121-4c40ef5480f0 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:26.927112 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc551239-dea5-4644-b196-89aa02c39395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:26.927772 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc551239-dea5-4644-b196-89aa02c39395 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:26.928051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc551239-dea5-4644-b196-89aa02c39395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:26.928323 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc551239-dea5-4644-b196-89aa02c39395 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:26.929010 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc551239-dea5-4644-b196-89aa02c39395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:26.930965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc551239-dea5-4644-b196-89aa02c39395 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:26.954540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1071/2130] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:26 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:26.959067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b3f8d-a0c0-4b2a-a1a3-070d15f365ab admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:26.969134 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b3f8d-a0c0-4b2a-a1a3-070d15f365ab admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:26.975085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb52fe-0970-4bf3-9544-4539c401392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:26.975781 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb52fe-0970-4bf3-9544-4539c401392e admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:26.976064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb52fe-0970-4bf3-9544-4539c401392e admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:26.976343 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb52fe-0970-4bf3-9544-4539c401392e admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:26.977070 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb52fe-0970-4bf3-9544-4539c401392e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:26.978727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb52fe-0970-4bf3-9544-4539c401392e admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:26.990279 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1060/2131] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:26.993739 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc551239-dea5-4644-b196-89aa02c39395 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:27.003710 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc551239-dea5-4644-b196-89aa02c39395 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:27.008635 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6f05a-0df6-4a5b-ab3b-145d55ffd6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:27.009292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6f05a-0df6-4a5b-ab3b-145d55ffd6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:27.009578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6f05a-0df6-4a5b-ab3b-145d55ffd6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:27.009857 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6f05a-0df6-4a5b-ab3b-145d55ffd6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:27.010617 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6f05a-0df6-4a5b-ab3b-145d55ffd6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:27.012228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6f05a-0df6-4a5b-ab3b-145d55ffd6d1 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:27.022649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1072/2132] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:27.026745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb52fe-0970-4bf3-9544-4539c401392e admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:27.037594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb52fe-0970-4bf3-9544-4539c401392e admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:27.042243 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d1088-3ba1-4d63-a967-6a367cf3b5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:27.043131 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d1088-3ba1-4d63-a967-6a367cf3b5de admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:27.043420 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d1088-3ba1-4d63-a967-6a367cf3b5de admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:27.043718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d1088-3ba1-4d63-a967-6a367cf3b5de admin admin] PATH_INFO: `/v3/projects/d8e4ba7afb424930893197d3b88c5888/users/0fff40cce9564baa8618238340bfbfb3/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:27.059529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d1088-3ba1-4d63-a967-6a367cf3b5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e4ba7afb424930893197d3b88c5888, user_id=0fff40cce9564baa8618238340bfbfb3, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:27.062364 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d1088-3ba1-4d63-a967-6a367cf3b5de admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:27.076388 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1061/2133] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:27 2022] PUT /identity/v3/projects/d8e4ba7afb424930893197d3b88c5888/users/0fff40cce9564baa8618238340bfbfb3/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:27.087227 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fcb66-dd66-4c09-9691-eb5a16cc2342 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:27.087520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fcb66-dd66-4c09-9691-eb5a16cc2342 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:27.087802 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fcb66-dd66-4c09-9691-eb5a16cc2342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:27.114798 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-b70fcb66-dd66-4c09-9691-eb5a16cc2342 None None] MFA Rules not processed for user `0fff40cce9564baa8618238340bfbfb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:27.116026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b70fcb66-dd66-4c09-9691-eb5a16cc2342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:27.179016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1073/2134] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:27.183580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d1088-3ba1-4d63-a967-6a367cf3b5de admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:27.251325 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d1088-3ba1-4d63-a967-6a367cf3b5de admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:27.257211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f64c5-65c3-4f4d-8860-f49453798072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:27.257910 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f64c5-65c3-4f4d-8860-f49453798072 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:27.258220 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f64c5-65c3-4f4d-8860-f49453798072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:27.258533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f64c5-65c3-4f4d-8860-f49453798072 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:27.259280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f64c5-65c3-4f4d-8860-f49453798072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:27.261207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f64c5-65c3-4f4d-8860-f49453798072 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:27.294863 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1062/2135] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:27 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:27.298080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fcb66-dd66-4c09-9691-eb5a16cc2342 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:27.309296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fcb66-dd66-4c09-9691-eb5a16cc2342 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:27.368605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b4381-eab4-4d7e-a4b7-22006ef3c96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:27.369270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b4381-eab4-4d7e-a4b7-22006ef3c96d admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:27.369553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b4381-eab4-4d7e-a4b7-22006ef3c96d admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:27.369831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b4381-eab4-4d7e-a4b7-22006ef3c96d admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:27.370558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b4381-eab4-4d7e-a4b7-22006ef3c96d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:27.372487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b4381-eab4-4d7e-a4b7-22006ef3c96d admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:27.391181 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1074/2136] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:27 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:27.395337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f64c5-65c3-4f4d-8860-f49453798072 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:27.405485 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f64c5-65c3-4f4d-8860-f49453798072 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:27.410242 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb5428-9539-4145-8b8e-e91225da4e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:27.410909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb5428-9539-4145-8b8e-e91225da4e9f admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:27.411192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb5428-9539-4145-8b8e-e91225da4e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:27.411473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb5428-9539-4145-8b8e-e91225da4e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:27.412196 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb5428-9539-4145-8b8e-e91225da4e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:27.413814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb5428-9539-4145-8b8e-e91225da4e9f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:27.425022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1063/2137] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:27.429151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b4381-eab4-4d7e-a4b7-22006ef3c96d admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:27.447757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b4381-eab4-4d7e-a4b7-22006ef3c96d admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:27.452801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c9152-54a0-43f0-9220-cf0d10a26df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:27.453964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c9152-54a0-43f0-9220-cf0d10a26df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:27.454284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c9152-54a0-43f0-9220-cf0d10a26df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:27.454563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c9152-54a0-43f0-9220-cf0d10a26df2 admin admin] PATH_INFO: `/v3/projects/98cd1804bdde4abb99a8c9a50d02a179/users/02fa37cae2c54ca5a3bb580704115b39/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:27.469503 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c9152-54a0-43f0-9220-cf0d10a26df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98cd1804bdde4abb99a8c9a50d02a179, user_id=02fa37cae2c54ca5a3bb580704115b39, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:27.472273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c9152-54a0-43f0-9220-cf0d10a26df2 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:27.486931 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1075/2138] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:27 2022] PUT /identity/v3/projects/98cd1804bdde4abb99a8c9a50d02a179/users/02fa37cae2c54ca5a3bb580704115b39/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:27.490902 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb5428-9539-4145-8b8e-e91225da4e9f admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:27.502234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb5428-9539-4145-8b8e-e91225da4e9f admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:27.561541 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970667a-9cbf-4de2-9f29-ae0c54356d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:27.562126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970667a-9cbf-4de2-9f29-ae0c54356d30 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:27.562442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970667a-9cbf-4de2-9f29-ae0c54356d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:27.562723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970667a-9cbf-4de2-9f29-ae0c54356d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:27.563476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970667a-9cbf-4de2-9f29-ae0c54356d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:27.565642 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970667a-9cbf-4de2-9f29-ae0c54356d30 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:27.575465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1064/2139] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:27.580280 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c9152-54a0-43f0-9220-cf0d10a26df2 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:27.590625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c9152-54a0-43f0-9220-cf0d10a26df2 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:27.595372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77438ad5-d07f-422a-9eec-25f806239e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:27.596388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77438ad5-d07f-422a-9eec-25f806239e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:27.596696 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77438ad5-d07f-422a-9eec-25f806239e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:27.596970 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77438ad5-d07f-422a-9eec-25f806239e3a admin admin] PATH_INFO: `/v3/projects/98cd1804bdde4abb99a8c9a50d02a179/users/02fa37cae2c54ca5a3bb580704115b39/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:27.598940 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77438ad5-d07f-422a-9eec-25f806239e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=98cd1804bdde4abb99a8c9a50d02a179, user_id=02fa37cae2c54ca5a3bb580704115b39, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:27.601596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77438ad5-d07f-422a-9eec-25f806239e3a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:27.612263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1076/2140] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:27 2022] PUT /identity/v3/projects/98cd1804bdde4abb99a8c9a50d02a179/users/02fa37cae2c54ca5a3bb580704115b39/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:27.623651 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48018802-a14d-4871-9ad6-c0ca3d694b03 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:27.623959 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48018802-a14d-4871-9ad6-c0ca3d694b03 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:27.624228 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48018802-a14d-4871-9ad6-c0ca3d694b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:27.652113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-48018802-a14d-4871-9ad6-c0ca3d694b03 None None] MFA Rules not processed for user `02fa37cae2c54ca5a3bb580704115b39`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:27.653352 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-48018802-a14d-4871-9ad6-c0ca3d694b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:27.729858 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1065/2141] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:33:27.741131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77438ad5-d07f-422a-9eec-25f806239e3a admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:27.742897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-77438ad5-d07f-422a-9eec-25f806239e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:27.799956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77438ad5-d07f-422a-9eec-25f806239e3a admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:27.804294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bce1b1-56d4-471c-a4ff-1b1ab766f08e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:27.805012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bce1b1-56d4-471c-a4ff-1b1ab766f08e service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:27.805367 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bce1b1-56d4-471c-a4ff-1b1ab766f08e service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:27.805712 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bce1b1-56d4-471c-a4ff-1b1ab766f08e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:27.825617 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bce1b1-56d4-471c-a4ff-1b1ab766f08e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:27.827405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bce1b1-56d4-471c-a4ff-1b1ab766f08e service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:27.837672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1077/2142] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:27 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:27.996318 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48018802-a14d-4871-9ad6-c0ca3d694b03 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:28.057717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48018802-a14d-4871-9ad6-c0ca3d694b03 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:28.062353 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9d8ff-07ce-4789-baf9-bb63da111215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:28.063187 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9d8ff-07ce-4789-baf9-bb63da111215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:28.063465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9d8ff-07ce-4789-baf9-bb63da111215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:28.063741 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9d8ff-07ce-4789-baf9-bb63da111215 admin admin] PATH_INFO: `/v3/users/0fff40cce9564baa8618238340bfbfb3` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:28.065685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9d8ff-07ce-4789-baf9-bb63da111215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fff40cce9564baa8618238340bfbfb3)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:28.067657 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9d8ff-07ce-4789-baf9-bb63da111215 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:28.115569 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ded9d8ff-07ce-4789-baf9-bb63da111215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fff40cce9564baa8618238340bfbfb3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:28.123812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ded9d8ff-07ce-4789-baf9-bb63da111215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fff40cce9564baa8618238340bfbfb3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:28.124585 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ded9d8ff-07ce-4789-baf9-bb63da111215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fff40cce9564baa8618238340bfbfb3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:28.137212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ded9d8ff-07ce-4789-baf9-bb63da111215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fff40cce9564baa8618238340bfbfb3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:28.144459 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ded9d8ff-07ce-4789-baf9-bb63da111215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fff40cce9564baa8618238340bfbfb3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:28.150597 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1066/2143] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:27 2022] DELETE /identity/v3/users/0fff40cce9564baa8618238340bfbfb3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:28.155244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414213d2-de4a-423d-94e7-858a019b7f8c None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:28.155545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414213d2-de4a-423d-94e7-858a019b7f8c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:28.155824 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414213d2-de4a-423d-94e7-858a019b7f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:28.172921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-414213d2-de4a-423d-94e7-858a019b7f8c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:28.174825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-414213d2-de4a-423d-94e7-858a019b7f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:28.231893 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1078/2144] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:28.241544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9d8ff-07ce-4789-baf9-bb63da111215 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:28.243038 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ded9d8ff-07ce-4789-baf9-bb63da111215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:28.300535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9d8ff-07ce-4789-baf9-bb63da111215 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:28.304249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bccb4-7163-4b61-8032-dca16b540712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:28.304908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bccb4-7163-4b61-8032-dca16b540712 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:28.305254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bccb4-7163-4b61-8032-dca16b540712 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:28.305543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bccb4-7163-4b61-8032-dca16b540712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:28.315402 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bccb4-7163-4b61-8032-dca16b540712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:28.316786 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bccb4-7163-4b61-8032-dca16b540712 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:28.327052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1067/2145] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:28.612851 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414213d2-de4a-423d-94e7-858a019b7f8c None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:28.614388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-414213d2-de4a-423d-94e7-858a019b7f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:28.701549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414213d2-de4a-423d-94e7-858a019b7f8c None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:28.707042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19316f-c897-46f7-9648-21da6b905196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:28.707889 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19316f-c897-46f7-9648-21da6b905196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:28.708174 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19316f-c897-46f7-9648-21da6b905196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:28.708452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19316f-c897-46f7-9648-21da6b905196 admin admin] PATH_INFO: `/v3/projects/d8e4ba7afb424930893197d3b88c5888` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:28.709628 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19316f-c897-46f7-9648-21da6b905196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e4ba7afb424930893197d3b88c5888)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:28.711599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19316f-c897-46f7-9648-21da6b905196 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:28.757229 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-cf19316f-c897-46f7-9648-21da6b905196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e4ba7afb424930893197d3b88c5888', 'request_id': 'req-cf19316f-c897-46f7-9648-21da6b905196'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:28.763480 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-cf19316f-c897-46f7-9648-21da6b905196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e4ba7afb424930893197d3b88c5888', 'request_id': 'req-cf19316f-c897-46f7-9648-21da6b905196'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:28.772013 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-cf19316f-c897-46f7-9648-21da6b905196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e4ba7afb424930893197d3b88c5888', 'request_id': 'req-cf19316f-c897-46f7-9648-21da6b905196'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:28.782724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-cf19316f-c897-46f7-9648-21da6b905196 admin admin] The token cache is being invalidate because project d8e4ba7afb424930893197d3b88c5888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:28.783124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-cf19316f-c897-46f7-9648-21da6b905196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:28.783794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-cf19316f-c897-46f7-9648-21da6b905196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:28.785343 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1079/2146] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:28 2022] DELETE /identity/v3/projects/d8e4ba7afb424930893197d3b88c5888 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:28.789257 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bccb4-7163-4b61-8032-dca16b540712 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:28.837043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bccb4-7163-4b61-8032-dca16b540712 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:28.899841 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39842182-8dd0-46a2-aff0-97c9f99d349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:28.900808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39842182-8dd0-46a2-aff0-97c9f99d349d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:28.901075 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39842182-8dd0-46a2-aff0-97c9f99d349d admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:28.901354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39842182-8dd0-46a2-aff0-97c9f99d349d admin admin] PATH_INFO: `/v3/users/02fa37cae2c54ca5a3bb580704115b39` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:28.902593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39842182-8dd0-46a2-aff0-97c9f99d349d admin admin] RBAC: Authorizing `identity:delete_user(user_id=02fa37cae2c54ca5a3bb580704115b39)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:28.905135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39842182-8dd0-46a2-aff0-97c9f99d349d admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:28.969137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-39842182-8dd0-46a2-aff0-97c9f99d349d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02fa37cae2c54ca5a3bb580704115b39'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:28.976947 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-39842182-8dd0-46a2-aff0-97c9f99d349d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02fa37cae2c54ca5a3bb580704115b39'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:28.977668 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-39842182-8dd0-46a2-aff0-97c9f99d349d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02fa37cae2c54ca5a3bb580704115b39'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:28.990616 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-39842182-8dd0-46a2-aff0-97c9f99d349d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02fa37cae2c54ca5a3bb580704115b39'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:28.998302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-39842182-8dd0-46a2-aff0-97c9f99d349d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02fa37cae2c54ca5a3bb580704115b39'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:29.004822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1068/2147] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:28 2022] DELETE /identity/v3/users/02fa37cae2c54ca5a3bb580704115b39 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:29.275269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19316f-c897-46f7-9648-21da6b905196 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:29.276950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-cf19316f-c897-46f7-9648-21da6b905196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:29.294269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19316f-c897-46f7-9648-21da6b905196 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:29.351204 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffe5ae-0fa8-4108-8bdf-e2ccf5e4a93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:29.352054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffe5ae-0fa8-4108-8bdf-e2ccf5e4a93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:29.352336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffe5ae-0fa8-4108-8bdf-e2ccf5e4a93a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:29.352609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffe5ae-0fa8-4108-8bdf-e2ccf5e4a93a admin admin] PATH_INFO: `/v3/projects/98cd1804bdde4abb99a8c9a50d02a179` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:29.353779 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffe5ae-0fa8-4108-8bdf-e2ccf5e4a93a admin admin] RBAC: Authorizing `identity:delete_project(project_id=98cd1804bdde4abb99a8c9a50d02a179)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:29.355745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffe5ae-0fa8-4108-8bdf-e2ccf5e4a93a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:29.400331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a7ffe5ae-0fa8-4108-8bdf-e2ccf5e4a93a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98cd1804bdde4abb99a8c9a50d02a179', 'request_id': 'req-a7ffe5ae-0fa8-4108-8bdf-e2ccf5e4a93a'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:29.406126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a7ffe5ae-0fa8-4108-8bdf-e2ccf5e4a93a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98cd1804bdde4abb99a8c9a50d02a179', 'request_id': 'req-a7ffe5ae-0fa8-4108-8bdf-e2ccf5e4a93a'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:29.414005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a7ffe5ae-0fa8-4108-8bdf-e2ccf5e4a93a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98cd1804bdde4abb99a8c9a50d02a179', 'request_id': 'req-a7ffe5ae-0fa8-4108-8bdf-e2ccf5e4a93a'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:29.424837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a7ffe5ae-0fa8-4108-8bdf-e2ccf5e4a93a admin admin] The token cache is being invalidate because project 98cd1804bdde4abb99a8c9a50d02a179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:29.425115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a7ffe5ae-0fa8-4108-8bdf-e2ccf5e4a93a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:29.425801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-a7ffe5ae-0fa8-4108-8bdf-e2ccf5e4a93a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:29.427403 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1080/2148] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:29 2022] DELETE /identity/v3/projects/98cd1804bdde4abb99a8c9a50d02a179 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:29.432198 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6fc4-f021-4b73-8e34-7c078c0b7a0b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:29.432699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6fc4-f021-4b73-8e34-7c078c0b7a0b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:29.432819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6fc4-f021-4b73-8e34-7c078c0b7a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:29.479852 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-845a6fc4-f021-4b73-8e34-7c078c0b7a0b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:29.481037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-845a6fc4-f021-4b73-8e34-7c078c0b7a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:29.542788 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1069/2149] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:29.551872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3614-0091-47d0-9e0b-b06f8625b47c None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:29.552246 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3614-0091-47d0-9e0b-b06f8625b47c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:29.552524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3614-0091-47d0-9e0b-b06f8625b47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:29.570949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-6a8f3614-0091-47d0-9e0b-b06f8625b47c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:29.572137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6a8f3614-0091-47d0-9e0b-b06f8625b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:29.580594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1081/2150] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:29.584787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a6fc4-f021-4b73-8e34-7c078c0b7a0b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:29.596019 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a6fc4-f021-4b73-8e34-7c078c0b7a0b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:29.600979 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45defe97-d707-41a0-b98a-2f2fe4cb8b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:29.601701 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45defe97-d707-41a0-b98a-2f2fe4cb8b3d admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:29.601934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45defe97-d707-41a0-b98a-2f2fe4cb8b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:29.602249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45defe97-d707-41a0-b98a-2f2fe4cb8b3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:29.602983 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45defe97-d707-41a0-b98a-2f2fe4cb8b3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:33:29.603709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45defe97-d707-41a0-b98a-2f2fe4cb8b3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:29.605332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45defe97-d707-41a0-b98a-2f2fe4cb8b3d admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:29.617589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1070/2151] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:33:29.621904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f3614-0091-47d0-9e0b-b06f8625b47c None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:29.631551 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f3614-0091-47d0-9e0b-b06f8625b47c None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:29.636475 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799d7da-6767-4ea7-8cf6-bed021c5bcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:29.637116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799d7da-6767-4ea7-8cf6-bed021c5bcc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:29.637399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799d7da-6767-4ea7-8cf6-bed021c5bcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:29.637679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799d7da-6767-4ea7-8cf6-bed021c5bcc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:29.638406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799d7da-6767-4ea7-8cf6-bed021c5bcc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:29.640312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799d7da-6767-4ea7-8cf6-bed021c5bcc1 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:29.665059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1082/2152] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:29 2022] POST /identity/v3/projects => generated 357 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:29.669115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45defe97-d707-41a0-b98a-2f2fe4cb8b3d admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:29.681592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45defe97-d707-41a0-b98a-2f2fe4cb8b3d admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:29.741404 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f2125-2036-495f-968e-dbc096b55ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:29.742105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f2125-2036-495f-968e-dbc096b55ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:29.742421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f2125-2036-495f-968e-dbc096b55ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:29.742702 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f2125-2036-495f-968e-dbc096b55ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:29.743424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f2125-2036-495f-968e-dbc096b55ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:29.745403 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f2125-2036-495f-968e-dbc096b55ca5 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:29.766115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1071/2153] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:29 2022] POST /identity/v3/users => generated 279 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:29.770386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799d7da-6767-4ea7-8cf6-bed021c5bcc1 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:29.780615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799d7da-6767-4ea7-8cf6-bed021c5bcc1 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:29.785311 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24360db7-18a5-49a0-8f9a-18427ff390ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:29.785968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24360db7-18a5-49a0-8f9a-18427ff390ec admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:29.786277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24360db7-18a5-49a0-8f9a-18427ff390ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:29.786554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24360db7-18a5-49a0-8f9a-18427ff390ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:29.787312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24360db7-18a5-49a0-8f9a-18427ff390ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:29.788911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24360db7-18a5-49a0-8f9a-18427ff390ec admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:29.799603 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1083/2154] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:29.803369 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f2125-2036-495f-968e-dbc096b55ca5 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:29.813071 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f2125-2036-495f-968e-dbc096b55ca5 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:29.818432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7c04a-95f8-4533-a4f8-d5aaff85661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:29.819087 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7c04a-95f8-4533-a4f8-d5aaff85661c admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:29.819375 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7c04a-95f8-4533-a4f8-d5aaff85661c admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:29.819656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7c04a-95f8-4533-a4f8-d5aaff85661c admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:29.820377 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7c04a-95f8-4533-a4f8-d5aaff85661c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:29.821984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7c04a-95f8-4533-a4f8-d5aaff85661c admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:29.834320 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1072/2155] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:33:29.838258 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24360db7-18a5-49a0-8f9a-18427ff390ec admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:29.848318 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24360db7-18a5-49a0-8f9a-18427ff390ec admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:29.853035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297182eb-0b0f-46fb-8df0-68f938be78de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:29.853945 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297182eb-0b0f-46fb-8df0-68f938be78de admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:29.854258 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297182eb-0b0f-46fb-8df0-68f938be78de admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:29.854561 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297182eb-0b0f-46fb-8df0-68f938be78de admin admin] PATH_INFO: `/v3/projects/9145c37f550c4cfe8eddd3a35c93761a/users/6c190a1b00de43e5a90dfd04c04d218b/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:29.871478 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297182eb-0b0f-46fb-8df0-68f938be78de admin admin] RBAC: Authorizing `identity:create_grant(project_id=9145c37f550c4cfe8eddd3a35c93761a, user_id=6c190a1b00de43e5a90dfd04c04d218b, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:29.874191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297182eb-0b0f-46fb-8df0-68f938be78de admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:29.889026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1084/2156] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:29 2022] PUT /identity/v3/projects/9145c37f550c4cfe8eddd3a35c93761a/users/6c190a1b00de43e5a90dfd04c04d218b/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:33:29.900532 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9144e79-b007-4d1e-8724-c7247365c247 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:29.900839 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9144e79-b007-4d1e-8724-c7247365c247 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:29.901116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9144e79-b007-4d1e-8724-c7247365c247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:29.928805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-a9144e79-b007-4d1e-8724-c7247365c247 None None] MFA Rules not processed for user `6c190a1b00de43e5a90dfd04c04d218b`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:29.929905 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a9144e79-b007-4d1e-8724-c7247365c247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:29.995309 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1073/2157] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:29 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:29.999677 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297182eb-0b0f-46fb-8df0-68f938be78de admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:30.062910 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297182eb-0b0f-46fb-8df0-68f938be78de admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:30.068912 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072214ab-69fb-4742-aa86-3a15e72ffaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:30.069633 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072214ab-69fb-4742-aa86-3a15e72ffaac admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:30.069919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072214ab-69fb-4742-aa86-3a15e72ffaac admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:30.070234 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072214ab-69fb-4742-aa86-3a15e72ffaac admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:30.072456 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072214ab-69fb-4742-aa86-3a15e72ffaac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:30.073061 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072214ab-69fb-4742-aa86-3a15e72ffaac admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:30.100403 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1085/2158] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:29 2022] POST /identity/v3/projects => generated 357 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:30.104398 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9144e79-b007-4d1e-8724-c7247365c247 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:30.115247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9144e79-b007-4d1e-8724-c7247365c247 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:30.177215 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36038c94-68f2-4816-8c23-60a6f6ff4f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:30.177896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36038c94-68f2-4816-8c23-60a6f6ff4f00 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:30.178199 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36038c94-68f2-4816-8c23-60a6f6ff4f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:30.178491 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36038c94-68f2-4816-8c23-60a6f6ff4f00 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:30.179250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36038c94-68f2-4816-8c23-60a6f6ff4f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:30.181122 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36038c94-68f2-4816-8c23-60a6f6ff4f00 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:30.201702 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1074/2159] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:30 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:30.206016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072214ab-69fb-4742-aa86-3a15e72ffaac admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:30.216137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072214ab-69fb-4742-aa86-3a15e72ffaac admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:30.221442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31520a9-4282-47bb-b621-82cfeb909aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:30.222098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31520a9-4282-47bb-b621-82cfeb909aab admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:30.222414 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31520a9-4282-47bb-b621-82cfeb909aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:30.222692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31520a9-4282-47bb-b621-82cfeb909aab admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:30.223444 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31520a9-4282-47bb-b621-82cfeb909aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:30.225046 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31520a9-4282-47bb-b621-82cfeb909aab admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:30.235200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1086/2160] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:30.240384 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36038c94-68f2-4816-8c23-60a6f6ff4f00 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:30.251156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36038c94-68f2-4816-8c23-60a6f6ff4f00 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:30.256540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468042d8-f72b-40cf-8d5e-35b564c466a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:30.257418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468042d8-f72b-40cf-8d5e-35b564c466a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:30.257731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468042d8-f72b-40cf-8d5e-35b564c466a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:30.258010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468042d8-f72b-40cf-8d5e-35b564c466a7 admin admin] PATH_INFO: `/v3/projects/e004f64b8d1f4b408faf70f88f8e56dc/users/9a331fc0bb9e4c89aab5b831879d9d78/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:30.274915 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468042d8-f72b-40cf-8d5e-35b564c466a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e004f64b8d1f4b408faf70f88f8e56dc, user_id=9a331fc0bb9e4c89aab5b831879d9d78, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:30.277613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468042d8-f72b-40cf-8d5e-35b564c466a7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:30.291006 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1075/2161] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:30 2022] PUT /identity/v3/projects/e004f64b8d1f4b408faf70f88f8e56dc/users/9a331fc0bb9e4c89aab5b831879d9d78/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:33:30.295054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31520a9-4282-47bb-b621-82cfeb909aab admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:30.304762 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31520a9-4282-47bb-b621-82cfeb909aab admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:30.359698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892120c-fe8d-4e2f-b12c-561929b93f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:30.360357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892120c-fe8d-4e2f-b12c-561929b93f6a admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:30.360663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892120c-fe8d-4e2f-b12c-561929b93f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:30.360992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892120c-fe8d-4e2f-b12c-561929b93f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:30.361892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892120c-fe8d-4e2f-b12c-561929b93f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:30.363542 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892120c-fe8d-4e2f-b12c-561929b93f6a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:30.373034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1087/2162] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:30.377226 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468042d8-f72b-40cf-8d5e-35b564c466a7 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:30.387393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468042d8-f72b-40cf-8d5e-35b564c466a7 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:30.392477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197c1e7-0477-4c68-b02a-4bbf5d09ec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:30.393352 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197c1e7-0477-4c68-b02a-4bbf5d09ec43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:30.393627 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197c1e7-0477-4c68-b02a-4bbf5d09ec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:30.393898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197c1e7-0477-4c68-b02a-4bbf5d09ec43 admin admin] PATH_INFO: `/v3/projects/e004f64b8d1f4b408faf70f88f8e56dc/users/9a331fc0bb9e4c89aab5b831879d9d78/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:30.395859 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197c1e7-0477-4c68-b02a-4bbf5d09ec43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e004f64b8d1f4b408faf70f88f8e56dc, user_id=9a331fc0bb9e4c89aab5b831879d9d78, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:30.398516 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197c1e7-0477-4c68-b02a-4bbf5d09ec43 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:30.408809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1076/2163] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:30 2022] PUT /identity/v3/projects/e004f64b8d1f4b408faf70f88f8e56dc/users/9a331fc0bb9e4c89aab5b831879d9d78/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:30.418621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f404d72-580b-4153-b271-62ce72e2b5d9 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:30.418979 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f404d72-580b-4153-b271-62ce72e2b5d9 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:30.419346 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f404d72-580b-4153-b271-62ce72e2b5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:30.445325 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-7f404d72-580b-4153-b271-62ce72e2b5d9 None None] MFA Rules not processed for user `9a331fc0bb9e4c89aab5b831879d9d78`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:30.446484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7f404d72-580b-4153-b271-62ce72e2b5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:30.516726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1088/2164] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:30 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:30.528207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197c1e7-0477-4c68-b02a-4bbf5d09ec43 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:30.529943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f197c1e7-0477-4c68-b02a-4bbf5d09ec43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:30.602039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197c1e7-0477-4c68-b02a-4bbf5d09ec43 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:30.605642 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8f9c7-dad7-4c7a-97f6-c971009d0349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:30.606310 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8f9c7-dad7-4c7a-97f6-c971009d0349 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:30.606592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8f9c7-dad7-4c7a-97f6-c971009d0349 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:30.606866 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8f9c7-dad7-4c7a-97f6-c971009d0349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:30.618229 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8f9c7-dad7-4c7a-97f6-c971009d0349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:30.619722 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8f9c7-dad7-4c7a-97f6-c971009d0349 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:30.631344 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1077/2165] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:30 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:30.702428 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f404d72-580b-4153-b271-62ce72e2b5d9 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:30.712077 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f404d72-580b-4153-b271-62ce72e2b5d9 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:30.715957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d1706-192e-44b0-9e28-5d4970740e51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:30.716595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1706-192e-44b0-9e28-5d4970740e51 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:30.716993 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1706-192e-44b0-9e28-5d4970740e51 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:30.717401 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1706-192e-44b0-9e28-5d4970740e51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:30.777410 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d1706-192e-44b0-9e28-5d4970740e51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:30.778957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d1706-192e-44b0-9e28-5d4970740e51 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:30.788863 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1089/2166] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:30 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:48.173886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460b91e-6202-476e-b66c-fc4278ec7627 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:48.175218 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460b91e-6202-476e-b66c-fc4278ec7627 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:48.175218 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460b91e-6202-476e-b66c-fc4278ec7627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:48.192942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-5460b91e-6202-476e-b66c-fc4278ec7627 None None] MFA Rules not processed for user `5b1ec83a7b7546db943a3c1af3bdd2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:48.194130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5460b91e-6202-476e-b66c-fc4278ec7627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:48.249778 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1078/2167] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:48.793802 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d1706-192e-44b0-9e28-5d4970740e51 service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:48.859904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d1706-192e-44b0-9e28-5d4970740e51 service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:48.865306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094e729-4b1e-449a-9c69-88fb6bf69870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:48.866107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094e729-4b1e-449a-9c69-88fb6bf69870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:48.866413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094e729-4b1e-449a-9c69-88fb6bf69870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:48.866678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094e729-4b1e-449a-9c69-88fb6bf69870 admin admin] PATH_INFO: `/v3/users/6c190a1b00de43e5a90dfd04c04d218b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:48.868302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094e729-4b1e-449a-9c69-88fb6bf69870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c190a1b00de43e5a90dfd04c04d218b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:48.869791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094e729-4b1e-449a-9c69-88fb6bf69870 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:48.918595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c094e729-4b1e-449a-9c69-88fb6bf69870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c190a1b00de43e5a90dfd04c04d218b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:48.928212 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c094e729-4b1e-449a-9c69-88fb6bf69870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c190a1b00de43e5a90dfd04c04d218b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:48.929983 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c094e729-4b1e-449a-9c69-88fb6bf69870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c190a1b00de43e5a90dfd04c04d218b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:48.943388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c094e729-4b1e-449a-9c69-88fb6bf69870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c190a1b00de43e5a90dfd04c04d218b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:48.950119 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c094e729-4b1e-449a-9c69-88fb6bf69870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c190a1b00de43e5a90dfd04c04d218b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:48.956932 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1090/2168] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:48 2022] DELETE /identity/v3/users/6c190a1b00de43e5a90dfd04c04d218b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:48.961670 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f1389-5892-4b9d-bd11-fd46247d6e9d None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:48.962031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f1389-5892-4b9d-bd11-fd46247d6e9d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:48.962435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f1389-5892-4b9d-bd11-fd46247d6e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:48.981757 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7a3f1389-5892-4b9d-bd11-fd46247d6e9d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:48.983058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7a3f1389-5892-4b9d-bd11-fd46247d6e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:49.047966 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1079/2169] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:33:49.058949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094e729-4b1e-449a-9c69-88fb6bf69870 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:49.060690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c094e729-4b1e-449a-9c69-88fb6bf69870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:49.145267 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094e729-4b1e-449a-9c69-88fb6bf69870 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:49.149042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60dd84-56ea-4409-bc4b-2c8f67656989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:49.149688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60dd84-56ea-4409-bc4b-2c8f67656989 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:49.149971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60dd84-56ea-4409-bc4b-2c8f67656989 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:49.150346 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60dd84-56ea-4409-bc4b-2c8f67656989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:49.160599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60dd84-56ea-4409-bc4b-2c8f67656989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:49.162027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60dd84-56ea-4409-bc4b-2c8f67656989 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:49.172461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1091/2170] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:49.444312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f1389-5892-4b9d-bd11-fd46247d6e9d None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:49.446048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7a3f1389-5892-4b9d-bd11-fd46247d6e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:49.459797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f1389-5892-4b9d-bd11-fd46247d6e9d None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:49.465295 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a24580-7cc5-4f2e-9793-ffbfe049465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:49.466380 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a24580-7cc5-4f2e-9793-ffbfe049465b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:49.466660 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a24580-7cc5-4f2e-9793-ffbfe049465b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:49.467100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a24580-7cc5-4f2e-9793-ffbfe049465b admin admin] PATH_INFO: `/v3/projects/9145c37f550c4cfe8eddd3a35c93761a` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:49.468623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a24580-7cc5-4f2e-9793-ffbfe049465b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9145c37f550c4cfe8eddd3a35c93761a)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:49.472695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a24580-7cc5-4f2e-9793-ffbfe049465b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:49.523261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-32a24580-7cc5-4f2e-9793-ffbfe049465b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9145c37f550c4cfe8eddd3a35c93761a', 'request_id': 'req-32a24580-7cc5-4f2e-9793-ffbfe049465b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:49.529398 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-32a24580-7cc5-4f2e-9793-ffbfe049465b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9145c37f550c4cfe8eddd3a35c93761a', 'request_id': 'req-32a24580-7cc5-4f2e-9793-ffbfe049465b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:49.538039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-32a24580-7cc5-4f2e-9793-ffbfe049465b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9145c37f550c4cfe8eddd3a35c93761a', 'request_id': 'req-32a24580-7cc5-4f2e-9793-ffbfe049465b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:49.548326 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-32a24580-7cc5-4f2e-9793-ffbfe049465b admin admin] The token cache is being invalidate because project 9145c37f550c4cfe8eddd3a35c93761a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:49.548617 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-32a24580-7cc5-4f2e-9793-ffbfe049465b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:49.549882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-32a24580-7cc5-4f2e-9793-ffbfe049465b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:49.551695 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1080/2171] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:49 2022] DELETE /identity/v3/projects/9145c37f550c4cfe8eddd3a35c93761a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:49.555638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60dd84-56ea-4409-bc4b-2c8f67656989 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:49.565172 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60dd84-56ea-4409-bc4b-2c8f67656989 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:49.622846 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae7b0a-31c8-4f57-9efa-15ce0dd87c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:49.623704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7b0a-31c8-4f57-9efa-15ce0dd87c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:49.623985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7b0a-31c8-4f57-9efa-15ce0dd87c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:49.624258 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7b0a-31c8-4f57-9efa-15ce0dd87c39 admin admin] PATH_INFO: `/v3/users/9a331fc0bb9e4c89aab5b831879d9d78` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:49.625444 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae7b0a-31c8-4f57-9efa-15ce0dd87c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a331fc0bb9e4c89aab5b831879d9d78)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:49.627413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae7b0a-31c8-4f57-9efa-15ce0dd87c39 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:49.671949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2fae7b0a-31c8-4f57-9efa-15ce0dd87c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a331fc0bb9e4c89aab5b831879d9d78'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:49.680483 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2fae7b0a-31c8-4f57-9efa-15ce0dd87c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a331fc0bb9e4c89aab5b831879d9d78'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:49.681151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2fae7b0a-31c8-4f57-9efa-15ce0dd87c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a331fc0bb9e4c89aab5b831879d9d78'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:49.692959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2fae7b0a-31c8-4f57-9efa-15ce0dd87c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a331fc0bb9e4c89aab5b831879d9d78'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:49.699577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2fae7b0a-31c8-4f57-9efa-15ce0dd87c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a331fc0bb9e4c89aab5b831879d9d78'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:49.706695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1092/2172] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:49 2022] DELETE /identity/v3/users/9a331fc0bb9e4c89aab5b831879d9d78 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:49.992434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a24580-7cc5-4f2e-9793-ffbfe049465b admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:49.994170 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-32a24580-7cc5-4f2e-9793-ffbfe049465b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:50.023394 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a24580-7cc5-4f2e-9793-ffbfe049465b admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:50.093865 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12862680-93ee-4744-b166-31959a66c15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:50.096226 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12862680-93ee-4744-b166-31959a66c15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:50.096520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12862680-93ee-4744-b166-31959a66c15f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:50.096958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12862680-93ee-4744-b166-31959a66c15f admin admin] PATH_INFO: `/v3/projects/e004f64b8d1f4b408faf70f88f8e56dc` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:50.098382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12862680-93ee-4744-b166-31959a66c15f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e004f64b8d1f4b408faf70f88f8e56dc)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:50.100314 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12862680-93ee-4744-b166-31959a66c15f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:50.152608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-12862680-93ee-4744-b166-31959a66c15f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e004f64b8d1f4b408faf70f88f8e56dc', 'request_id': 'req-12862680-93ee-4744-b166-31959a66c15f'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:50.159113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-12862680-93ee-4744-b166-31959a66c15f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e004f64b8d1f4b408faf70f88f8e56dc', 'request_id': 'req-12862680-93ee-4744-b166-31959a66c15f'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:50.166197 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-12862680-93ee-4744-b166-31959a66c15f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e004f64b8d1f4b408faf70f88f8e56dc', 'request_id': 'req-12862680-93ee-4744-b166-31959a66c15f'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:50.177304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-12862680-93ee-4744-b166-31959a66c15f admin admin] The token cache is being invalidate because project e004f64b8d1f4b408faf70f88f8e56dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:50.177595 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-12862680-93ee-4744-b166-31959a66c15f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:50.178266 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-12862680-93ee-4744-b166-31959a66c15f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:50.180018 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1081/2173] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:49 2022] DELETE /identity/v3/projects/e004f64b8d1f4b408faf70f88f8e56dc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:50.184676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab434189-791f-4b9e-9193-baaabd0331df None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:50.185120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab434189-791f-4b9e-9193-baaabd0331df None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:50.185241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab434189-791f-4b9e-9193-baaabd0331df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:50.214653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-ab434189-791f-4b9e-9193-baaabd0331df None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:50.215854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ab434189-791f-4b9e-9193-baaabd0331df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:50.274868 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1093/2174] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:50.282477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdefd98-3169-48fa-b103-3d698a265f4c None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:50.282763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdefd98-3169-48fa-b103-3d698a265f4c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:50.283038 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdefd98-3169-48fa-b103-3d698a265f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:50.301141 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-ffdefd98-3169-48fa-b103-3d698a265f4c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:50.302450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ffdefd98-3169-48fa-b103-3d698a265f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:50.310901 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1082/2175] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:50.315777 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab434189-791f-4b9e-9193-baaabd0331df None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:50.326222 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab434189-791f-4b9e-9193-baaabd0331df None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:50.331696 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a34da0-27c3-4c2f-99cb-8d4440664220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:50.332364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a34da0-27c3-4c2f-99cb-8d4440664220 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:50.332650 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a34da0-27c3-4c2f-99cb-8d4440664220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:50.332927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a34da0-27c3-4c2f-99cb-8d4440664220 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:50.333663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a34da0-27c3-4c2f-99cb-8d4440664220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:33:50.333975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a34da0-27c3-4c2f-99cb-8d4440664220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:50.335623 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a34da0-27c3-4c2f-99cb-8d4440664220 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:50.348056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1094/2176] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:33:50.351485 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdefd98-3169-48fa-b103-3d698a265f4c None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:50.360813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdefd98-3169-48fa-b103-3d698a265f4c None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:50.365805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee3543-5346-494b-b31d-5eb15a1f56a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:50.366496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee3543-5346-494b-b31d-5eb15a1f56a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:50.366780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee3543-5346-494b-b31d-5eb15a1f56a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:50.367084 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee3543-5346-494b-b31d-5eb15a1f56a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:50.367792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee3543-5346-494b-b31d-5eb15a1f56a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:50.369703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee3543-5346-494b-b31d-5eb15a1f56a4 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:50.396394 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1083/2177] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:50 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:50.400560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a34da0-27c3-4c2f-99cb-8d4440664220 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:50.411248 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a34da0-27c3-4c2f-99cb-8d4440664220 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:50.469044 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388e68c-4779-4aa7-8c73-66d961083fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:50.470115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388e68c-4779-4aa7-8c73-66d961083fba admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:50.470115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388e68c-4779-4aa7-8c73-66d961083fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:50.470301 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388e68c-4779-4aa7-8c73-66d961083fba admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:50.471077 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388e68c-4779-4aa7-8c73-66d961083fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:50.473309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388e68c-4779-4aa7-8c73-66d961083fba admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:50.493845 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1095/2178] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:50 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:50.497840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee3543-5346-494b-b31d-5eb15a1f56a4 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:50.508833 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee3543-5346-494b-b31d-5eb15a1f56a4 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:50.513473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218588f-5e24-4ef1-bbf6-b957d0cf81bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:50.514169 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218588f-5e24-4ef1-bbf6-b957d0cf81bb admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:50.514492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218588f-5e24-4ef1-bbf6-b957d0cf81bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:50.514772 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218588f-5e24-4ef1-bbf6-b957d0cf81bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:50.515550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218588f-5e24-4ef1-bbf6-b957d0cf81bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:50.517158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218588f-5e24-4ef1-bbf6-b957d0cf81bb admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:50.527579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1084/2179] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:50.531713 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388e68c-4779-4aa7-8c73-66d961083fba admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:50.541918 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388e68c-4779-4aa7-8c73-66d961083fba admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:50.546634 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ad9d9-af4b-4311-9cf8-1526913b61b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:50.547282 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ad9d9-af4b-4311-9cf8-1526913b61b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:50.547560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ad9d9-af4b-4311-9cf8-1526913b61b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:50.547833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ad9d9-af4b-4311-9cf8-1526913b61b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:50.548547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ad9d9-af4b-4311-9cf8-1526913b61b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:50.551153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ad9d9-af4b-4311-9cf8-1526913b61b6 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:50.560841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1096/2180] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:50.566390 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218588f-5e24-4ef1-bbf6-b957d0cf81bb admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:50.577376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218588f-5e24-4ef1-bbf6-b957d0cf81bb admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:50.582766 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7beab-f500-4863-a6ef-2afc1b85e19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:50.583691 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7beab-f500-4863-a6ef-2afc1b85e19b admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:50.583974 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7beab-f500-4863-a6ef-2afc1b85e19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:50.584474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7beab-f500-4863-a6ef-2afc1b85e19b admin admin] PATH_INFO: `/v3/projects/2e56710ab2c84d0991dc1b01cc470347/users/5d37c6e01457444e9f92b487c1661062/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:50.600129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7beab-f500-4863-a6ef-2afc1b85e19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e56710ab2c84d0991dc1b01cc470347, user_id=5d37c6e01457444e9f92b487c1661062, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:50.602876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7beab-f500-4863-a6ef-2afc1b85e19b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:50.616772 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1085/2181] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:50 2022] PUT /identity/v3/projects/2e56710ab2c84d0991dc1b01cc470347/users/5d37c6e01457444e9f92b487c1661062/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:50.628580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd135e-f9b2-4a53-8b00-46677ee8feac None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:50.629057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd135e-f9b2-4a53-8b00-46677ee8feac None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:50.629332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd135e-f9b2-4a53-8b00-46677ee8feac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:50.655388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-66dd135e-f9b2-4a53-8b00-46677ee8feac None None] MFA Rules not processed for user `5d37c6e01457444e9f92b487c1661062`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:50.656599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-66dd135e-f9b2-4a53-8b00-46677ee8feac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:50.721802 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1097/2182] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:50.726353 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7beab-f500-4863-a6ef-2afc1b85e19b admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:50.792307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7beab-f500-4863-a6ef-2afc1b85e19b admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:50.798130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111a339-4f43-424b-aa44-60446a6276d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:50.799767 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111a339-4f43-424b-aa44-60446a6276d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:50.800465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111a339-4f43-424b-aa44-60446a6276d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:50.800465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111a339-4f43-424b-aa44-60446a6276d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:50.801239 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111a339-4f43-424b-aa44-60446a6276d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:50.802981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111a339-4f43-424b-aa44-60446a6276d2 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:50.833693 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1086/2183] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:50 2022] POST /identity/v3/projects => generated 399 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:33:50.837795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd135e-f9b2-4a53-8b00-46677ee8feac None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:50.850235 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd135e-f9b2-4a53-8b00-46677ee8feac None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:50.916260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da808a7a-5045-4f8a-9f07-21a1d6c10bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:50.916953 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da808a7a-5045-4f8a-9f07-21a1d6c10bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:50.917244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da808a7a-5045-4f8a-9f07-21a1d6c10bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:50.917524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da808a7a-5045-4f8a-9f07-21a1d6c10bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:50.918305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da808a7a-5045-4f8a-9f07-21a1d6c10bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:50.920464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da808a7a-5045-4f8a-9f07-21a1d6c10bd0 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:50.943412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1098/2184] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:50 2022] POST /identity/v3/users => generated 306 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:33:50.947699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111a339-4f43-424b-aa44-60446a6276d2 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:50.959080 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111a339-4f43-424b-aa44-60446a6276d2 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:50.964120 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25c76a-5626-4ce4-80d0-c3a114cec725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:50.964747 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25c76a-5626-4ce4-80d0-c3a114cec725 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:50.965029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25c76a-5626-4ce4-80d0-c3a114cec725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:50.965306 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25c76a-5626-4ce4-80d0-c3a114cec725 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:50.966043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25c76a-5626-4ce4-80d0-c3a114cec725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:50.967708 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25c76a-5626-4ce4-80d0-c3a114cec725 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:50.983121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1087/2185] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:50.985952 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da808a7a-5045-4f8a-9f07-21a1d6c10bd0 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:50.996766 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da808a7a-5045-4f8a-9f07-21a1d6c10bd0 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:51.002028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce876494-0dc2-4cc0-b58a-be00f0f2d430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:51.003112 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce876494-0dc2-4cc0-b58a-be00f0f2d430 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:51.003395 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce876494-0dc2-4cc0-b58a-be00f0f2d430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:51.003672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce876494-0dc2-4cc0-b58a-be00f0f2d430 admin admin] PATH_INFO: `/v3/projects/649c66cee59e461e89b98c67610e0ca3/users/27c48effcc0b40bdaa592ee8d247f9a1/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:51.019021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce876494-0dc2-4cc0-b58a-be00f0f2d430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649c66cee59e461e89b98c67610e0ca3, user_id=27c48effcc0b40bdaa592ee8d247f9a1, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:51.021857 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce876494-0dc2-4cc0-b58a-be00f0f2d430 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:51.036922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1099/2186] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:50 2022] PUT /identity/v3/projects/649c66cee59e461e89b98c67610e0ca3/users/27c48effcc0b40bdaa592ee8d247f9a1/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:51.040325 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25c76a-5626-4ce4-80d0-c3a114cec725 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:51.052115 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25c76a-5626-4ce4-80d0-c3a114cec725 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:51.127967 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857d610-82d1-4eeb-a74b-7c39b926aaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:51.128643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857d610-82d1-4eeb-a74b-7c39b926aaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:51.128941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857d610-82d1-4eeb-a74b-7c39b926aaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:51.129193 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857d610-82d1-4eeb-a74b-7c39b926aaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:51.129976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857d610-82d1-4eeb-a74b-7c39b926aaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:51.131791 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857d610-82d1-4eeb-a74b-7c39b926aaa3 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:51.142464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1088/2187] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:51.146737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce876494-0dc2-4cc0-b58a-be00f0f2d430 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:51.156801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce876494-0dc2-4cc0-b58a-be00f0f2d430 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:51.161927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f8b8e-007a-4ee9-b4b3-7052a2fbf46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:51.162825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f8b8e-007a-4ee9-b4b3-7052a2fbf46b admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:51.163107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f8b8e-007a-4ee9-b4b3-7052a2fbf46b admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:51.163386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f8b8e-007a-4ee9-b4b3-7052a2fbf46b admin admin] PATH_INFO: `/v3/projects/649c66cee59e461e89b98c67610e0ca3/users/27c48effcc0b40bdaa592ee8d247f9a1/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:51.165902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f8b8e-007a-4ee9-b4b3-7052a2fbf46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=649c66cee59e461e89b98c67610e0ca3, user_id=27c48effcc0b40bdaa592ee8d247f9a1, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:51.168659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f8b8e-007a-4ee9-b4b3-7052a2fbf46b admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:51.180129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1100/2188] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:51 2022] PUT /identity/v3/projects/649c66cee59e461e89b98c67610e0ca3/users/27c48effcc0b40bdaa592ee8d247f9a1/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:51.190725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f1644-1728-4550-8d44-260b233736ce None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:51.191028 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f1644-1728-4550-8d44-260b233736ce None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:51.191314 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f1644-1728-4550-8d44-260b233736ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:51.218672 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-322f1644-1728-4550-8d44-260b233736ce None None] MFA Rules not processed for user `27c48effcc0b40bdaa592ee8d247f9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:51.219807 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-322f1644-1728-4550-8d44-260b233736ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:51.291360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1089/2189] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:51.302200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f8b8e-007a-4ee9-b4b3-7052a2fbf46b admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:51.304156 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-214f8b8e-007a-4ee9-b4b3-7052a2fbf46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:51.370046 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f8b8e-007a-4ee9-b4b3-7052a2fbf46b admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:51.382692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f4667-0b06-433c-a30c-d2c8896eb355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:51.383389 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f4667-0b06-433c-a30c-d2c8896eb355 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:51.383645 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f4667-0b06-433c-a30c-d2c8896eb355 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:51.383937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f4667-0b06-433c-a30c-d2c8896eb355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:51.394577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f4667-0b06-433c-a30c-d2c8896eb355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:51.396056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f4667-0b06-433c-a30c-d2c8896eb355 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:51.406349 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1101/2190] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:51 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:51.495700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f1644-1728-4550-8d44-260b233736ce None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:51.507003 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f1644-1728-4550-8d44-260b233736ce None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:51.512492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bbb5b-bd93-4c3a-beb3-c02e01138073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:51.513401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bbb5b-bd93-4c3a-beb3-c02e01138073 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:51.513922 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bbb5b-bd93-4c3a-beb3-c02e01138073 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:51.514235 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bbb5b-bd93-4c3a-beb3-c02e01138073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:51.579184 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bbb5b-bd93-4c3a-beb3-c02e01138073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:51.581341 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bbb5b-bd93-4c3a-beb3-c02e01138073 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:51.592319 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1090/2191] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:55.660697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f4667-0b06-433c-a30c-d2c8896eb355 service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:55.721716 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f4667-0b06-433c-a30c-d2c8896eb355 service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:55.726339 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6f842-4a48-46a8-8d68-10bedff2512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:55.727225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6f842-4a48-46a8-8d68-10bedff2512b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:55.727509 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6f842-4a48-46a8-8d68-10bedff2512b admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:55.727803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6f842-4a48-46a8-8d68-10bedff2512b admin admin] PATH_INFO: `/v3/users/5d37c6e01457444e9f92b487c1661062` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:55.728962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6f842-4a48-46a8-8d68-10bedff2512b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d37c6e01457444e9f92b487c1661062)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:55.730959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6f842-4a48-46a8-8d68-10bedff2512b admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:55.776205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-68e6f842-4a48-46a8-8d68-10bedff2512b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d37c6e01457444e9f92b487c1661062'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:55.783175 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-68e6f842-4a48-46a8-8d68-10bedff2512b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d37c6e01457444e9f92b487c1661062'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:55.783970 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-68e6f842-4a48-46a8-8d68-10bedff2512b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d37c6e01457444e9f92b487c1661062'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:55.795322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-68e6f842-4a48-46a8-8d68-10bedff2512b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d37c6e01457444e9f92b487c1661062'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:55.802443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-68e6f842-4a48-46a8-8d68-10bedff2512b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d37c6e01457444e9f92b487c1661062'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:55.808127 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1102/2192] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:55 2022] DELETE /identity/v3/users/5d37c6e01457444e9f92b487c1661062 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:55.813437 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d547-be30-4f4b-9a31-cc1ff5b80435 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:55.813920 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d547-be30-4f4b-9a31-cc1ff5b80435 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:55.814033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d547-be30-4f4b-9a31-cc1ff5b80435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:55.832118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-a3b4d547-be30-4f4b-9a31-cc1ff5b80435 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:55.833310 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a3b4d547-be30-4f4b-9a31-cc1ff5b80435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:55.898627 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1091/2193] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:55.914005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6f842-4a48-46a8-8d68-10bedff2512b admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:55.915466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-68e6f842-4a48-46a8-8d68-10bedff2512b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:55.988539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6f842-4a48-46a8-8d68-10bedff2512b admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:55.992394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c858c-eb54-4137-b603-8761dc35f775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:55.993145 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c858c-eb54-4137-b603-8761dc35f775 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:55.993506 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c858c-eb54-4137-b603-8761dc35f775 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:55.993854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c858c-eb54-4137-b603-8761dc35f775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:56.003841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c858c-eb54-4137-b603-8761dc35f775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:56.005403 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c858c-eb54-4137-b603-8761dc35f775 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:56.015881 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1103/2194] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:33:56.289551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d547-be30-4f4b-9a31-cc1ff5b80435 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:56.291101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a3b4d547-be30-4f4b-9a31-cc1ff5b80435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:56.305828 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d547-be30-4f4b-9a31-cc1ff5b80435 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:56.312942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d73ab-355a-4633-b96b-0cdbae8c28b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:56.314285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d73ab-355a-4633-b96b-0cdbae8c28b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:56.314464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d73ab-355a-4633-b96b-0cdbae8c28b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:56.315449 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d73ab-355a-4633-b96b-0cdbae8c28b7 admin admin] PATH_INFO: `/v3/projects/2e56710ab2c84d0991dc1b01cc470347` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:56.316817 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d73ab-355a-4633-b96b-0cdbae8c28b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e56710ab2c84d0991dc1b01cc470347)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:56.318793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d73ab-355a-4633-b96b-0cdbae8c28b7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:56.371348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-842d73ab-355a-4633-b96b-0cdbae8c28b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e56710ab2c84d0991dc1b01cc470347', 'request_id': 'req-842d73ab-355a-4633-b96b-0cdbae8c28b7'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:56.378797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-842d73ab-355a-4633-b96b-0cdbae8c28b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e56710ab2c84d0991dc1b01cc470347', 'request_id': 'req-842d73ab-355a-4633-b96b-0cdbae8c28b7'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:56.387740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-842d73ab-355a-4633-b96b-0cdbae8c28b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e56710ab2c84d0991dc1b01cc470347', 'request_id': 'req-842d73ab-355a-4633-b96b-0cdbae8c28b7'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:56.402521 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-842d73ab-355a-4633-b96b-0cdbae8c28b7 admin admin] The token cache is being invalidate because project 2e56710ab2c84d0991dc1b01cc470347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:56.403194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-842d73ab-355a-4633-b96b-0cdbae8c28b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:56.403984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-842d73ab-355a-4633-b96b-0cdbae8c28b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:56.409734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1092/2195] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:56 2022] DELETE /identity/v3/projects/2e56710ab2c84d0991dc1b01cc470347 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:56.410281 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c858c-eb54-4137-b603-8761dc35f775 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:56.420880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c858c-eb54-4137-b603-8761dc35f775 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:56.488348 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab793bdd-8249-4c52-980d-94efe52a8606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:56.489223 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab793bdd-8249-4c52-980d-94efe52a8606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:56.489504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab793bdd-8249-4c52-980d-94efe52a8606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:56.489805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab793bdd-8249-4c52-980d-94efe52a8606 admin admin] PATH_INFO: `/v3/users/27c48effcc0b40bdaa592ee8d247f9a1` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:56.491009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab793bdd-8249-4c52-980d-94efe52a8606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c48effcc0b40bdaa592ee8d247f9a1)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:56.492949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab793bdd-8249-4c52-980d-94efe52a8606 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:56.542049 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ab793bdd-8249-4c52-980d-94efe52a8606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c48effcc0b40bdaa592ee8d247f9a1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:56.551312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ab793bdd-8249-4c52-980d-94efe52a8606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c48effcc0b40bdaa592ee8d247f9a1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:56.552035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ab793bdd-8249-4c52-980d-94efe52a8606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c48effcc0b40bdaa592ee8d247f9a1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:56.564418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ab793bdd-8249-4c52-980d-94efe52a8606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c48effcc0b40bdaa592ee8d247f9a1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:56.572402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ab793bdd-8249-4c52-980d-94efe52a8606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c48effcc0b40bdaa592ee8d247f9a1'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:56.578699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1104/2196] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:56 2022] DELETE /identity/v3/users/27c48effcc0b40bdaa592ee8d247f9a1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:33:56.888983 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d73ab-355a-4633-b96b-0cdbae8c28b7 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:56.890742 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-842d73ab-355a-4633-b96b-0cdbae8c28b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:56.909367 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d73ab-355a-4633-b96b-0cdbae8c28b7 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:56.971424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d819f9b-f7e5-4a1e-9cff-ac9595f5e55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:56.972784 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d819f9b-f7e5-4a1e-9cff-ac9595f5e55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:56.973076 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d819f9b-f7e5-4a1e-9cff-ac9595f5e55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:56.973349 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d819f9b-f7e5-4a1e-9cff-ac9595f5e55b admin admin] PATH_INFO: `/v3/projects/649c66cee59e461e89b98c67610e0ca3` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:56.974930 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d819f9b-f7e5-4a1e-9cff-ac9595f5e55b admin admin] RBAC: Authorizing `identity:delete_project(project_id=649c66cee59e461e89b98c67610e0ca3)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:56.976837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d819f9b-f7e5-4a1e-9cff-ac9595f5e55b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:57.025431 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7d819f9b-f7e5-4a1e-9cff-ac9595f5e55b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649c66cee59e461e89b98c67610e0ca3', 'request_id': 'req-7d819f9b-f7e5-4a1e-9cff-ac9595f5e55b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:57.031757 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7d819f9b-f7e5-4a1e-9cff-ac9595f5e55b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649c66cee59e461e89b98c67610e0ca3', 'request_id': 'req-7d819f9b-f7e5-4a1e-9cff-ac9595f5e55b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:57.039948 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7d819f9b-f7e5-4a1e-9cff-ac9595f5e55b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649c66cee59e461e89b98c67610e0ca3', 'request_id': 'req-7d819f9b-f7e5-4a1e-9cff-ac9595f5e55b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:57.050487 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7d819f9b-f7e5-4a1e-9cff-ac9595f5e55b admin admin] The token cache is being invalidate because project 649c66cee59e461e89b98c67610e0ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:57.050711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7d819f9b-f7e5-4a1e-9cff-ac9595f5e55b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:57.051353 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-7d819f9b-f7e5-4a1e-9cff-ac9595f5e55b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:57.052907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1093/2197] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:56 2022] DELETE /identity/v3/projects/649c66cee59e461e89b98c67610e0ca3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:57.058050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d0188-7798-4367-aeb5-d5474c05dbce None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.058555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d0188-7798-4367-aeb5-d5474c05dbce None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.058657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d0188-7798-4367-aeb5-d5474c05dbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:57.077611 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-b19d0188-7798-4367-aeb5-d5474c05dbce None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:57.078922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b19d0188-7798-4367-aeb5-d5474c05dbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:57.138865 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1105/2198] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:57.148177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be95fb-cbbd-41a5-b4bf-5f68a5638b1b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.148464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be95fb-cbbd-41a5-b4bf-5f68a5638b1b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.148743 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be95fb-cbbd-41a5-b4bf-5f68a5638b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:57.167767 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-a6be95fb-cbbd-41a5-b4bf-5f68a5638b1b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:57.168976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a6be95fb-cbbd-41a5-b4bf-5f68a5638b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:57.177541 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1094/2199] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:57.182378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d0188-7798-4367-aeb5-d5474c05dbce None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:57.192434 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d0188-7798-4367-aeb5-d5474c05dbce None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:57.197039 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990d21d-5772-4978-8f06-adb854ba7869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:57.197685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990d21d-5772-4978-8f06-adb854ba7869 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.197963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990d21d-5772-4978-8f06-adb854ba7869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.198268 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990d21d-5772-4978-8f06-adb854ba7869 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:57.199002 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990d21d-5772-4978-8f06-adb854ba7869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:33:57.199753 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990d21d-5772-4978-8f06-adb854ba7869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:57.201153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990d21d-5772-4978-8f06-adb854ba7869 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:57.213512 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1106/2200] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:33:57.217828 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be95fb-cbbd-41a5-b4bf-5f68a5638b1b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:57.227249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be95fb-cbbd-41a5-b4bf-5f68a5638b1b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:57.231884 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca589565-bb45-4f9c-be98-f6772e5002d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:57.232516 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca589565-bb45-4f9c-be98-f6772e5002d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.232797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca589565-bb45-4f9c-be98-f6772e5002d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.233071 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca589565-bb45-4f9c-be98-f6772e5002d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:57.233765 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca589565-bb45-4f9c-be98-f6772e5002d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:57.235714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca589565-bb45-4f9c-be98-f6772e5002d1 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:57.261904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1095/2201] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:57 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:33:57.266125 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990d21d-5772-4978-8f06-adb854ba7869 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:57.276102 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990d21d-5772-4978-8f06-adb854ba7869 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:57.331620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc77e5b-c670-475b-9993-8f653668531b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:57.332210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc77e5b-c670-475b-9993-8f653668531b admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.332494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc77e5b-c670-475b-9993-8f653668531b admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.332773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc77e5b-c670-475b-9993-8f653668531b admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:57.333463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc77e5b-c670-475b-9993-8f653668531b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:57.335508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc77e5b-c670-475b-9993-8f653668531b admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:57.355637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1107/2202] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:57 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:57.359806 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca589565-bb45-4f9c-be98-f6772e5002d1 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:57.373544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca589565-bb45-4f9c-be98-f6772e5002d1 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:57.379010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a42f22-ce23-4615-b991-9f20b402f387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:57.379673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a42f22-ce23-4615-b991-9f20b402f387 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.379955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a42f22-ce23-4615-b991-9f20b402f387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.380263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a42f22-ce23-4615-b991-9f20b402f387 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:57.380994 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a42f22-ce23-4615-b991-9f20b402f387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:57.382686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a42f22-ce23-4615-b991-9f20b402f387 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:57.393173 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1096/2203] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:57.397158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc77e5b-c670-475b-9993-8f653668531b admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:57.407011 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc77e5b-c670-475b-9993-8f653668531b admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:57.412341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b58cb-e6cf-4efe-99e8-3d871c1e6a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:57.412983 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b58cb-e6cf-4efe-99e8-3d871c1e6a68 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.413266 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b58cb-e6cf-4efe-99e8-3d871c1e6a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.413538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b58cb-e6cf-4efe-99e8-3d871c1e6a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:57.414285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b58cb-e6cf-4efe-99e8-3d871c1e6a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:57.415889 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b58cb-e6cf-4efe-99e8-3d871c1e6a68 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:57.426632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1108/2204] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:57.430579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a42f22-ce23-4615-b991-9f20b402f387 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:57.440990 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a42f22-ce23-4615-b991-9f20b402f387 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:57.445630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbccf55-ab5a-4b82-87fa-a03cf4ee9946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:57.446534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbccf55-ab5a-4b82-87fa-a03cf4ee9946 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.446843 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbccf55-ab5a-4b82-87fa-a03cf4ee9946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.447118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbccf55-ab5a-4b82-87fa-a03cf4ee9946 admin admin] PATH_INFO: `/v3/projects/1db486a2b92246b6bb03724bf1b88761/users/1ce3fba7d866448d8c1be5945b8eac1c/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:57.461497 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbccf55-ab5a-4b82-87fa-a03cf4ee9946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db486a2b92246b6bb03724bf1b88761, user_id=1ce3fba7d866448d8c1be5945b8eac1c, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:57.464200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbccf55-ab5a-4b82-87fa-a03cf4ee9946 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:57.476614 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1097/2205] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:57 2022] PUT /identity/v3/projects/1db486a2b92246b6bb03724bf1b88761/users/1ce3fba7d866448d8c1be5945b8eac1c/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:57.487333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b33bf-3dfd-4691-afb6-04be736f7e6d None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.487622 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b33bf-3dfd-4691-afb6-04be736f7e6d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.487901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b33bf-3dfd-4691-afb6-04be736f7e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:57.514101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-351b33bf-3dfd-4691-afb6-04be736f7e6d None None] MFA Rules not processed for user `1ce3fba7d866448d8c1be5945b8eac1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:57.515394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-351b33bf-3dfd-4691-afb6-04be736f7e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:57.576565 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1109/2206] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:57.581264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbccf55-ab5a-4b82-87fa-a03cf4ee9946 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:57.641537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbccf55-ab5a-4b82-87fa-a03cf4ee9946 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:57.646296 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff51c7-42f9-4fdd-b447-3c1e83f06dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:57.646946 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff51c7-42f9-4fdd-b447-3c1e83f06dcc admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.647232 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff51c7-42f9-4fdd-b447-3c1e83f06dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.647510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff51c7-42f9-4fdd-b447-3c1e83f06dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:57.648203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff51c7-42f9-4fdd-b447-3c1e83f06dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:57.650116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff51c7-42f9-4fdd-b447-3c1e83f06dcc admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:57.675543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1098/2207] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:57 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:57.679749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b33bf-3dfd-4691-afb6-04be736f7e6d None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:57.690099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b33bf-3dfd-4691-afb6-04be736f7e6d None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:57.744124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205ab5b-536c-44ae-bd58-e697696f39de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:57.744788 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205ab5b-536c-44ae-bd58-e697696f39de admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.745073 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205ab5b-536c-44ae-bd58-e697696f39de admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.745351 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205ab5b-536c-44ae-bd58-e697696f39de admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:57.746048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205ab5b-536c-44ae-bd58-e697696f39de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:57.748051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205ab5b-536c-44ae-bd58-e697696f39de admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:57.768016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1110/2208] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:57 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:33:57.772347 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff51c7-42f9-4fdd-b447-3c1e83f06dcc admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:57.782443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff51c7-42f9-4fdd-b447-3c1e83f06dcc admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:57.788355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767cf9f-f834-43cc-9806-0ab29425ee7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:57.789016 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767cf9f-f834-43cc-9806-0ab29425ee7c admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.789301 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767cf9f-f834-43cc-9806-0ab29425ee7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.789582 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767cf9f-f834-43cc-9806-0ab29425ee7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:57.790351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767cf9f-f834-43cc-9806-0ab29425ee7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:57.791962 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767cf9f-f834-43cc-9806-0ab29425ee7c admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:57.803232 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1099/2209] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:57.807205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205ab5b-536c-44ae-bd58-e697696f39de admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:57.817592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205ab5b-536c-44ae-bd58-e697696f39de admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:57.822514 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d1e14-f264-41c6-9f97-e2efd1c81bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:57.823390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d1e14-f264-41c6-9f97-e2efd1c81bea admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.823672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d1e14-f264-41c6-9f97-e2efd1c81bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.823948 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d1e14-f264-41c6-9f97-e2efd1c81bea admin admin] PATH_INFO: `/v3/projects/8bc876befd874e138425d08ce375e71e/users/ca5ff570eda34dbcb8857baf9a2ee20d/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:57.839934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d1e14-f264-41c6-9f97-e2efd1c81bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc876befd874e138425d08ce375e71e, user_id=ca5ff570eda34dbcb8857baf9a2ee20d, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:57.842983 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d1e14-f264-41c6-9f97-e2efd1c81bea admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:57.856245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1111/2210] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:57 2022] PUT /identity/v3/projects/8bc876befd874e138425d08ce375e71e/users/ca5ff570eda34dbcb8857baf9a2ee20d/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:57.860133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767cf9f-f834-43cc-9806-0ab29425ee7c admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:57.870809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767cf9f-f834-43cc-9806-0ab29425ee7c admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:57.927383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52e8b6-957a-4961-8357-c6f1aeb9d331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:57.928121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52e8b6-957a-4961-8357-c6f1aeb9d331 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.928413 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52e8b6-957a-4961-8357-c6f1aeb9d331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.928694 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52e8b6-957a-4961-8357-c6f1aeb9d331 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:57.929450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52e8b6-957a-4961-8357-c6f1aeb9d331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:57.931147 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52e8b6-957a-4961-8357-c6f1aeb9d331 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:57.941179 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1100/2211] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:57.945173 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d1e14-f264-41c6-9f97-e2efd1c81bea admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:57.956267 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d1e14-f264-41c6-9f97-e2efd1c81bea admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:57.961051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1a8df-684b-44e9-bc03-783400c046c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:57.961924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1a8df-684b-44e9-bc03-783400c046c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.962263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1a8df-684b-44e9-bc03-783400c046c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.962510 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1a8df-684b-44e9-bc03-783400c046c5 admin admin] PATH_INFO: `/v3/projects/8bc876befd874e138425d08ce375e71e/users/ca5ff570eda34dbcb8857baf9a2ee20d/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:57.964466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1a8df-684b-44e9-bc03-783400c046c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc876befd874e138425d08ce375e71e, user_id=ca5ff570eda34dbcb8857baf9a2ee20d, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:57.967165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1a8df-684b-44e9-bc03-783400c046c5 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:57.978498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1112/2212] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:57 2022] PUT /identity/v3/projects/8bc876befd874e138425d08ce375e71e/users/ca5ff570eda34dbcb8857baf9a2ee20d/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:57.989225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2cddb-17da-4e4b-8a8b-bbd3b452c900 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:57.989523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2cddb-17da-4e4b-8a8b-bbd3b452c900 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:57.989804 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2cddb-17da-4e4b-8a8b-bbd3b452c900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:58.015328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-50e2cddb-17da-4e4b-8a8b-bbd3b452c900 None None] MFA Rules not processed for user `ca5ff570eda34dbcb8857baf9a2ee20d`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:58.016519 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-50e2cddb-17da-4e4b-8a8b-bbd3b452c900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:58.084649 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1101/2213] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:58.096831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1a8df-684b-44e9-bc03-783400c046c5 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:58.098871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f9a1a8df-684b-44e9-bc03-783400c046c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:58.154644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1a8df-684b-44e9-bc03-783400c046c5 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:58.164306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7429cb-cfab-4777-88bb-a14b167e75ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:58.165159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7429cb-cfab-4777-88bb-a14b167e75ee service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:58.165447 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7429cb-cfab-4777-88bb-a14b167e75ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:58.165718 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7429cb-cfab-4777-88bb-a14b167e75ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:58.175147 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7429cb-cfab-4777-88bb-a14b167e75ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:58.176581 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7429cb-cfab-4777-88bb-a14b167e75ee service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:58.186610 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1113/2214] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:58.314811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2cddb-17da-4e4b-8a8b-bbd3b452c900 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:58.379727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2cddb-17da-4e4b-8a8b-bbd3b452c900 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:58.385768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4fee0-aa78-45a9-93c0-3fddf15eb2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:58.385768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4fee0-aa78-45a9-93c0-3fddf15eb2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:58.385768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4fee0-aa78-45a9-93c0-3fddf15eb2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:58.386101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4fee0-aa78-45a9-93c0-3fddf15eb2ef admin admin] PATH_INFO: `/v3/users/1ce3fba7d866448d8c1be5945b8eac1c` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:58.387072 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4fee0-aa78-45a9-93c0-3fddf15eb2ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce3fba7d866448d8c1be5945b8eac1c)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:58.389039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4fee0-aa78-45a9-93c0-3fddf15eb2ef admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:58.435875 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d9f4fee0-aa78-45a9-93c0-3fddf15eb2ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce3fba7d866448d8c1be5945b8eac1c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:58.443026 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d9f4fee0-aa78-45a9-93c0-3fddf15eb2ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce3fba7d866448d8c1be5945b8eac1c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:58.443696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d9f4fee0-aa78-45a9-93c0-3fddf15eb2ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce3fba7d866448d8c1be5945b8eac1c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:58.455823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d9f4fee0-aa78-45a9-93c0-3fddf15eb2ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce3fba7d866448d8c1be5945b8eac1c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:58.462600 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d9f4fee0-aa78-45a9-93c0-3fddf15eb2ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce3fba7d866448d8c1be5945b8eac1c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:58.468400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1102/2215] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:58 2022] DELETE /identity/v3/users/1ce3fba7d866448d8c1be5945b8eac1c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:58.473822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3ecf0-033c-4176-afac-d2f0e2b930d8 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:58.473936 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3ecf0-033c-4176-afac-d2f0e2b930d8 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:58.474155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3ecf0-033c-4176-afac-d2f0e2b930d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:58.491751 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-dee3ecf0-033c-4176-afac-d2f0e2b930d8 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:58.492951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-dee3ecf0-033c-4176-afac-d2f0e2b930d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:58.549591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1114/2216] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:58.559101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4fee0-aa78-45a9-93c0-3fddf15eb2ef admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:58.560516 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d9f4fee0-aa78-45a9-93c0-3fddf15eb2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:58.619414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4fee0-aa78-45a9-93c0-3fddf15eb2ef admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:58.623113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3de2cd-0c45-4e0a-8ba5-cbdfa00c52d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:58.623779 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3de2cd-0c45-4e0a-8ba5-cbdfa00c52d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:58.624041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3de2cd-0c45-4e0a-8ba5-cbdfa00c52d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:58.624314 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3de2cd-0c45-4e0a-8ba5-cbdfa00c52d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:58.633335 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3de2cd-0c45-4e0a-8ba5-cbdfa00c52d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:58.634806 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3de2cd-0c45-4e0a-8ba5-cbdfa00c52d1 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:58.644041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1103/2217] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:33:58.898864 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3ecf0-033c-4176-afac-d2f0e2b930d8 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:58.900387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-dee3ecf0-033c-4176-afac-d2f0e2b930d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:58.916036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3ecf0-033c-4176-afac-d2f0e2b930d8 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:58.920802 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c280ab-7077-46ee-8198-579e2924cb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:58.921686 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c280ab-7077-46ee-8198-579e2924cb41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:58.922017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c280ab-7077-46ee-8198-579e2924cb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:58.922325 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c280ab-7077-46ee-8198-579e2924cb41 admin admin] PATH_INFO: `/v3/projects/1db486a2b92246b6bb03724bf1b88761` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:58.923529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c280ab-7077-46ee-8198-579e2924cb41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db486a2b92246b6bb03724bf1b88761)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:58.925453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c280ab-7077-46ee-8198-579e2924cb41 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:58.971833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-67c280ab-7077-46ee-8198-579e2924cb41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db486a2b92246b6bb03724bf1b88761', 'request_id': 'req-67c280ab-7077-46ee-8198-579e2924cb41'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:58.977798 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-67c280ab-7077-46ee-8198-579e2924cb41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db486a2b92246b6bb03724bf1b88761', 'request_id': 'req-67c280ab-7077-46ee-8198-579e2924cb41'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:58.985106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-67c280ab-7077-46ee-8198-579e2924cb41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db486a2b92246b6bb03724bf1b88761', 'request_id': 'req-67c280ab-7077-46ee-8198-579e2924cb41'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:58.995389 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-67c280ab-7077-46ee-8198-579e2924cb41 admin admin] The token cache is being invalidate because project 1db486a2b92246b6bb03724bf1b88761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:58.995677 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-67c280ab-7077-46ee-8198-579e2924cb41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:58.996308 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-67c280ab-7077-46ee-8198-579e2924cb41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:58.997878 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1115/2218] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:58 2022] DELETE /identity/v3/projects/1db486a2b92246b6bb03724bf1b88761 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:59.001841 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3de2cd-0c45-4e0a-8ba5-cbdfa00c52d1 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:59.011693 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3de2cd-0c45-4e0a-8ba5-cbdfa00c52d1 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:59.067017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c70ab-60cf-4e61-a1d6-1ad993041090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:59.067890 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c70ab-60cf-4e61-a1d6-1ad993041090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:59.068171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c70ab-60cf-4e61-a1d6-1ad993041090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:59.068446 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c70ab-60cf-4e61-a1d6-1ad993041090 admin admin] PATH_INFO: `/v3/users/ca5ff570eda34dbcb8857baf9a2ee20d` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:59.069630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c70ab-60cf-4e61-a1d6-1ad993041090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5ff570eda34dbcb8857baf9a2ee20d)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:59.071594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c70ab-60cf-4e61-a1d6-1ad993041090 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:59.117464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-689c70ab-60cf-4e61-a1d6-1ad993041090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5ff570eda34dbcb8857baf9a2ee20d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:59.124162 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-689c70ab-60cf-4e61-a1d6-1ad993041090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5ff570eda34dbcb8857baf9a2ee20d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:59.124829 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-689c70ab-60cf-4e61-a1d6-1ad993041090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5ff570eda34dbcb8857baf9a2ee20d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:59.137324 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-689c70ab-60cf-4e61-a1d6-1ad993041090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5ff570eda34dbcb8857baf9a2ee20d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:59.144996 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-689c70ab-60cf-4e61-a1d6-1ad993041090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5ff570eda34dbcb8857baf9a2ee20d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:59.150817 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1104/2219] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:33:59 2022] DELETE /identity/v3/users/ca5ff570eda34dbcb8857baf9a2ee20d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:59.419301 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c280ab-7077-46ee-8198-579e2924cb41 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:59.420851 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-67c280ab-7077-46ee-8198-579e2924cb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:59.437086 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c280ab-7077-46ee-8198-579e2924cb41 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:59.496352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7037119-1e5e-4558-9ab7-29e85d6b15c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:59.497126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7037119-1e5e-4558-9ab7-29e85d6b15c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:59.497410 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7037119-1e5e-4558-9ab7-29e85d6b15c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:59.497681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7037119-1e5e-4558-9ab7-29e85d6b15c5 admin admin] PATH_INFO: `/v3/projects/8bc876befd874e138425d08ce375e71e` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:59.498889 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7037119-1e5e-4558-9ab7-29e85d6b15c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bc876befd874e138425d08ce375e71e)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:59.500844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7037119-1e5e-4558-9ab7-29e85d6b15c5 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:59.547399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f7037119-1e5e-4558-9ab7-29e85d6b15c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc876befd874e138425d08ce375e71e', 'request_id': 'req-f7037119-1e5e-4558-9ab7-29e85d6b15c5'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:59.553943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f7037119-1e5e-4558-9ab7-29e85d6b15c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc876befd874e138425d08ce375e71e', 'request_id': 'req-f7037119-1e5e-4558-9ab7-29e85d6b15c5'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:59.561770 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f7037119-1e5e-4558-9ab7-29e85d6b15c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc876befd874e138425d08ce375e71e', 'request_id': 'req-f7037119-1e5e-4558-9ab7-29e85d6b15c5'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:59.572266 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f7037119-1e5e-4558-9ab7-29e85d6b15c5 admin admin] The token cache is being invalidate because project 8bc876befd874e138425d08ce375e71e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:33:59.572552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f7037119-1e5e-4558-9ab7-29e85d6b15c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:59.573170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f7037119-1e5e-4558-9ab7-29e85d6b15c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:33:59.574729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1116/2220] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:33:59 2022] DELETE /identity/v3/projects/8bc876befd874e138425d08ce375e71e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:33:59.579816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360fcf2-b1b7-45e6-bae3-a784d1ae5729 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:59.580130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360fcf2-b1b7-45e6-bae3-a784d1ae5729 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:59.580436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360fcf2-b1b7-45e6-bae3-a784d1ae5729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:59.598864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-8360fcf2-b1b7-45e6-bae3-a784d1ae5729 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:59.600057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-8360fcf2-b1b7-45e6-bae3-a784d1ae5729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:59.657620 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1105/2221] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:33:59.667122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c5a48-9e88-43da-8a11-47b59ffa09d6 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:59.667404 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c5a48-9e88-43da-8a11-47b59ffa09d6 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:59.667678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c5a48-9e88-43da-8a11-47b59ffa09d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:59.685974 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-840c5a48-9e88-43da-8a11-47b59ffa09d6 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:33:59.687185 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-840c5a48-9e88-43da-8a11-47b59ffa09d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:33:59.694998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1117/2222] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:33:59.699096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360fcf2-b1b7-45e6-bae3-a784d1ae5729 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:59.709405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360fcf2-b1b7-45e6-bae3-a784d1ae5729 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:59.713952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226621b-af58-428a-b290-4c09774d3986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:59.714637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226621b-af58-428a-b290-4c09774d3986 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:59.714911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226621b-af58-428a-b290-4c09774d3986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:59.715180 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226621b-af58-428a-b290-4c09774d3986 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:59.715900 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226621b-af58-428a-b290-4c09774d3986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:33:59.716201 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226621b-af58-428a-b290-4c09774d3986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:59.717836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226621b-af58-428a-b290-4c09774d3986 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:59.729611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1106/2223] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:33:59.734044 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c5a48-9e88-43da-8a11-47b59ffa09d6 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:59.743057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c5a48-9e88-43da-8a11-47b59ffa09d6 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:59.747684 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1997d5c-f215-473c-a67b-1ec1aa95cde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:59.748258 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997d5c-f215-473c-a67b-1ec1aa95cde0 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:59.748535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997d5c-f215-473c-a67b-1ec1aa95cde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:59.748803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1997d5c-f215-473c-a67b-1ec1aa95cde0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:59.749489 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1997d5c-f215-473c-a67b-1ec1aa95cde0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:59.751404 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1997d5c-f215-473c-a67b-1ec1aa95cde0 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:59.777439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1118/2224] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:33:59 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:33:59.781558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226621b-af58-428a-b290-4c09774d3986 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:59.792296 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226621b-af58-428a-b290-4c09774d3986 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:59.848629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be7833-5d11-401f-8958-bb3f79dbcadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:59.849345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be7833-5d11-401f-8958-bb3f79dbcadf admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:59.849658 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be7833-5d11-401f-8958-bb3f79dbcadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:59.849937 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be7833-5d11-401f-8958-bb3f79dbcadf admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:59.850671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be7833-5d11-401f-8958-bb3f79dbcadf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:59.852586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be7833-5d11-401f-8958-bb3f79dbcadf admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:59.871928 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1107/2225] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:33:59 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:33:59.875999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1997d5c-f215-473c-a67b-1ec1aa95cde0 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:59.886998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1997d5c-f215-473c-a67b-1ec1aa95cde0 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:59.891724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea9d9b-3513-48d9-bfa0-099c75243364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:59.892372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea9d9b-3513-48d9-bfa0-099c75243364 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:59.893234 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea9d9b-3513-48d9-bfa0-099c75243364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:59.893514 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea9d9b-3513-48d9-bfa0-099c75243364 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:59.894387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea9d9b-3513-48d9-bfa0-099c75243364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:59.895988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea9d9b-3513-48d9-bfa0-099c75243364 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:59.906477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1119/2226] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:59.910371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be7833-5d11-401f-8958-bb3f79dbcadf admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:59.920721 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be7833-5d11-401f-8958-bb3f79dbcadf admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:59.925402 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814458f-8793-446d-a83b-8a490646b1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:59.926052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814458f-8793-446d-a83b-8a490646b1ad admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:59.926375 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814458f-8793-446d-a83b-8a490646b1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:59.926651 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814458f-8793-446d-a83b-8a490646b1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:59.927367 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814458f-8793-446d-a83b-8a490646b1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:59.928961 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814458f-8793-446d-a83b-8a490646b1ad admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:59.938751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1108/2227] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:33:59.943544 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea9d9b-3513-48d9-bfa0-099c75243364 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:33:59.953690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea9d9b-3513-48d9-bfa0-099c75243364 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:33:59.958921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b467d04-76ef-43b9-9738-e08c366ece28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:33:59.959799 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b467d04-76ef-43b9-9738-e08c366ece28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:33:59.960086 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b467d04-76ef-43b9-9738-e08c366ece28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:33:59.960365 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b467d04-76ef-43b9-9738-e08c366ece28 admin admin] PATH_INFO: `/v3/projects/eef73c9ed4b44abfae62250e4fc78030/users/8c2e7f6745594f17af6b44bf8eb850c3/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:33:59.975227 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b467d04-76ef-43b9-9738-e08c366ece28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef73c9ed4b44abfae62250e4fc78030, user_id=8c2e7f6745594f17af6b44bf8eb850c3, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:33:59.977894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b467d04-76ef-43b9-9738-e08c366ece28 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:33:59.991277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1120/2228] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:33:59 2022] PUT /identity/v3/projects/eef73c9ed4b44abfae62250e4fc78030/users/8c2e7f6745594f17af6b44bf8eb850c3/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:34:00.005765 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227dbf2-b0c1-4c33-ab0f-0db29bf41605 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:00.006304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227dbf2-b0c1-4c33-ab0f-0db29bf41605 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:00.006304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227dbf2-b0c1-4c33-ab0f-0db29bf41605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:00.033195 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-3227dbf2-b0c1-4c33-ab0f-0db29bf41605 None None] MFA Rules not processed for user `8c2e7f6745594f17af6b44bf8eb850c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:34:00.034637 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3227dbf2-b0c1-4c33-ab0f-0db29bf41605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:34:00.098366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1109/2229] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:34:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:34:00.102833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b467d04-76ef-43b9-9738-e08c366ece28 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:34:00.165931 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b467d04-76ef-43b9-9738-e08c366ece28 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:34:00.170641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d9495-fa4f-41a7-8b70-90bb743e626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:34:00.171293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d9495-fa4f-41a7-8b70-90bb743e626a admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:00.171577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d9495-fa4f-41a7-8b70-90bb743e626a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:00.171851 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d9495-fa4f-41a7-8b70-90bb743e626a admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:00.172537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d9495-fa4f-41a7-8b70-90bb743e626a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:34:00.175126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d9495-fa4f-41a7-8b70-90bb743e626a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:34:00.200291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1121/2230] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:34:00 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:34:00.204567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227dbf2-b0c1-4c33-ab0f-0db29bf41605 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:34:00.216036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227dbf2-b0c1-4c33-ab0f-0db29bf41605 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:34:00.271423 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46148a52-c34c-4108-99c1-ed9d456f38e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:34:00.272026 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46148a52-c34c-4108-99c1-ed9d456f38e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:00.272311 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46148a52-c34c-4108-99c1-ed9d456f38e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:00.272591 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46148a52-c34c-4108-99c1-ed9d456f38e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:00.273276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46148a52-c34c-4108-99c1-ed9d456f38e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:34:00.275293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46148a52-c34c-4108-99c1-ed9d456f38e8 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:34:00.295304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1110/2231] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:34:00 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:34:00.299309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d9495-fa4f-41a7-8b70-90bb743e626a admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:34:00.309332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d9495-fa4f-41a7-8b70-90bb743e626a admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:34:00.314039 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66564cd0-5cdc-44da-bbd5-160190b9cc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:34:00.314778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66564cd0-5cdc-44da-bbd5-160190b9cc1b admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:00.315057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66564cd0-5cdc-44da-bbd5-160190b9cc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:00.315329 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66564cd0-5cdc-44da-bbd5-160190b9cc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:00.316045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66564cd0-5cdc-44da-bbd5-160190b9cc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:34:00.317654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66564cd0-5cdc-44da-bbd5-160190b9cc1b admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:34:00.328023 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1122/2232] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:34:00.332625 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46148a52-c34c-4108-99c1-ed9d456f38e8 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:34:00.342828 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46148a52-c34c-4108-99c1-ed9d456f38e8 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:34:00.348700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edd5c1-f0a2-4b9a-bd9d-d9665d3a2268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:34:00.349567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edd5c1-f0a2-4b9a-bd9d-d9665d3a2268 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:00.349850 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edd5c1-f0a2-4b9a-bd9d-d9665d3a2268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:00.350124 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edd5c1-f0a2-4b9a-bd9d-d9665d3a2268 admin admin] PATH_INFO: `/v3/projects/5538e4c73a294912a14ff9e4b96317fa/users/98b6dfa19111476194e8b35ebafded1d/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:00.364981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edd5c1-f0a2-4b9a-bd9d-d9665d3a2268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5538e4c73a294912a14ff9e4b96317fa, user_id=98b6dfa19111476194e8b35ebafded1d, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:34:00.367697 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edd5c1-f0a2-4b9a-bd9d-d9665d3a2268 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:34:00.380847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1111/2233] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:34:00 2022] PUT /identity/v3/projects/5538e4c73a294912a14ff9e4b96317fa/users/98b6dfa19111476194e8b35ebafded1d/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:34:00.384411 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66564cd0-5cdc-44da-bbd5-160190b9cc1b admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:34:00.395371 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66564cd0-5cdc-44da-bbd5-160190b9cc1b admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:34:00.451395 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925e723-e5c4-4bdb-969d-aa9a854dae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:34:00.452053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925e723-e5c4-4bdb-969d-aa9a854dae5e admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:00.452334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925e723-e5c4-4bdb-969d-aa9a854dae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:00.452606 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925e723-e5c4-4bdb-969d-aa9a854dae5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:00.453316 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925e723-e5c4-4bdb-969d-aa9a854dae5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:34:00.454940 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925e723-e5c4-4bdb-969d-aa9a854dae5e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:34:00.465274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1123/2234] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:34:00.469365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edd5c1-f0a2-4b9a-bd9d-d9665d3a2268 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:34:00.481966 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edd5c1-f0a2-4b9a-bd9d-d9665d3a2268 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:34:00.486891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb4b8b-817d-45c6-8de1-06ef0dd41abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:34:00.487775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb4b8b-817d-45c6-8de1-06ef0dd41abb admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:00.488056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb4b8b-817d-45c6-8de1-06ef0dd41abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:00.488335 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb4b8b-817d-45c6-8de1-06ef0dd41abb admin admin] PATH_INFO: `/v3/projects/5538e4c73a294912a14ff9e4b96317fa/users/98b6dfa19111476194e8b35ebafded1d/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:00.490427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb4b8b-817d-45c6-8de1-06ef0dd41abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5538e4c73a294912a14ff9e4b96317fa, user_id=98b6dfa19111476194e8b35ebafded1d, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:34:00.493104 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb4b8b-817d-45c6-8de1-06ef0dd41abb admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:34:00.503299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1112/2235] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:34:00 2022] PUT /identity/v3/projects/5538e4c73a294912a14ff9e4b96317fa/users/98b6dfa19111476194e8b35ebafded1d/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:34:00.513233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9078ae7-d09b-4bec-a16a-7240095aff10 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:00.513524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9078ae7-d09b-4bec-a16a-7240095aff10 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:00.513806 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9078ae7-d09b-4bec-a16a-7240095aff10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:00.541309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-d9078ae7-d09b-4bec-a16a-7240095aff10 None None] MFA Rules not processed for user `98b6dfa19111476194e8b35ebafded1d`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:34:00.542546 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-d9078ae7-d09b-4bec-a16a-7240095aff10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:34:00.611200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1124/2236] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:34:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:34:00.623829 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb4b8b-817d-45c6-8de1-06ef0dd41abb admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:34:00.625531 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d9eb4b8b-817d-45c6-8de1-06ef0dd41abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:34:00.707032 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb4b8b-817d-45c6-8de1-06ef0dd41abb admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:34:00.710767 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d7272-c284-4bd8-9fda-18937097758d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:34:00.711412 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d7272-c284-4bd8-9fda-18937097758d service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:00.711697 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d7272-c284-4bd8-9fda-18937097758d service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:00.711976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d7272-c284-4bd8-9fda-18937097758d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:00.721212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d7272-c284-4bd8-9fda-18937097758d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:34:00.722689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d7272-c284-4bd8-9fda-18937097758d service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:34:00.731780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1113/2237] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:34:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:34:00.802072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9078ae7-d09b-4bec-a16a-7240095aff10 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:34:00.811549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9078ae7-d09b-4bec-a16a-7240095aff10 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:34:00.815766 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e2256-950d-4468-8d01-07a7bd62e321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:34:00.816406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e2256-950d-4468-8d01-07a7bd62e321 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:00.816742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e2256-950d-4468-8d01-07a7bd62e321 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:00.817095 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e2256-950d-4468-8d01-07a7bd62e321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:00.872636 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e2256-950d-4468-8d01-07a7bd62e321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:34:00.874062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e2256-950d-4468-8d01-07a7bd62e321 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:34:00.883617 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1125/2238] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:34:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:34:01.136457 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d7272-c284-4bd8-9fda-18937097758d service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:34:01.197037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d7272-c284-4bd8-9fda-18937097758d service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:34:01.201818 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c2adf-28c9-4b8e-8164-473ea939bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:34:01.202714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c2adf-28c9-4b8e-8164-473ea939bbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:01.202992 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c2adf-28c9-4b8e-8164-473ea939bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:01.203264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c2adf-28c9-4b8e-8164-473ea939bbd7 admin admin] PATH_INFO: `/v3/users/8c2e7f6745594f17af6b44bf8eb850c3` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:01.204425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c2adf-28c9-4b8e-8164-473ea939bbd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2e7f6745594f17af6b44bf8eb850c3)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:34:01.206405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c2adf-28c9-4b8e-8164-473ea939bbd7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:34:01.252662 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-690c2adf-28c9-4b8e-8164-473ea939bbd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2e7f6745594f17af6b44bf8eb850c3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:01.259327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-690c2adf-28c9-4b8e-8164-473ea939bbd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2e7f6745594f17af6b44bf8eb850c3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:01.260006 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-690c2adf-28c9-4b8e-8164-473ea939bbd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2e7f6745594f17af6b44bf8eb850c3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:01.271237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-690c2adf-28c9-4b8e-8164-473ea939bbd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2e7f6745594f17af6b44bf8eb850c3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:01.278228 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-690c2adf-28c9-4b8e-8164-473ea939bbd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2e7f6745594f17af6b44bf8eb850c3'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:01.284375 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1114/2239] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:34:01 2022] DELETE /identity/v3/users/8c2e7f6745594f17af6b44bf8eb850c3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:34:01.289094 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629d08d-aaca-4d63-8752-d4878b1f84c2 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:01.289384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629d08d-aaca-4d63-8752-d4878b1f84c2 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:01.289795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629d08d-aaca-4d63-8752-d4878b1f84c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:01.307312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-b629d08d-aaca-4d63-8752-d4878b1f84c2 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:34:01.308445 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b629d08d-aaca-4d63-8752-d4878b1f84c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:34:01.367280 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1126/2240] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:34:01.377027 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c2adf-28c9-4b8e-8164-473ea939bbd7 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:34:01.378639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-690c2adf-28c9-4b8e-8164-473ea939bbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:34:01.436014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c2adf-28c9-4b8e-8164-473ea939bbd7 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:34:01.440245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1ef14-4f93-4898-9b17-a4f9d73c3e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:34:01.440951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1ef14-4f93-4898-9b17-a4f9d73c3e57 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:01.441271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1ef14-4f93-4898-9b17-a4f9d73c3e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:01.441570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1ef14-4f93-4898-9b17-a4f9d73c3e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:01.451145 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1ef14-4f93-4898-9b17-a4f9d73c3e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:34:01.452568 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1ef14-4f93-4898-9b17-a4f9d73c3e57 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:34:01.463053 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1115/2241] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:34:01.725741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629d08d-aaca-4d63-8752-d4878b1f84c2 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:34:01.727376 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b629d08d-aaca-4d63-8752-d4878b1f84c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:34:01.742540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629d08d-aaca-4d63-8752-d4878b1f84c2 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:34:01.747316 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d46e1-43c9-4eff-a576-41ecd378799c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:34:01.748193 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d46e1-43c9-4eff-a576-41ecd378799c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:01.748544 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d46e1-43c9-4eff-a576-41ecd378799c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:01.748976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d46e1-43c9-4eff-a576-41ecd378799c admin admin] PATH_INFO: `/v3/projects/eef73c9ed4b44abfae62250e4fc78030` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:01.750209 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d46e1-43c9-4eff-a576-41ecd378799c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef73c9ed4b44abfae62250e4fc78030)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:34:01.752225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d46e1-43c9-4eff-a576-41ecd378799c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:34:01.802131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d14d46e1-43c9-4eff-a576-41ecd378799c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef73c9ed4b44abfae62250e4fc78030', 'request_id': 'req-d14d46e1-43c9-4eff-a576-41ecd378799c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:01.808554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d14d46e1-43c9-4eff-a576-41ecd378799c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef73c9ed4b44abfae62250e4fc78030', 'request_id': 'req-d14d46e1-43c9-4eff-a576-41ecd378799c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:01.817812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d14d46e1-43c9-4eff-a576-41ecd378799c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef73c9ed4b44abfae62250e4fc78030', 'request_id': 'req-d14d46e1-43c9-4eff-a576-41ecd378799c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:01.828409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d14d46e1-43c9-4eff-a576-41ecd378799c admin admin] The token cache is being invalidate because project eef73c9ed4b44abfae62250e4fc78030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:34:01.828742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d14d46e1-43c9-4eff-a576-41ecd378799c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:01.829426 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d14d46e1-43c9-4eff-a576-41ecd378799c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:01.831966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1127/2242] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:34:01 2022] DELETE /identity/v3/projects/eef73c9ed4b44abfae62250e4fc78030 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:34:01.836022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1ef14-4f93-4898-9b17-a4f9d73c3e57 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:34:01.846979 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1ef14-4f93-4898-9b17-a4f9d73c3e57 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:34:01.909526 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0dc60-2550-4cc2-bd0a-c860041ecbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:34:01.910479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0dc60-2550-4cc2-bd0a-c860041ecbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:01.910748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0dc60-2550-4cc2-bd0a-c860041ecbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:01.911211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0dc60-2550-4cc2-bd0a-c860041ecbbf admin admin] PATH_INFO: `/v3/users/98b6dfa19111476194e8b35ebafded1d` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:01.912704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0dc60-2550-4cc2-bd0a-c860041ecbbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=98b6dfa19111476194e8b35ebafded1d)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:34:01.914937 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0dc60-2550-4cc2-bd0a-c860041ecbbf admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:34:01.959208 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a6d0dc60-2550-4cc2-bd0a-c860041ecbbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b6dfa19111476194e8b35ebafded1d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:01.965856 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a6d0dc60-2550-4cc2-bd0a-c860041ecbbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b6dfa19111476194e8b35ebafded1d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:01.966746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a6d0dc60-2550-4cc2-bd0a-c860041ecbbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b6dfa19111476194e8b35ebafded1d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:01.980004 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a6d0dc60-2550-4cc2-bd0a-c860041ecbbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b6dfa19111476194e8b35ebafded1d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:01.988491 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a6d0dc60-2550-4cc2-bd0a-c860041ecbbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b6dfa19111476194e8b35ebafded1d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:01.994734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1116/2243] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:34:01 2022] DELETE /identity/v3/users/98b6dfa19111476194e8b35ebafded1d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:34:02.319853 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d46e1-43c9-4eff-a576-41ecd378799c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:34:02.321444 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-d14d46e1-43c9-4eff-a576-41ecd378799c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:34:02.340023 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d46e1-43c9-4eff-a576-41ecd378799c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:34:02.403372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ceb36f-f0a9-4161-a601-167ea7db5db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:34:02.404232 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceb36f-f0a9-4161-a601-167ea7db5db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:02.404527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceb36f-f0a9-4161-a601-167ea7db5db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:02.404807 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceb36f-f0a9-4161-a601-167ea7db5db8 admin admin] PATH_INFO: `/v3/projects/5538e4c73a294912a14ff9e4b96317fa` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:02.406015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ceb36f-f0a9-4161-a601-167ea7db5db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5538e4c73a294912a14ff9e4b96317fa)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:34:02.408003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ceb36f-f0a9-4161-a601-167ea7db5db8 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:34:02.456675 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-b3ceb36f-f0a9-4161-a601-167ea7db5db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5538e4c73a294912a14ff9e4b96317fa', 'request_id': 'req-b3ceb36f-f0a9-4161-a601-167ea7db5db8'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:02.463646 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-b3ceb36f-f0a9-4161-a601-167ea7db5db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5538e4c73a294912a14ff9e4b96317fa', 'request_id': 'req-b3ceb36f-f0a9-4161-a601-167ea7db5db8'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:02.473368 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-b3ceb36f-f0a9-4161-a601-167ea7db5db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5538e4c73a294912a14ff9e4b96317fa', 'request_id': 'req-b3ceb36f-f0a9-4161-a601-167ea7db5db8'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:02.484384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-b3ceb36f-f0a9-4161-a601-167ea7db5db8 admin admin] The token cache is being invalidate because project 5538e4c73a294912a14ff9e4b96317fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:34:02.484673 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-b3ceb36f-f0a9-4161-a601-167ea7db5db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:02.485330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-b3ceb36f-f0a9-4161-a601-167ea7db5db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:34:02.487741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1128/2244] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:34:02 2022] DELETE /identity/v3/projects/5538e4c73a294912a14ff9e4b96317fa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:34:36.023161 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6727276-4845-4dd5-82f0-d00adc6a7174 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:36.023698 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6727276-4845-4dd5-82f0-d00adc6a7174 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:36.023698 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6727276-4845-4dd5-82f0-d00adc6a7174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:36.041735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-d6727276-4845-4dd5-82f0-d00adc6a7174 None None] MFA Rules not processed for user `f8e456973fbc45c2b4c8c5ad8c982913`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:34:36.042980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d6727276-4845-4dd5-82f0-d00adc6a7174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:34:36.097019 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1117/2245] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:34:37.050614 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ceb36f-f0a9-4161-a601-167ea7db5db8 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:34:37.052295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b3ceb36f-f0a9-4161-a601-167ea7db5db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:34:37.140524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ceb36f-f0a9-4161-a601-167ea7db5db8 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:34:37.146425 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef63686-035f-4462-82f7-61a2db8669f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fad90f42ebfe43eb8256611a88df87ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:34:37.147059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef63686-035f-4462-82f7-61a2db8669f8 service placement] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:37.147343 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef63686-035f-4462-82f7-61a2db8669f8 service placement] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:37.147613 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef63686-035f-4462-82f7-61a2db8669f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:37.149330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-0ef63686-035f-4462-82f7-61a2db8669f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:34:37.161952 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef63686-035f-4462-82f7-61a2db8669f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:34:37.163568 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef63686-035f-4462-82f7-61a2db8669f8 service placement] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:34:37.173963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1129/2246] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:34:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:34:51.753233 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ba46e-3bab-4271-b3e4-eaa601b1097c None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:51.753762 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ba46e-3bab-4271-b3e4-eaa601b1097c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:51.753863 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ba46e-3bab-4271-b3e4-eaa601b1097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:51.812555 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-5c8ba46e-3bab-4271-b3e4-eaa601b1097c None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:34:51.813935 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5c8ba46e-3bab-4271-b3e4-eaa601b1097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:34:51.884749 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1118/2247] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 14:34:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:34:51.930298 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef63686-035f-4462-82f7-61a2db8669f8 service placement] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:34:51.931708 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-0ef63686-035f-4462-82f7-61a2db8669f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:34:52.023158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef63686-035f-4462-82f7-61a2db8669f8 service placement] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:34:52.028032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f05e0-6bd2-4406-ab18-dc9fde81524e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:34:52.028671 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f05e0-6bd2-4406-ab18-dc9fde81524e service swift] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:34:52.028950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f05e0-6bd2-4406-ab18-dc9fde81524e service swift] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:34:52.029222 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f05e0-6bd2-4406-ab18-dc9fde81524e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:34:52.037577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f05e0-6bd2-4406-ab18-dc9fde81524e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:34:52.039221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f05e0-6bd2-4406-ab18-dc9fde81524e service swift] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:34:52.047086 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1130/2248] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:34:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:35:14.760323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4365e-ebb1-4594-8d27-8a20bbf82ff2 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:35:14.760963 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4365e-ebb1-4594-8d27-8a20bbf82ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:35:14.760963 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4365e-ebb1-4594-8d27-8a20bbf82ff2 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:35:14.762259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1119/2249] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 14:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:35:14.769540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1c0ad-22f5-4e0e-a6ce-eca97dd44d85 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:35:14.770152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1c0ad-22f5-4e0e-a6ce-eca97dd44d85 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:35:14.770152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1c0ad-22f5-4e0e-a6ce-eca97dd44d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:35:14.822667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c5d1c0ad-22f5-4e0e-a6ce-eca97dd44d85 None None] MFA Rules not processed for user `1f443d2ca1534249bb2c4096300ddffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:35:14.823897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c5d1c0ad-22f5-4e0e-a6ce-eca97dd44d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:35:14.910927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1131/2250] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 14:35:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:35:14.927525 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4365e-ebb1-4594-8d27-8a20bbf82ff2 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:35:14.929297 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-cde4365e-ebb1-4594-8d27-8a20bbf82ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:35:15.016527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4365e-ebb1-4594-8d27-8a20bbf82ff2 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:35:15.020144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67318c-a096-44ec-9c9d-b4b8bf459f5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34ff47d8c4f4d99955340ddbdc3d475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:35:15.020787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67318c-a096-44ec-9c9d-b4b8bf459f5a service glance] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:35:15.021069 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67318c-a096-44ec-9c9d-b4b8bf459f5a service glance] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:35:15.021349 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67318c-a096-44ec-9c9d-b4b8bf459f5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:35:15.031551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67318c-a096-44ec-9c9d-b4b8bf459f5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:35:15.032991 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67318c-a096-44ec-9c9d-b4b8bf459f5a service glance] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:35:15.043391 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1120/2251] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:35:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:35:15.110063 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd31d80-58d4-45b1-9060-c04eeaf2927a None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:35:15.110384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd31d80-58d4-45b1-9060-c04eeaf2927a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:35:15.110667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd31d80-58d4-45b1-9060-c04eeaf2927a None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:35:15.112031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1132/2252] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 14:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:35:15.116821 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e9b79-10b1-45f5-b0e7-dd84d8fc92db None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:35:15.117116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e9b79-10b1-45f5-b0e7-dd84d8fc92db None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:35:15.117399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e9b79-10b1-45f5-b0e7-dd84d8fc92db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:35:15.135564 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7f1e9b79-10b1-45f5-b0e7-dd84d8fc92db None None] MFA Rules not processed for user `7b03ca44da654c3a9a5d9762b8eee189`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:35:15.136851 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7f1e9b79-10b1-45f5-b0e7-dd84d8fc92db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:35:15.190394 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1121/2253] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 14:35:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:35:15.203285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd31d80-58d4-45b1-9060-c04eeaf2927a None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:35:15.205026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-3cd31d80-58d4-45b1-9060-c04eeaf2927a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:35:15.219125 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd31d80-58d4-45b1-9060-c04eeaf2927a None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:35:15.222681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f991611-2a48-470d-a39f-a2106edb2ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:35:15.223375 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f991611-2a48-470d-a39f-a2106edb2ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:35:15.223652 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f991611-2a48-470d-a39f-a2106edb2ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:35:15.223921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f991611-2a48-470d-a39f-a2106edb2ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:35:15.230969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f991611-2a48-470d-a39f-a2106edb2ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:35:15.232381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f991611-2a48-470d-a39f-a2106edb2ae2 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:35:15.240829 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1133/2254] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:35:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:35:15.322536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d96714-d4e2-437d-9ce4-02b16d970209 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:35:15.322823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d96714-d4e2-437d-9ce4-02b16d970209 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:35:15.323100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d96714-d4e2-437d-9ce4-02b16d970209 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:35:15.324463 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1122/2255] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 14:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:35:15.330143 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bc8c2-8bb7-45fe-9fb4-26abde75b494 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:35:15.330463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bc8c2-8bb7-45fe-9fb4-26abde75b494 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:35:15.330741 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bc8c2-8bb7-45fe-9fb4-26abde75b494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:35:15.349255 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-cb6bc8c2-8bb7-45fe-9fb4-26abde75b494 None None] MFA Rules not processed for user `1f443d2ca1534249bb2c4096300ddffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:35:15.350482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-cb6bc8c2-8bb7-45fe-9fb4-26abde75b494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:35:15.360351 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1134/2256] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 14:35:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:35:15.370614 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d96714-d4e2-437d-9ce4-02b16d970209 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:35:15.381886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d96714-d4e2-437d-9ce4-02b16d970209 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:35:15.385798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9566d9-b388-4e0e-a4c6-6b88648133f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:35:15.386499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9566d9-b388-4e0e-a4c6-6b88648133f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:35:15.386789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9566d9-b388-4e0e-a4c6-6b88648133f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:35:15.387067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9566d9-b388-4e0e-a4c6-6b88648133f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:35:15.397165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9566d9-b388-4e0e-a4c6-6b88648133f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:35:15.398686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9566d9-b388-4e0e-a4c6-6b88648133f1 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:35:15.409733 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1123/2257] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:35:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:35:18.703809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec9bf0-c32e-4f1e-a173-25f6e268aaaf None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:35:18.704277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec9bf0-c32e-4f1e-a173-25f6e268aaaf None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:35:18.704368 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec9bf0-c32e-4f1e-a173-25f6e268aaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:35:18.724862 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-10ec9bf0-c32e-4f1e-a173-25f6e268aaaf None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:35:18.726060 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-10ec9bf0-c32e-4f1e-a173-25f6e268aaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:35:18.733306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1135/2258] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 14:35:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:35:18.745235 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9566d9-b388-4e0e-a4c6-6b88648133f1 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:35:18.756699 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9566d9-b388-4e0e-a4c6-6b88648133f1 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:35:18.761651 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a6b07-1cd7-4d7a-b619-1f107a7907aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:35:18.762392 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a6b07-1cd7-4d7a-b619-1f107a7907aa service swift] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:35:18.762680 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a6b07-1cd7-4d7a-b619-1f107a7907aa service swift] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:35:18.762958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a6b07-1cd7-4d7a-b619-1f107a7907aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:35:18.771769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a6b07-1cd7-4d7a-b619-1f107a7907aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:35:18.773352 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a6b07-1cd7-4d7a-b619-1f107a7907aa service swift] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:35:18.782089 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1124/2259] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:35:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:35:51.867813 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ac390-f5e9-46c7-a69f-bb9e7b6b81e0 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:35:51.868332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ac390-f5e9-46c7-a69f-bb9e7b6b81e0 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:35:51.868332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ac390-f5e9-46c7-a69f-bb9e7b6b81e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:35:51.885096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-507ac390-f5e9-46c7-a69f-bb9e7b6b81e0 None None] MFA Rules not processed for user `5998f94809ee4001b031b901a8fc39c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:35:51.886305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-507ac390-f5e9-46c7-a69f-bb9e7b6b81e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:35:51.939692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1136/2260] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:35:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:36:01.446427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2add0-e4dc-4da3-817d-89a49a789db9 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:36:01.446979 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2add0-e4dc-4da3-817d-89a49a789db9 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:36:01.446979 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2add0-e4dc-4da3-817d-89a49a789db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:36:01.469705 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-9be2add0-e4dc-4da3-817d-89a49a789db9 None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:36:01.471649 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-9be2add0-e4dc-4da3-817d-89a49a789db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:36:01.486389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1125/2261] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 17 14:36:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:36:01.504620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ac390-f5e9-46c7-a69f-bb9e7b6b81e0 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:36:01.519507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ac390-f5e9-46c7-a69f-bb9e7b6b81e0 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:36:01.524822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a53ca-1260-45aa-a481-369b6d2b8674 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:36:01.525481 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a53ca-1260-45aa-a481-369b6d2b8674 service swift] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:36:01.525765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a53ca-1260-45aa-a481-369b6d2b8674 service swift] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:36:01.526042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a53ca-1260-45aa-a481-369b6d2b8674 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:36:01.541494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a53ca-1260-45aa-a481-369b6d2b8674 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:36:01.543242 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a53ca-1260-45aa-a481-369b6d2b8674 service swift] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:36:01.552010 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1137/2262] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:36:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:36:06.181245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2add0-e4dc-4da3-817d-89a49a789db9 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:36:06.183023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-9be2add0-e4dc-4da3-817d-89a49a789db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:36:06.255762 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2add0-e4dc-4da3-817d-89a49a789db9 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:36:06.260595 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b999ff-e9e0-4a00-b2b4-839d61b24cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:36:06.261471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b999ff-e9e0-4a00-b2b4-839d61b24cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:36:06.261755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b999ff-e9e0-4a00-b2b4-839d61b24cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:36:06.262085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b999ff-e9e0-4a00-b2b4-839d61b24cd9 admin admin] PATH_INFO: `/v3/users/f8e456973fbc45c2b4c8c5ad8c982913` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:36:06.263359 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b999ff-e9e0-4a00-b2b4-839d61b24cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e456973fbc45c2b4c8c5ad8c982913)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:36:06.265311 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b999ff-e9e0-4a00-b2b4-839d61b24cd9 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:36:06.315038 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-47b999ff-e9e0-4a00-b2b4-839d61b24cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e456973fbc45c2b4c8c5ad8c982913'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:36:06.322160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-47b999ff-e9e0-4a00-b2b4-839d61b24cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e456973fbc45c2b4c8c5ad8c982913'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:36:06.322891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-47b999ff-e9e0-4a00-b2b4-839d61b24cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e456973fbc45c2b4c8c5ad8c982913'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:36:06.338682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-47b999ff-e9e0-4a00-b2b4-839d61b24cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e456973fbc45c2b4c8c5ad8c982913'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:36:06.349313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-47b999ff-e9e0-4a00-b2b4-839d61b24cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e456973fbc45c2b4c8c5ad8c982913'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:36:06.355762 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1126/2263] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:36:06 2022] DELETE /identity/v3/users/f8e456973fbc45c2b4c8c5ad8c982913 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:36:06.536233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a53ca-1260-45aa-a481-369b6d2b8674 service swift] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:36:06.551620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a53ca-1260-45aa-a481-369b6d2b8674 service swift] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:36:06.620227 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96360f62-8bb4-4476-964e-6ae7fb2deac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:36:06.621159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96360f62-8bb4-4476-964e-6ae7fb2deac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:36:06.621516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96360f62-8bb4-4476-964e-6ae7fb2deac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:36:06.621922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96360f62-8bb4-4476-964e-6ae7fb2deac9 admin admin] PATH_INFO: `/v3/projects/828d5bf5df484f8c844e10924cabbe32` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:36:06.623256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96360f62-8bb4-4476-964e-6ae7fb2deac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=828d5bf5df484f8c844e10924cabbe32)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:36:06.625221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96360f62-8bb4-4476-964e-6ae7fb2deac9 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:36:06.672315 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-96360f62-8bb4-4476-964e-6ae7fb2deac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '828d5bf5df484f8c844e10924cabbe32', 'request_id': 'req-96360f62-8bb4-4476-964e-6ae7fb2deac9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:36:06.679524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-96360f62-8bb4-4476-964e-6ae7fb2deac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '828d5bf5df484f8c844e10924cabbe32', 'request_id': 'req-96360f62-8bb4-4476-964e-6ae7fb2deac9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:36:06.687500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-96360f62-8bb4-4476-964e-6ae7fb2deac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '828d5bf5df484f8c844e10924cabbe32', 'request_id': 'req-96360f62-8bb4-4476-964e-6ae7fb2deac9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:36:06.697966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-96360f62-8bb4-4476-964e-6ae7fb2deac9 admin admin] The token cache is being invalidate because project 828d5bf5df484f8c844e10924cabbe32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:36:06.698284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-96360f62-8bb4-4476-964e-6ae7fb2deac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:36:06.698917 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-96360f62-8bb4-4476-964e-6ae7fb2deac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:36:06.700716 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1138/2264] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:36:06 2022] DELETE /identity/v3/projects/828d5bf5df484f8c844e10924cabbe32 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:36:32.451602 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b999ff-e9e0-4a00-b2b4-839d61b24cd9 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:36:32.452979 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-47b999ff-e9e0-4a00-b2b4-839d61b24cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:36:32.507655 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b999ff-e9e0-4a00-b2b4-839d61b24cd9 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:36:32.554655 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fb4f8-ec89-40d5-b555-e0449d7b7bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:36:32.555300 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fb4f8-ec89-40d5-b555-e0449d7b7bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:36:32.555577 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fb4f8-ec89-40d5-b555-e0449d7b7bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:36:32.555851 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fb4f8-ec89-40d5-b555-e0449d7b7bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:36:32.557600 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-190fb4f8-ec89-40d5-b555-e0449d7b7bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:36:32.626254 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fb4f8-ec89-40d5-b555-e0449d7b7bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:36:32.627686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fb4f8-ec89-40d5-b555-e0449d7b7bb3 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:36:32.638210 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1127/2265] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:36:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:36:37.088167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96360f62-8bb4-4476-964e-6ae7fb2deac9 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:36:37.089538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-96360f62-8bb4-4476-964e-6ae7fb2deac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:36:37.101570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96360f62-8bb4-4476-964e-6ae7fb2deac9 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:36:37.105073 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45538f9-f1b9-49c2-893a-2fbdf263fb98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:36:37.105690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45538f9-f1b9-49c2-893a-2fbdf263fb98 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:36:37.105968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45538f9-f1b9-49c2-893a-2fbdf263fb98 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:36:37.106275 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45538f9-f1b9-49c2-893a-2fbdf263fb98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:36:37.107949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e45538f9-f1b9-49c2-893a-2fbdf263fb98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:36:37.165783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45538f9-f1b9-49c2-893a-2fbdf263fb98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:36:37.167241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45538f9-f1b9-49c2-893a-2fbdf263fb98 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:36:37.176084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1139/2266] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:36:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:36:40.495687 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fb4f8-ec89-40d5-b555-e0449d7b7bb3 service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:36:40.503968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fb4f8-ec89-40d5-b555-e0449d7b7bb3 service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:36:40.507505 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f513ae-6a9d-4eee-bee2-4978954bc4de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:36:40.508132 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f513ae-6a9d-4eee-bee2-4978954bc4de service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:36:40.508410 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f513ae-6a9d-4eee-bee2-4978954bc4de service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:36:40.508682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f513ae-6a9d-4eee-bee2-4978954bc4de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:36:40.510407 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e5f513ae-6a9d-4eee-bee2-4978954bc4de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:36:40.523836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f513ae-6a9d-4eee-bee2-4978954bc4de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:36:40.525251 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f513ae-6a9d-4eee-bee2-4978954bc4de service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:36:40.536437 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1128/2267] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:36:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:36:53.752992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45538f9-f1b9-49c2-893a-2fbdf263fb98 service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:36:53.754637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e45538f9-f1b9-49c2-893a-2fbdf263fb98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:36:53.809594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45538f9-f1b9-49c2-893a-2fbdf263fb98 service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:36:53.813247 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e7c1d-d395-4979-b5e4-bf36238515f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:36:53.813882 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e7c1d-d395-4979-b5e4-bf36238515f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:36:53.814166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e7c1d-d395-4979-b5e4-bf36238515f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:36:53.814469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e7c1d-d395-4979-b5e4-bf36238515f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:36:53.816208 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6c7e7c1d-d395-4979-b5e4-bf36238515f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:36:53.825749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e7c1d-d395-4979-b5e4-bf36238515f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:36:53.827282 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e7c1d-d395-4979-b5e4-bf36238515f1 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:36:53.835672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1140/2268] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:36:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:36:57.189618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83b07d-7eb1-4e09-a835-d338e160b8ac None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:36:57.190112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83b07d-7eb1-4e09-a835-d338e160b8ac None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:36:57.190247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83b07d-7eb1-4e09-a835-d338e160b8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:36:57.207913 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7f83b07d-7eb1-4e09-a835-d338e160b8ac None None] MFA Rules not processed for user `5b1ec83a7b7546db943a3c1af3bdd2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:36:57.209099 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7f83b07d-7eb1-4e09-a835-d338e160b8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:36:57.215964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1129/2269] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:36:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:37:03.163847 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e7c1d-d395-4979-b5e4-bf36238515f1 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:37:03.165331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6c7e7c1d-d395-4979-b5e4-bf36238515f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:37:03.181752 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e7c1d-d395-4979-b5e4-bf36238515f1 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:37:03.190393 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6370d-e6fb-4c2a-8045-5a8c09b2dfe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:37:03.196177 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6370d-e6fb-4c2a-8045-5a8c09b2dfe4 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:37:03.196177 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6370d-e6fb-4c2a-8045-5a8c09b2dfe4 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:37:03.196177 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6370d-e6fb-4c2a-8045-5a8c09b2dfe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:37:03.196177 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-18d6370d-e6fb-4c2a-8045-5a8c09b2dfe4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:37:03.208312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6370d-e6fb-4c2a-8045-5a8c09b2dfe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:37:03.210010 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6370d-e6fb-4c2a-8045-5a8c09b2dfe4 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:37:03.221210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1141/2270] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:37:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:37:10.023813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83b07d-7eb1-4e09-a835-d338e160b8ac None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:37:10.037069 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83b07d-7eb1-4e09-a835-d338e160b8ac None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:37:10.042941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d898fa6-a081-42ee-a99e-70ea81e8e117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:37:10.043586 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d898fa6-a081-42ee-a99e-70ea81e8e117 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:37:10.043871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d898fa6-a081-42ee-a99e-70ea81e8e117 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:37:10.044152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d898fa6-a081-42ee-a99e-70ea81e8e117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:37:10.045900 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-9d898fa6-a081-42ee-a99e-70ea81e8e117 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:37:10.103690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d898fa6-a081-42ee-a99e-70ea81e8e117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:37:10.105284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d898fa6-a081-42ee-a99e-70ea81e8e117 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:37:10.115062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1130/2271] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:37:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:37:19.261871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cf2d9-d2bc-4755-a9ef-19afd8d59256 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:37:19.262408 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cf2d9-d2bc-4755-a9ef-19afd8d59256 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:37:19.262539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cf2d9-d2bc-4755-a9ef-19afd8d59256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:37:19.280093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-fc8cf2d9-d2bc-4755-a9ef-19afd8d59256 None None] MFA Rules not processed for user `357500181e4a43de8b1326d3db0b6f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:37:19.281291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-fc8cf2d9-d2bc-4755-a9ef-19afd8d59256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:37:19.289067 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1142/2272] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:37:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:37:19.583750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d898fa6-a081-42ee-a99e-70ea81e8e117 service nova] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:37:19.592664 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d898fa6-a081-42ee-a99e-70ea81e8e117 service nova] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:37:19.596270 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67761f9a-8711-4545-8ae7-dba73856dfe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:37:19.597389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67761f9a-8711-4545-8ae7-dba73856dfe4 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:37:19.597666 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67761f9a-8711-4545-8ae7-dba73856dfe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:37:19.597936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67761f9a-8711-4545-8ae7-dba73856dfe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:37:19.599691 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-67761f9a-8711-4545-8ae7-dba73856dfe4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:37:19.608772 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67761f9a-8711-4545-8ae7-dba73856dfe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:37:19.610206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67761f9a-8711-4545-8ae7-dba73856dfe4 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:37:19.618763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1131/2273] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:37:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:37:19.921672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cf2d9-d2bc-4755-a9ef-19afd8d59256 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:37:19.925207 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-fc8cf2d9-d2bc-4755-a9ef-19afd8d59256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:37:19.995854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cf2d9-d2bc-4755-a9ef-19afd8d59256 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:37:20.000794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51d1b-aa24-4084-a223-5954eaa25869 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fad90f42ebfe43eb8256611a88df87ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:37:20.001465 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51d1b-aa24-4084-a223-5954eaa25869 service placement] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:37:20.001750 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51d1b-aa24-4084-a223-5954eaa25869 service placement] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:37:20.002030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51d1b-aa24-4084-a223-5954eaa25869 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:37:20.004034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-10a51d1b-aa24-4084-a223-5954eaa25869 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:37:20.015150 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a51d1b-aa24-4084-a223-5954eaa25869 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:37:20.016737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a51d1b-aa24-4084-a223-5954eaa25869 service placement] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:37:20.027514 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1143/2274] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:37:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:37:28.999075 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67761f9a-8711-4545-8ae7-dba73856dfe4 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:37:29.000542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-67761f9a-8711-4545-8ae7-dba73856dfe4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:37:29.024715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67761f9a-8711-4545-8ae7-dba73856dfe4 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:37:29.030396 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8b46a-d42f-487e-9087-fa966cc03b2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:37:29.031039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b46a-d42f-487e-9087-fa966cc03b2e service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:37:29.031320 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b46a-d42f-487e-9087-fa966cc03b2e service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:37:29.031596 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b46a-d42f-487e-9087-fa966cc03b2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:37:29.033701 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5db8b46a-d42f-487e-9087-fa966cc03b2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:37:29.047170 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8b46a-d42f-487e-9087-fa966cc03b2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:37:29.048797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8b46a-d42f-487e-9087-fa966cc03b2e service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:37:29.059395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1132/2275] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:37:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:37:31.391896 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51d1b-aa24-4084-a223-5954eaa25869 service placement] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:37:31.404077 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51d1b-aa24-4084-a223-5954eaa25869 service placement] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:37:31.409515 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f7ef1-bc5a-425c-9e72-b0cdaa6ad0f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:37:31.410149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f7ef1-bc5a-425c-9e72-b0cdaa6ad0f6 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:37:31.410510 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f7ef1-bc5a-425c-9e72-b0cdaa6ad0f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:37:31.410789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f7ef1-bc5a-425c-9e72-b0cdaa6ad0f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:37:31.412552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-216f7ef1-bc5a-425c-9e72-b0cdaa6ad0f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:37:31.469609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f7ef1-bc5a-425c-9e72-b0cdaa6ad0f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:37:31.471163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f7ef1-bc5a-425c-9e72-b0cdaa6ad0f6 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:37:31.480521 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1144/2276] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:37:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:37:32.933215 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8b46a-d42f-487e-9087-fa966cc03b2e service nova] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:37:32.946148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8b46a-d42f-487e-9087-fa966cc03b2e service nova] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:37:32.953046 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a4325-9866-4b2b-a6f1-0bf0b03d7f46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:37:32.954066 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a4325-9866-4b2b-a6f1-0bf0b03d7f46 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:37:32.954380 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a4325-9866-4b2b-a6f1-0bf0b03d7f46 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:37:32.954835 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a4325-9866-4b2b-a6f1-0bf0b03d7f46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:37:32.957332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-366a4325-9866-4b2b-a6f1-0bf0b03d7f46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:37:32.970954 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a4325-9866-4b2b-a6f1-0bf0b03d7f46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:37:32.973758 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a4325-9866-4b2b-a6f1-0bf0b03d7f46 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:37:32.986322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1133/2277] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:37:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:37:38.382075 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f7ef1-bc5a-425c-9e72-b0cdaa6ad0f6 service nova] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:37:38.393843 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f7ef1-bc5a-425c-9e72-b0cdaa6ad0f6 service nova] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:37:38.399464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0942554-362e-4a2a-96e4-715a40600812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:37:38.400113 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0942554-362e-4a2a-96e4-715a40600812 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:37:38.400403 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0942554-362e-4a2a-96e4-715a40600812 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:37:38.400681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0942554-362e-4a2a-96e4-715a40600812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:37:38.402463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f0942554-362e-4a2a-96e4-715a40600812 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:37:38.460601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0942554-362e-4a2a-96e4-715a40600812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:37:38.462263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0942554-362e-4a2a-96e4-715a40600812 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:37:38.471368 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1145/2278] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:37:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:37:50.720996 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529225f8-044a-4dcf-a391-8e59d7ea01c8 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:37:50.721506 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529225f8-044a-4dcf-a391-8e59d7ea01c8 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:37:50.721609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529225f8-044a-4dcf-a391-8e59d7ea01c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:37:50.739565 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-529225f8-044a-4dcf-a391-8e59d7ea01c8 None None] MFA Rules not processed for user `5998f94809ee4001b031b901a8fc39c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:37:50.740750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-529225f8-044a-4dcf-a391-8e59d7ea01c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:37:50.747453 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1134/2279] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:37:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:20.098726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0942554-362e-4a2a-96e4-715a40600812 service nova] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:20.107821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0942554-362e-4a2a-96e4-715a40600812 service nova] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:20.111975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011203a-d99b-46bc-b9d2-e457c63c45fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:20.112598 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011203a-d99b-46bc-b9d2-e457c63c45fb service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:20.112873 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011203a-d99b-46bc-b9d2-e457c63c45fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:20.113144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011203a-d99b-46bc-b9d2-e457c63c45fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:20.114898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2011203a-d99b-46bc-b9d2-e457c63c45fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:20.174704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011203a-d99b-46bc-b9d2-e457c63c45fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:20.176124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011203a-d99b-46bc-b9d2-e457c63c45fb service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:20.185504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1146/2280] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:38:23.437176 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529225f8-044a-4dcf-a391-8e59d7ea01c8 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:23.439609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-529225f8-044a-4dcf-a391-8e59d7ea01c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:23.455942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529225f8-044a-4dcf-a391-8e59d7ea01c8 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:23.460753 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e13aac-7c4d-4428-83a9-58cb28ae6e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:23.461653 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e13aac-7c4d-4428-83a9-58cb28ae6e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:23.462061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e13aac-7c4d-4428-83a9-58cb28ae6e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:23.462237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e13aac-7c4d-4428-83a9-58cb28ae6e1c admin admin] PATH_INFO: `/v3/users/5b1ec83a7b7546db943a3c1af3bdd2d9` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:23.463773 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e13aac-7c4d-4428-83a9-58cb28ae6e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1ec83a7b7546db943a3c1af3bdd2d9)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:23.465437 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e13aac-7c4d-4428-83a9-58cb28ae6e1c admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:23.517315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-07e13aac-7c4d-4428-83a9-58cb28ae6e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1ec83a7b7546db943a3c1af3bdd2d9'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:23.526560 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-07e13aac-7c4d-4428-83a9-58cb28ae6e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1ec83a7b7546db943a3c1af3bdd2d9'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:23.527305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-07e13aac-7c4d-4428-83a9-58cb28ae6e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1ec83a7b7546db943a3c1af3bdd2d9'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:23.545607 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-07e13aac-7c4d-4428-83a9-58cb28ae6e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1ec83a7b7546db943a3c1af3bdd2d9'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:23.554422 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-07e13aac-7c4d-4428-83a9-58cb28ae6e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1ec83a7b7546db943a3c1af3bdd2d9'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:23.560332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1135/2281] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:38:23 2022] DELETE /identity/v3/users/5b1ec83a7b7546db943a3c1af3bdd2d9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:23.732861 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011203a-d99b-46bc-b9d2-e457c63c45fb service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:23.743371 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011203a-d99b-46bc-b9d2-e457c63c45fb service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:23.797775 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8951a-7576-4361-ad03-3ad9c185b846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:23.799166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8951a-7576-4361-ad03-3ad9c185b846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:23.799446 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8951a-7576-4361-ad03-3ad9c185b846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:23.799716 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8951a-7576-4361-ad03-3ad9c185b846 admin admin] PATH_INFO: `/v3/projects/71557cd0787042da9b8b5fd1d0e93fcf` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:23.800880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8951a-7576-4361-ad03-3ad9c185b846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71557cd0787042da9b8b5fd1d0e93fcf)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:23.802828 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8951a-7576-4361-ad03-3ad9c185b846 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:23.847455 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-08a8951a-7576-4361-ad03-3ad9c185b846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71557cd0787042da9b8b5fd1d0e93fcf', 'request_id': 'req-08a8951a-7576-4361-ad03-3ad9c185b846'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:23.854261 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-08a8951a-7576-4361-ad03-3ad9c185b846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71557cd0787042da9b8b5fd1d0e93fcf', 'request_id': 'req-08a8951a-7576-4361-ad03-3ad9c185b846'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:23.861290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-08a8951a-7576-4361-ad03-3ad9c185b846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71557cd0787042da9b8b5fd1d0e93fcf', 'request_id': 'req-08a8951a-7576-4361-ad03-3ad9c185b846'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:23.873252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-08a8951a-7576-4361-ad03-3ad9c185b846 admin admin] The token cache is being invalidate because project 71557cd0787042da9b8b5fd1d0e93fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:38:23.873534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-08a8951a-7576-4361-ad03-3ad9c185b846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:23.874163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-08a8951a-7576-4361-ad03-3ad9c185b846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:23.875707 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1147/2282] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:38:23 2022] DELETE /identity/v3/projects/71557cd0787042da9b8b5fd1d0e93fcf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:23.880867 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47835d8-16f2-4995-b545-5077dd6b644e None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:23.881202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47835d8-16f2-4995-b545-5077dd6b644e None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:23.881505 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47835d8-16f2-4995-b545-5077dd6b644e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:23.900200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b47835d8-16f2-4995-b545-5077dd6b644e None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:23.901381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b47835d8-16f2-4995-b545-5077dd6b644e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:23.958160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1136/2283] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:23.965578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9976a71-a614-4b37-be15-2c9aa361abcf None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:23.965865 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9976a71-a614-4b37-be15-2c9aa361abcf None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:23.966146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9976a71-a614-4b37-be15-2c9aa361abcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:23.984550 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c9976a71-a614-4b37-be15-2c9aa361abcf None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:23.985794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c9976a71-a614-4b37-be15-2c9aa361abcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:23.993841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1148/2284] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:23.997877 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47835d8-16f2-4995-b545-5077dd6b644e None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:24.008011 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47835d8-16f2-4995-b545-5077dd6b644e None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:24.012606 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5131bcc-2565-4e6b-b8ac-42354212edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:24.013258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5131bcc-2565-4e6b-b8ac-42354212edaf admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:24.013547 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5131bcc-2565-4e6b-b8ac-42354212edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:24.013824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5131bcc-2565-4e6b-b8ac-42354212edaf admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:24.014581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5131bcc-2565-4e6b-b8ac-42354212edaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:38:24.014892 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5131bcc-2565-4e6b-b8ac-42354212edaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:24.016503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5131bcc-2565-4e6b-b8ac-42354212edaf admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:24.028462 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1137/2285] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:38:24.032796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9976a71-a614-4b37-be15-2c9aa361abcf None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:24.041956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9976a71-a614-4b37-be15-2c9aa361abcf None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:24.046737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc7164-c9de-4d6e-8fb7-4229b376e016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:24.047395 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc7164-c9de-4d6e-8fb7-4229b376e016 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:24.047694 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc7164-c9de-4d6e-8fb7-4229b376e016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:24.047966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc7164-c9de-4d6e-8fb7-4229b376e016 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:24.048730 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc7164-c9de-4d6e-8fb7-4229b376e016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:24.050742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc7164-c9de-4d6e-8fb7-4229b376e016 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:24.085522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1149/2286] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:38:24 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:38:24.089771 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5131bcc-2565-4e6b-b8ac-42354212edaf admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:24.100150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5131bcc-2565-4e6b-b8ac-42354212edaf admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:24.156780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88de0b-fce1-4dfe-bb39-6b2142a46281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:24.157452 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88de0b-fce1-4dfe-bb39-6b2142a46281 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:24.157746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88de0b-fce1-4dfe-bb39-6b2142a46281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:24.158023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88de0b-fce1-4dfe-bb39-6b2142a46281 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:24.158850 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88de0b-fce1-4dfe-bb39-6b2142a46281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:24.160776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88de0b-fce1-4dfe-bb39-6b2142a46281 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:24.180039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1138/2287] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:38:24 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:38:24.184138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc7164-c9de-4d6e-8fb7-4229b376e016 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:24.195004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc7164-c9de-4d6e-8fb7-4229b376e016 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:24.200011 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bdb63-95fa-4617-b971-4a8ba570c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:24.200662 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bdb63-95fa-4617-b971-4a8ba570c8ed admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:24.200939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bdb63-95fa-4617-b971-4a8ba570c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:24.201209 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bdb63-95fa-4617-b971-4a8ba570c8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:24.201930 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bdb63-95fa-4617-b971-4a8ba570c8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:24.203565 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bdb63-95fa-4617-b971-4a8ba570c8ed admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:24.214155 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1150/2288] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:38:24.218074 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88de0b-fce1-4dfe-bb39-6b2142a46281 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:24.228064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88de0b-fce1-4dfe-bb39-6b2142a46281 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:24.232640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1da603-8d00-4ee6-bfdf-a49aa2bae2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:24.233288 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1da603-8d00-4ee6-bfdf-a49aa2bae2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:24.233574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1da603-8d00-4ee6-bfdf-a49aa2bae2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:24.233853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1da603-8d00-4ee6-bfdf-a49aa2bae2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:24.234684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1da603-8d00-4ee6-bfdf-a49aa2bae2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:24.236299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1da603-8d00-4ee6-bfdf-a49aa2bae2e4 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:24.245913 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1139/2289] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:38:24.250105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bdb63-95fa-4617-b971-4a8ba570c8ed admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:24.260853 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bdb63-95fa-4617-b971-4a8ba570c8ed admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:24.265419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55750d-f718-4cdc-964e-b701fc9250e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:24.266324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55750d-f718-4cdc-964e-b701fc9250e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:24.266602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55750d-f718-4cdc-964e-b701fc9250e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:24.266941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55750d-f718-4cdc-964e-b701fc9250e5 admin admin] PATH_INFO: `/v3/projects/b1c496f6d2e04e4da22e04b9d41854fa/users/7964d811ff1c4a9883de2d8d7c78920b/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:24.281325 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55750d-f718-4cdc-964e-b701fc9250e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c496f6d2e04e4da22e04b9d41854fa, user_id=7964d811ff1c4a9883de2d8d7c78920b, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:24.284559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55750d-f718-4cdc-964e-b701fc9250e5 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:24.296857 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1151/2290] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:38:24 2022] PUT /identity/v3/projects/b1c496f6d2e04e4da22e04b9d41854fa/users/7964d811ff1c4a9883de2d8d7c78920b/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:24.307591 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d731b36-061b-4e51-8d94-8eb68d4c5483 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:24.307908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d731b36-061b-4e51-8d94-8eb68d4c5483 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:24.308185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d731b36-061b-4e51-8d94-8eb68d4c5483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:24.334772 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-3d731b36-061b-4e51-8d94-8eb68d4c5483 None None] MFA Rules not processed for user `7964d811ff1c4a9883de2d8d7c78920b`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:24.335952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3d731b36-061b-4e51-8d94-8eb68d4c5483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:24.396240 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1140/2291] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:24.407348 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55750d-f718-4cdc-964e-b701fc9250e5 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:24.409458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-8d55750d-f718-4cdc-964e-b701fc9250e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:24.483221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55750d-f718-4cdc-964e-b701fc9250e5 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:24.489518 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76750ede-b2bb-4c42-a76b-2e04d6232af6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:24.490164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76750ede-b2bb-4c42-a76b-2e04d6232af6 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:24.490477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76750ede-b2bb-4c42-a76b-2e04d6232af6 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:24.490754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76750ede-b2bb-4c42-a76b-2e04d6232af6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:24.498606 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76750ede-b2bb-4c42-a76b-2e04d6232af6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:24.500198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76750ede-b2bb-4c42-a76b-2e04d6232af6 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:24.509958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1152/2292] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:38:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:38:27.161833 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d731b36-061b-4e51-8d94-8eb68d4c5483 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:27.221903 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d731b36-061b-4e51-8d94-8eb68d4c5483 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:27.226482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25eb66-9b96-47b8-84b1-c3ae87aa3a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:27.227351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25eb66-9b96-47b8-84b1-c3ae87aa3a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:27.227633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25eb66-9b96-47b8-84b1-c3ae87aa3a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:27.227926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25eb66-9b96-47b8-84b1-c3ae87aa3a51 admin admin] PATH_INFO: `/v3/users/7964d811ff1c4a9883de2d8d7c78920b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:27.229090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25eb66-9b96-47b8-84b1-c3ae87aa3a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7964d811ff1c4a9883de2d8d7c78920b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:27.231068 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25eb66-9b96-47b8-84b1-c3ae87aa3a51 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:27.277391 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-df25eb66-9b96-47b8-84b1-c3ae87aa3a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7964d811ff1c4a9883de2d8d7c78920b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:27.284667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-df25eb66-9b96-47b8-84b1-c3ae87aa3a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7964d811ff1c4a9883de2d8d7c78920b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:27.285367 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-df25eb66-9b96-47b8-84b1-c3ae87aa3a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7964d811ff1c4a9883de2d8d7c78920b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:27.297873 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-df25eb66-9b96-47b8-84b1-c3ae87aa3a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7964d811ff1c4a9883de2d8d7c78920b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:27.305217 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-df25eb66-9b96-47b8-84b1-c3ae87aa3a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7964d811ff1c4a9883de2d8d7c78920b'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:27.311281 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1141/2293] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:38:27 2022] DELETE /identity/v3/users/7964d811ff1c4a9883de2d8d7c78920b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:27.316401 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758337d3-4cbb-4adc-bbcc-bf73ae2cd56b None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:27.316858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758337d3-4cbb-4adc-bbcc-bf73ae2cd56b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:27.316949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758337d3-4cbb-4adc-bbcc-bf73ae2cd56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:27.334575 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-758337d3-4cbb-4adc-bbcc-bf73ae2cd56b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:27.335763 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-758337d3-4cbb-4adc-bbcc-bf73ae2cd56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:27.395443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1153/2294] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:38:27.405062 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25eb66-9b96-47b8-84b1-c3ae87aa3a51 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:27.406534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-df25eb66-9b96-47b8-84b1-c3ae87aa3a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:27.462838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25eb66-9b96-47b8-84b1-c3ae87aa3a51 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:27.466459 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6f0a8-d290-414e-b384-7ed7d434bb41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:27.467108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6f0a8-d290-414e-b384-7ed7d434bb41 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:27.467389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6f0a8-d290-414e-b384-7ed7d434bb41 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:27.467673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6f0a8-d290-414e-b384-7ed7d434bb41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:27.476802 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6f0a8-d290-414e-b384-7ed7d434bb41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:27.478264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6f0a8-d290-414e-b384-7ed7d434bb41 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:27.488099 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1142/2295] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:38:27.748973 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758337d3-4cbb-4adc-bbcc-bf73ae2cd56b None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:27.750590 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-758337d3-4cbb-4adc-bbcc-bf73ae2cd56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:27.763234 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758337d3-4cbb-4adc-bbcc-bf73ae2cd56b None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:27.769978 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e2fdc-fcaf-43b7-9c2b-435d831ba03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:27.771738 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2fdc-fcaf-43b7-9c2b-435d831ba03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:27.772056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2fdc-fcaf-43b7-9c2b-435d831ba03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:27.772318 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2fdc-fcaf-43b7-9c2b-435d831ba03e admin admin] PATH_INFO: `/v3/projects/b1c496f6d2e04e4da22e04b9d41854fa` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:27.773584 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e2fdc-fcaf-43b7-9c2b-435d831ba03e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c496f6d2e04e4da22e04b9d41854fa)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:27.775559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e2fdc-fcaf-43b7-9c2b-435d831ba03e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:27.823008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ee0e2fdc-fcaf-43b7-9c2b-435d831ba03e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c496f6d2e04e4da22e04b9d41854fa', 'request_id': 'req-ee0e2fdc-fcaf-43b7-9c2b-435d831ba03e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:27.829032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ee0e2fdc-fcaf-43b7-9c2b-435d831ba03e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c496f6d2e04e4da22e04b9d41854fa', 'request_id': 'req-ee0e2fdc-fcaf-43b7-9c2b-435d831ba03e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:27.836453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ee0e2fdc-fcaf-43b7-9c2b-435d831ba03e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c496f6d2e04e4da22e04b9d41854fa', 'request_id': 'req-ee0e2fdc-fcaf-43b7-9c2b-435d831ba03e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:27.846844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ee0e2fdc-fcaf-43b7-9c2b-435d831ba03e admin admin] The token cache is being invalidate because project b1c496f6d2e04e4da22e04b9d41854fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:38:27.847126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ee0e2fdc-fcaf-43b7-9c2b-435d831ba03e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:27.847760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-ee0e2fdc-fcaf-43b7-9c2b-435d831ba03e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:27.849264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1154/2296] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:38:27 2022] DELETE /identity/v3/projects/b1c496f6d2e04e4da22e04b9d41854fa => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:27.854067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ed74-8a27-457b-9c3e-05396436112b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:27.854386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ed74-8a27-457b-9c3e-05396436112b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:27.854666 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ed74-8a27-457b-9c3e-05396436112b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:27.872263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-f273ed74-8a27-457b-9c3e-05396436112b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:27.873443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f273ed74-8a27-457b-9c3e-05396436112b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:27.930256 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1143/2297] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:27.939489 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0eab7-df47-433d-8b81-dea9f86737c0 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:27.939809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0eab7-df47-433d-8b81-dea9f86737c0 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:27.940082 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0eab7-df47-433d-8b81-dea9f86737c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:27.958512 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-2bf0eab7-df47-433d-8b81-dea9f86737c0 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:27.959691 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2bf0eab7-df47-433d-8b81-dea9f86737c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:27.967314 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1155/2298] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:27.971368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273ed74-8a27-457b-9c3e-05396436112b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:27.981178 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273ed74-8a27-457b-9c3e-05396436112b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:27.986098 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381daed-e7da-48b3-b714-c233fbc7d6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:27.986787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381daed-e7da-48b3-b714-c233fbc7d6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:27.987073 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381daed-e7da-48b3-b714-c233fbc7d6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:27.987354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381daed-e7da-48b3-b714-c233fbc7d6d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:27.988076 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381daed-e7da-48b3-b714-c233fbc7d6d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:38:27.988385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381daed-e7da-48b3-b714-c233fbc7d6d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:27.990017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381daed-e7da-48b3-b714-c233fbc7d6d1 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:28.001815 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1144/2299] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:38:28.006071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0eab7-df47-433d-8b81-dea9f86737c0 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:28.015173 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0eab7-df47-433d-8b81-dea9f86737c0 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:28.020647 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba919b-78c0-4486-97b5-ec4c15af1cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:28.021319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba919b-78c0-4486-97b5-ec4c15af1cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:28.021602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba919b-78c0-4486-97b5-ec4c15af1cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:28.021899 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba919b-78c0-4486-97b5-ec4c15af1cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:28.022626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba919b-78c0-4486-97b5-ec4c15af1cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:28.024528 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba919b-78c0-4486-97b5-ec4c15af1cd4 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:28.049203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1156/2300] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:38:28 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:38:28.053358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381daed-e7da-48b3-b714-c233fbc7d6d1 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:28.063351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381daed-e7da-48b3-b714-c233fbc7d6d1 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:28.119555 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea57fa-6082-4c33-bff1-78f7559e59e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:28.120212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea57fa-6082-4c33-bff1-78f7559e59e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:28.120494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea57fa-6082-4c33-bff1-78f7559e59e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:28.120768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea57fa-6082-4c33-bff1-78f7559e59e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:28.121442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea57fa-6082-4c33-bff1-78f7559e59e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:28.123443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea57fa-6082-4c33-bff1-78f7559e59e0 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:28.144962 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1145/2301] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:38:28 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:38:28.149200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba919b-78c0-4486-97b5-ec4c15af1cd4 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:28.159524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba919b-78c0-4486-97b5-ec4c15af1cd4 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:28.164241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8706c20-45d2-4876-97d2-c49befa55f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:28.164886 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8706c20-45d2-4876-97d2-c49befa55f2f admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:28.165167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8706c20-45d2-4876-97d2-c49befa55f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:28.165435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8706c20-45d2-4876-97d2-c49befa55f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:28.166154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8706c20-45d2-4876-97d2-c49befa55f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:28.167783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8706c20-45d2-4876-97d2-c49befa55f2f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:28.179554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1157/2302] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:38:28.183500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea57fa-6082-4c33-bff1-78f7559e59e0 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:28.194118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea57fa-6082-4c33-bff1-78f7559e59e0 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:28.199556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d706b-3766-4674-9d94-4e1967660a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:28.199819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d706b-3766-4674-9d94-4e1967660a2d admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:28.200101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d706b-3766-4674-9d94-4e1967660a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:28.200375 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d706b-3766-4674-9d94-4e1967660a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:28.201097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d706b-3766-4674-9d94-4e1967660a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:28.202888 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d706b-3766-4674-9d94-4e1967660a2d admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:28.213284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1146/2303] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:38:28.217472 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8706c20-45d2-4876-97d2-c49befa55f2f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:28.227353 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8706c20-45d2-4876-97d2-c49befa55f2f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:28.231966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387ec1e-99e6-4e6d-b3c9-7c9955a7ab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:28.232835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387ec1e-99e6-4e6d-b3c9-7c9955a7ab37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:28.233116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387ec1e-99e6-4e6d-b3c9-7c9955a7ab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:28.233391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387ec1e-99e6-4e6d-b3c9-7c9955a7ab37 admin admin] PATH_INFO: `/v3/projects/8021d0ae1896405d92b215218ae0813a/users/2a5bcb6eb7404147b4a54d8ae777ef4e/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:28.248050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387ec1e-99e6-4e6d-b3c9-7c9955a7ab37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8021d0ae1896405d92b215218ae0813a, user_id=2a5bcb6eb7404147b4a54d8ae777ef4e, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:28.250814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387ec1e-99e6-4e6d-b3c9-7c9955a7ab37 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:28.265243 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1158/2304] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:38:28 2022] PUT /identity/v3/projects/8021d0ae1896405d92b215218ae0813a/users/2a5bcb6eb7404147b4a54d8ae777ef4e/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:28.275706 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3595d8-842c-43f2-b30e-2aa026f7d288 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:28.276018 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3595d8-842c-43f2-b30e-2aa026f7d288 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:28.276296 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3595d8-842c-43f2-b30e-2aa026f7d288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:28.305564 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-bd3595d8-842c-43f2-b30e-2aa026f7d288 None None] MFA Rules not processed for user `2a5bcb6eb7404147b4a54d8ae777ef4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:28.306781 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bd3595d8-842c-43f2-b30e-2aa026f7d288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:28.368366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1147/2305] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:28.372824 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387ec1e-99e6-4e6d-b3c9-7c9955a7ab37 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:28.436075 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387ec1e-99e6-4e6d-b3c9-7c9955a7ab37 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:28.442068 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ad206-e329-4170-8de5-1aca0afa4f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:28.442756 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ad206-e329-4170-8de5-1aca0afa4f99 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:28.443038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ad206-e329-4170-8de5-1aca0afa4f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:28.443313 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ad206-e329-4170-8de5-1aca0afa4f99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:28.444015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ad206-e329-4170-8de5-1aca0afa4f99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:28.446057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ad206-e329-4170-8de5-1aca0afa4f99 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:28.476034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1159/2306] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:38:28 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:38:28.477121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3595d8-842c-43f2-b30e-2aa026f7d288 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:28.488414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3595d8-842c-43f2-b30e-2aa026f7d288 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:28.545951 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c37dc7-b0bd-4b0e-a789-60b9c1f97567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:28.546917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c37dc7-b0bd-4b0e-a789-60b9c1f97567 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:28.547205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c37dc7-b0bd-4b0e-a789-60b9c1f97567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:28.547483 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c37dc7-b0bd-4b0e-a789-60b9c1f97567 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:28.548790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c37dc7-b0bd-4b0e-a789-60b9c1f97567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:28.551405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c37dc7-b0bd-4b0e-a789-60b9c1f97567 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:28.570838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1148/2307] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:38:28 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:38:28.575174 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ad206-e329-4170-8de5-1aca0afa4f99 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:28.585533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ad206-e329-4170-8de5-1aca0afa4f99 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:28.590091 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e532c35-49be-41ca-9d08-59c7e5819a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:28.590746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e532c35-49be-41ca-9d08-59c7e5819a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:28.591022 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e532c35-49be-41ca-9d08-59c7e5819a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:28.591292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e532c35-49be-41ca-9d08-59c7e5819a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:28.592002 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e532c35-49be-41ca-9d08-59c7e5819a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:28.593636 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e532c35-49be-41ca-9d08-59c7e5819a21 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:28.604271 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1160/2308] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:38:28.608503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c37dc7-b0bd-4b0e-a789-60b9c1f97567 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:28.619293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c37dc7-b0bd-4b0e-a789-60b9c1f97567 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:28.624923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b895a-1e2f-4f80-8117-34a3318cd44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:28.625763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b895a-1e2f-4f80-8117-34a3318cd44a admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:28.626084 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b895a-1e2f-4f80-8117-34a3318cd44a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:28.626439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b895a-1e2f-4f80-8117-34a3318cd44a admin admin] PATH_INFO: `/v3/projects/91e4a534482e45fe920fb168be91ae63/users/57376769cb8e4962bc02619b7a6d928d/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:28.640832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b895a-1e2f-4f80-8117-34a3318cd44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e4a534482e45fe920fb168be91ae63, user_id=57376769cb8e4962bc02619b7a6d928d, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:28.643700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b895a-1e2f-4f80-8117-34a3318cd44a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:28.656047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1149/2309] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:38:28 2022] PUT /identity/v3/projects/91e4a534482e45fe920fb168be91ae63/users/57376769cb8e4962bc02619b7a6d928d/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:28.660509 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e532c35-49be-41ca-9d08-59c7e5819a21 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:28.670131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e532c35-49be-41ca-9d08-59c7e5819a21 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:28.723159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2c289-6682-4876-bf21-e58f92527c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:28.723804 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2c289-6682-4876-bf21-e58f92527c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:28.724084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2c289-6682-4876-bf21-e58f92527c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:28.724350 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2c289-6682-4876-bf21-e58f92527c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:28.725059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2c289-6682-4876-bf21-e58f92527c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:28.726678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2c289-6682-4876-bf21-e58f92527c39 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:28.736517 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1161/2310] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:38:28.740759 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b895a-1e2f-4f80-8117-34a3318cd44a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:28.750832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b895a-1e2f-4f80-8117-34a3318cd44a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:28.755902 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6c70b-c9f5-4a06-8e44-79359a8f83d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:28.756768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6c70b-c9f5-4a06-8e44-79359a8f83d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:28.757046 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6c70b-c9f5-4a06-8e44-79359a8f83d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:28.757320 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6c70b-c9f5-4a06-8e44-79359a8f83d1 admin admin] PATH_INFO: `/v3/projects/91e4a534482e45fe920fb168be91ae63/users/57376769cb8e4962bc02619b7a6d928d/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:28.759299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6c70b-c9f5-4a06-8e44-79359a8f83d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e4a534482e45fe920fb168be91ae63, user_id=57376769cb8e4962bc02619b7a6d928d, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:28.761943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6c70b-c9f5-4a06-8e44-79359a8f83d1 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:28.772439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1150/2311] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:38:28 2022] PUT /identity/v3/projects/91e4a534482e45fe920fb168be91ae63/users/57376769cb8e4962bc02619b7a6d928d/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:28.782267 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dea45-bb67-4055-a60d-ec704398f86a None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:28.782663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dea45-bb67-4055-a60d-ec704398f86a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:28.782985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dea45-bb67-4055-a60d-ec704398f86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:28.810056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-946dea45-bb67-4055-a60d-ec704398f86a None None] MFA Rules not processed for user `57376769cb8e4962bc02619b7a6d928d`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:28.811311 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-946dea45-bb67-4055-a60d-ec704398f86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:28.877726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1162/2312] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:28.888665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6c70b-c9f5-4a06-8e44-79359a8f83d1 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:28.890368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-cbc6c70b-c9f5-4a06-8e44-79359a8f83d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:28.948499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6c70b-c9f5-4a06-8e44-79359a8f83d1 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:28.952110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c71dee-a634-4014-bde1-b4a23e2551be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:28.952758 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c71dee-a634-4014-bde1-b4a23e2551be service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:28.953038 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c71dee-a634-4014-bde1-b4a23e2551be service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:28.953315 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c71dee-a634-4014-bde1-b4a23e2551be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:28.962284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c71dee-a634-4014-bde1-b4a23e2551be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:28.963722 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c71dee-a634-4014-bde1-b4a23e2551be service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:28.973151 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1151/2313] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:38:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:38:29.045302 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dea45-bb67-4055-a60d-ec704398f86a None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:29.055556 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dea45-bb67-4055-a60d-ec704398f86a None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:29.059125 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e6216-ae33-49a8-ace8-82e96e25c556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:29.059747 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e6216-ae33-49a8-ace8-82e96e25c556 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:29.060025 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e6216-ae33-49a8-ace8-82e96e25c556 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:29.060298 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e6216-ae33-49a8-ace8-82e96e25c556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:29.115763 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e6216-ae33-49a8-ace8-82e96e25c556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:29.117206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e6216-ae33-49a8-ace8-82e96e25c556 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:29.125988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1163/2314] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:38:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:38:40.270782 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c71dee-a634-4014-bde1-b4a23e2551be service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:40.331471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c71dee-a634-4014-bde1-b4a23e2551be service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:40.336006 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416eb3e-16ef-4097-92f9-6a35adce8743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:40.336862 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416eb3e-16ef-4097-92f9-6a35adce8743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:40.337144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416eb3e-16ef-4097-92f9-6a35adce8743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:40.337419 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416eb3e-16ef-4097-92f9-6a35adce8743 admin admin] PATH_INFO: `/v3/users/2a5bcb6eb7404147b4a54d8ae777ef4e` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:40.338613 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416eb3e-16ef-4097-92f9-6a35adce8743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5bcb6eb7404147b4a54d8ae777ef4e)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:40.340540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416eb3e-16ef-4097-92f9-6a35adce8743 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:40.384553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-3416eb3e-16ef-4097-92f9-6a35adce8743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5bcb6eb7404147b4a54d8ae777ef4e'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:40.391012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-3416eb3e-16ef-4097-92f9-6a35adce8743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5bcb6eb7404147b4a54d8ae777ef4e'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:40.392206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-3416eb3e-16ef-4097-92f9-6a35adce8743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5bcb6eb7404147b4a54d8ae777ef4e'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:40.403453 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-3416eb3e-16ef-4097-92f9-6a35adce8743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5bcb6eb7404147b4a54d8ae777ef4e'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:40.414952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-3416eb3e-16ef-4097-92f9-6a35adce8743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5bcb6eb7404147b4a54d8ae777ef4e'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:40.428157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1152/2315] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:38:40 2022] DELETE /identity/v3/users/2a5bcb6eb7404147b4a54d8ae777ef4e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:40.432680 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7269e4c-512f-42a4-8523-0c80388b3fcc None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:40.433200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7269e4c-512f-42a4-8523-0c80388b3fcc None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:40.433306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7269e4c-512f-42a4-8523-0c80388b3fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:40.451017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c7269e4c-512f-42a4-8523-0c80388b3fcc None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:40.452226 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c7269e4c-512f-42a4-8523-0c80388b3fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:40.510622 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1164/2316] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:40.520535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416eb3e-16ef-4097-92f9-6a35adce8743 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:40.521981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3416eb3e-16ef-4097-92f9-6a35adce8743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:40.577880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416eb3e-16ef-4097-92f9-6a35adce8743 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:40.581871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd16e-a2df-4244-a528-9797539ffac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:40.582538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd16e-a2df-4244-a528-9797539ffac6 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:40.582818 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd16e-a2df-4244-a528-9797539ffac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:40.583088 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd16e-a2df-4244-a528-9797539ffac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:40.591815 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcd16e-a2df-4244-a528-9797539ffac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:40.593234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcd16e-a2df-4244-a528-9797539ffac6 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:40.603207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1153/2317] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:38:40.872773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7269e4c-512f-42a4-8523-0c80388b3fcc None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:40.874201 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c7269e4c-512f-42a4-8523-0c80388b3fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:40.892430 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7269e4c-512f-42a4-8523-0c80388b3fcc None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:40.897928 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d09e09-fead-4f04-af07-6f99fe3bd7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:40.898891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d09e09-fead-4f04-af07-6f99fe3bd7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:40.899086 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d09e09-fead-4f04-af07-6f99fe3bd7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:40.899359 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d09e09-fead-4f04-af07-6f99fe3bd7e2 admin admin] PATH_INFO: `/v3/projects/8021d0ae1896405d92b215218ae0813a` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:40.900536 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d09e09-fead-4f04-af07-6f99fe3bd7e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8021d0ae1896405d92b215218ae0813a)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:40.902544 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d09e09-fead-4f04-af07-6f99fe3bd7e2 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:40.948545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-46d09e09-fead-4f04-af07-6f99fe3bd7e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8021d0ae1896405d92b215218ae0813a', 'request_id': 'req-46d09e09-fead-4f04-af07-6f99fe3bd7e2'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:40.955288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-46d09e09-fead-4f04-af07-6f99fe3bd7e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8021d0ae1896405d92b215218ae0813a', 'request_id': 'req-46d09e09-fead-4f04-af07-6f99fe3bd7e2'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:40.962042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-46d09e09-fead-4f04-af07-6f99fe3bd7e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8021d0ae1896405d92b215218ae0813a', 'request_id': 'req-46d09e09-fead-4f04-af07-6f99fe3bd7e2'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:40.972572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-46d09e09-fead-4f04-af07-6f99fe3bd7e2 admin admin] The token cache is being invalidate because project 8021d0ae1896405d92b215218ae0813a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:38:40.972860 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-46d09e09-fead-4f04-af07-6f99fe3bd7e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:40.973476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-46d09e09-fead-4f04-af07-6f99fe3bd7e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:40.975148 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1165/2318] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:38:40 2022] DELETE /identity/v3/projects/8021d0ae1896405d92b215218ae0813a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:40.979096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd16e-a2df-4244-a528-9797539ffac6 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:40.988395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd16e-a2df-4244-a528-9797539ffac6 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:41.044276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64c6f1-a51e-40c7-8f1d-63eb1b4d9b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:41.045172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64c6f1-a51e-40c7-8f1d-63eb1b4d9b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:41.045459 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64c6f1-a51e-40c7-8f1d-63eb1b4d9b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:41.045742 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64c6f1-a51e-40c7-8f1d-63eb1b4d9b61 admin admin] PATH_INFO: `/v3/users/57376769cb8e4962bc02619b7a6d928d` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:41.046945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64c6f1-a51e-40c7-8f1d-63eb1b4d9b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57376769cb8e4962bc02619b7a6d928d)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:41.048919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64c6f1-a51e-40c7-8f1d-63eb1b4d9b61 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:41.093511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6e64c6f1-a51e-40c7-8f1d-63eb1b4d9b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57376769cb8e4962bc02619b7a6d928d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:41.100725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6e64c6f1-a51e-40c7-8f1d-63eb1b4d9b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57376769cb8e4962bc02619b7a6d928d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:41.101388 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6e64c6f1-a51e-40c7-8f1d-63eb1b4d9b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57376769cb8e4962bc02619b7a6d928d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:41.113642 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6e64c6f1-a51e-40c7-8f1d-63eb1b4d9b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57376769cb8e4962bc02619b7a6d928d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:41.120473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6e64c6f1-a51e-40c7-8f1d-63eb1b4d9b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57376769cb8e4962bc02619b7a6d928d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:41.126881 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1154/2319] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:38:40 2022] DELETE /identity/v3/users/57376769cb8e4962bc02619b7a6d928d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:41.396839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d09e09-fead-4f04-af07-6f99fe3bd7e2 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:41.398408 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-46d09e09-fead-4f04-af07-6f99fe3bd7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:41.413077 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d09e09-fead-4f04-af07-6f99fe3bd7e2 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:41.471519 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fc461-c42f-489b-b53a-b39b64e81bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:41.472297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fc461-c42f-489b-b53a-b39b64e81bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:41.472580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fc461-c42f-489b-b53a-b39b64e81bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:41.472858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fc461-c42f-489b-b53a-b39b64e81bf5 admin admin] PATH_INFO: `/v3/projects/91e4a534482e45fe920fb168be91ae63` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:41.474031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fc461-c42f-489b-b53a-b39b64e81bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e4a534482e45fe920fb168be91ae63)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:41.476004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fc461-c42f-489b-b53a-b39b64e81bf5 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:41.521343 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-940fc461-c42f-489b-b53a-b39b64e81bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e4a534482e45fe920fb168be91ae63', 'request_id': 'req-940fc461-c42f-489b-b53a-b39b64e81bf5'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:41.527290 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-940fc461-c42f-489b-b53a-b39b64e81bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e4a534482e45fe920fb168be91ae63', 'request_id': 'req-940fc461-c42f-489b-b53a-b39b64e81bf5'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:41.534628 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-940fc461-c42f-489b-b53a-b39b64e81bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e4a534482e45fe920fb168be91ae63', 'request_id': 'req-940fc461-c42f-489b-b53a-b39b64e81bf5'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:41.545057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-940fc461-c42f-489b-b53a-b39b64e81bf5 admin admin] The token cache is being invalidate because project 91e4a534482e45fe920fb168be91ae63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:38:41.545338 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-940fc461-c42f-489b-b53a-b39b64e81bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:41.545950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-940fc461-c42f-489b-b53a-b39b64e81bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:41.547559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1166/2320] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:38:41 2022] DELETE /identity/v3/projects/91e4a534482e45fe920fb168be91ae63 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:41.552415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1347f-4411-43fc-9e19-9b391d35a09b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:41.552886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1347f-4411-43fc-9e19-9b391d35a09b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:41.552989 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1347f-4411-43fc-9e19-9b391d35a09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:41.571574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-0df1347f-4411-43fc-9e19-9b391d35a09b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:41.573033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0df1347f-4411-43fc-9e19-9b391d35a09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:41.631960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1155/2321] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:41.640987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b1f22-0ac2-459f-90ab-5693ac6bc6a8 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:41.641277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b1f22-0ac2-459f-90ab-5693ac6bc6a8 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:41.641579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b1f22-0ac2-459f-90ab-5693ac6bc6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:41.661374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-a59b1f22-0ac2-459f-90ab-5693ac6bc6a8 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:41.662612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a59b1f22-0ac2-459f-90ab-5693ac6bc6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:41.670592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1167/2322] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:41.675384 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1347f-4411-43fc-9e19-9b391d35a09b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:41.684837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1347f-4411-43fc-9e19-9b391d35a09b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:41.689938 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ac158-7a31-47b8-9993-1c0aad491c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:41.690611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ac158-7a31-47b8-9993-1c0aad491c65 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:41.690892 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ac158-7a31-47b8-9993-1c0aad491c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:41.691165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ac158-7a31-47b8-9993-1c0aad491c65 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:41.691885 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ac158-7a31-47b8-9993-1c0aad491c65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:38:41.692185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ac158-7a31-47b8-9993-1c0aad491c65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:41.693783 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ac158-7a31-47b8-9993-1c0aad491c65 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:41.705503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1156/2323] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:38:41.709783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b1f22-0ac2-459f-90ab-5693ac6bc6a8 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:41.718946 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b1f22-0ac2-459f-90ab-5693ac6bc6a8 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:41.724001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e65809-cdaf-46fb-9d94-0ce769939829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:41.724582 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e65809-cdaf-46fb-9d94-0ce769939829 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:41.724865 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e65809-cdaf-46fb-9d94-0ce769939829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:41.725141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e65809-cdaf-46fb-9d94-0ce769939829 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:41.725819 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e65809-cdaf-46fb-9d94-0ce769939829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:41.727771 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e65809-cdaf-46fb-9d94-0ce769939829 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:41.753814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1168/2324] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:38:41 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:38:41.757805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ac158-7a31-47b8-9993-1c0aad491c65 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:41.768296 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ac158-7a31-47b8-9993-1c0aad491c65 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:41.822880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf851fb-3167-4478-aca2-c9ba56e22cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:41.823600 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf851fb-3167-4478-aca2-c9ba56e22cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:41.823891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf851fb-3167-4478-aca2-c9ba56e22cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:41.824167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf851fb-3167-4478-aca2-c9ba56e22cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:41.824863 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf851fb-3167-4478-aca2-c9ba56e22cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:41.826981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf851fb-3167-4478-aca2-c9ba56e22cd7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:41.847846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1157/2325] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:38:41 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:38:41.851880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e65809-cdaf-46fb-9d94-0ce769939829 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:41.861920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e65809-cdaf-46fb-9d94-0ce769939829 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:41.866544 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25217f-c269-4a1c-8b91-ad1464850760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:41.867193 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25217f-c269-4a1c-8b91-ad1464850760 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:41.867475 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25217f-c269-4a1c-8b91-ad1464850760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:41.867749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25217f-c269-4a1c-8b91-ad1464850760 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:41.868471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25217f-c269-4a1c-8b91-ad1464850760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:41.870056 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25217f-c269-4a1c-8b91-ad1464850760 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:41.880027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1169/2326] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:38:41.883769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf851fb-3167-4478-aca2-c9ba56e22cd7 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:41.894066 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf851fb-3167-4478-aca2-c9ba56e22cd7 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:41.898664 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746b1cf-a494-4fcf-84f0-c7ee87019977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:41.899314 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746b1cf-a494-4fcf-84f0-c7ee87019977 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:41.899600 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746b1cf-a494-4fcf-84f0-c7ee87019977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:41.899880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746b1cf-a494-4fcf-84f0-c7ee87019977 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:41.900599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746b1cf-a494-4fcf-84f0-c7ee87019977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:41.902308 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746b1cf-a494-4fcf-84f0-c7ee87019977 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:41.912640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1158/2327] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:38:41.916527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25217f-c269-4a1c-8b91-ad1464850760 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:41.926231 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25217f-c269-4a1c-8b91-ad1464850760 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:41.930890 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a85914-932c-4427-b35c-7ec6a7a431c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:41.931754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a85914-932c-4427-b35c-7ec6a7a431c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:41.932037 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a85914-932c-4427-b35c-7ec6a7a431c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:41.932311 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a85914-932c-4427-b35c-7ec6a7a431c5 admin admin] PATH_INFO: `/v3/projects/acd13e4d60cb461db5fe09a904b3d764/users/a96ab34a455646b1876a9e3916ede84d/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:41.946360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a85914-932c-4427-b35c-7ec6a7a431c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd13e4d60cb461db5fe09a904b3d764, user_id=a96ab34a455646b1876a9e3916ede84d, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:41.949275 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a85914-932c-4427-b35c-7ec6a7a431c5 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:41.962697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1170/2328] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:38:41 2022] PUT /identity/v3/projects/acd13e4d60cb461db5fe09a904b3d764/users/a96ab34a455646b1876a9e3916ede84d/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:41.967814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea5da1-0bef-4d62-a627-d088ccf5f529 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:41.968111 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea5da1-0bef-4d62-a627-d088ccf5f529 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:41.968395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea5da1-0bef-4d62-a627-d088ccf5f529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:41.986419 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-3dea5da1-0bef-4d62-a627-d088ccf5f529 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:41.987553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3dea5da1-0bef-4d62-a627-d088ccf5f529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:42.045464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1159/2329] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:38:42.055491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a85914-932c-4427-b35c-7ec6a7a431c5 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:42.057186 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c4a85914-932c-4427-b35c-7ec6a7a431c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:42.114698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a85914-932c-4427-b35c-7ec6a7a431c5 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:42.118337 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2655533-01c7-4e93-89dd-5d7a1741579a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:42.118975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2655533-01c7-4e93-89dd-5d7a1741579a service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:42.119252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2655533-01c7-4e93-89dd-5d7a1741579a service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:42.119521 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2655533-01c7-4e93-89dd-5d7a1741579a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:42.128404 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2655533-01c7-4e93-89dd-5d7a1741579a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:42.129824 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2655533-01c7-4e93-89dd-5d7a1741579a service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:42.138930 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1171/2330] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:38:42.716158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f7f26-ad9a-4912-9350-e6dab74d6168 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:42.716672 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f7f26-ad9a-4912-9350-e6dab74d6168 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:42.716795 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f7f26-ad9a-4912-9350-e6dab74d6168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:42.743943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-332f7f26-ad9a-4912-9350-e6dab74d6168 None None] MFA Rules not processed for user `a96ab34a455646b1876a9e3916ede84d`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:42.745142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-332f7f26-ad9a-4912-9350-e6dab74d6168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:42.810900 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1160/2331] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:42.816007 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2655533-01c7-4e93-89dd-5d7a1741579a service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:42.825725 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2655533-01c7-4e93-89dd-5d7a1741579a service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:42.831141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803e3b8-8dd8-40c8-959d-7795184af822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:42.831788 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803e3b8-8dd8-40c8-959d-7795184af822 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:42.832071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803e3b8-8dd8-40c8-959d-7795184af822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:42.832352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803e3b8-8dd8-40c8-959d-7795184af822 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:42.833034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803e3b8-8dd8-40c8-959d-7795184af822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:42.834980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803e3b8-8dd8-40c8-959d-7795184af822 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:42.860546 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1172/2332] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:38:42 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:38:42.864728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f7f26-ad9a-4912-9350-e6dab74d6168 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:42.875207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f7f26-ad9a-4912-9350-e6dab74d6168 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:42.931576 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff72c46-5a44-4d30-bfc1-a696b347808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:42.932253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff72c46-5a44-4d30-bfc1-a696b347808c admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:42.932538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff72c46-5a44-4d30-bfc1-a696b347808c admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:42.932814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff72c46-5a44-4d30-bfc1-a696b347808c admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:42.933503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff72c46-5a44-4d30-bfc1-a696b347808c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:42.935480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff72c46-5a44-4d30-bfc1-a696b347808c admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:42.954058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1161/2333] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:38:42 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:38:42.958320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803e3b8-8dd8-40c8-959d-7795184af822 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:42.968458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803e3b8-8dd8-40c8-959d-7795184af822 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:42.973488 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02889f-e685-40c5-8cf0-fa3be48b11a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:42.974140 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02889f-e685-40c5-8cf0-fa3be48b11a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:42.974457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02889f-e685-40c5-8cf0-fa3be48b11a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:42.974733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02889f-e685-40c5-8cf0-fa3be48b11a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:42.975453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02889f-e685-40c5-8cf0-fa3be48b11a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:42.977050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02889f-e685-40c5-8cf0-fa3be48b11a9 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:42.987579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1173/2334] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:38:42.991552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff72c46-5a44-4d30-bfc1-a696b347808c admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:43.001279 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff72c46-5a44-4d30-bfc1-a696b347808c admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:43.005847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd1a0d-e0f7-4fc0-be48-35e996f3def7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:43.006751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd1a0d-e0f7-4fc0-be48-35e996f3def7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:43.007037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd1a0d-e0f7-4fc0-be48-35e996f3def7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:43.007313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd1a0d-e0f7-4fc0-be48-35e996f3def7 admin admin] PATH_INFO: `/v3/projects/383124769bb544e1992dc6d934686e90/users/3feef08b530d4fcf9146bfe49c0568e1/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:43.021909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd1a0d-e0f7-4fc0-be48-35e996f3def7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=383124769bb544e1992dc6d934686e90, user_id=3feef08b530d4fcf9146bfe49c0568e1, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:43.024628 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd1a0d-e0f7-4fc0-be48-35e996f3def7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:43.037667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1162/2335] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:38:42 2022] PUT /identity/v3/projects/383124769bb544e1992dc6d934686e90/users/3feef08b530d4fcf9146bfe49c0568e1/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:38:43.041710 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02889f-e685-40c5-8cf0-fa3be48b11a9 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:43.052149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02889f-e685-40c5-8cf0-fa3be48b11a9 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:43.106386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac8e1a-e41d-4518-a4c9-9c0d9206d5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:43.107038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac8e1a-e41d-4518-a4c9-9c0d9206d5ad admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:43.107321 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac8e1a-e41d-4518-a4c9-9c0d9206d5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:43.107597 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac8e1a-e41d-4518-a4c9-9c0d9206d5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:43.108314 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac8e1a-e41d-4518-a4c9-9c0d9206d5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:43.109921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac8e1a-e41d-4518-a4c9-9c0d9206d5ad admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:43.119357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1174/2336] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:38:43.123735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd1a0d-e0f7-4fc0-be48-35e996f3def7 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:43.133715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd1a0d-e0f7-4fc0-be48-35e996f3def7 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:43.138234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da31443-68d1-46cc-9c64-197507352ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:43.139108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da31443-68d1-46cc-9c64-197507352ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:43.139388 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da31443-68d1-46cc-9c64-197507352ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:43.139658 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da31443-68d1-46cc-9c64-197507352ae7 admin admin] PATH_INFO: `/v3/projects/383124769bb544e1992dc6d934686e90/users/3feef08b530d4fcf9146bfe49c0568e1/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:43.142239 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da31443-68d1-46cc-9c64-197507352ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=383124769bb544e1992dc6d934686e90, user_id=3feef08b530d4fcf9146bfe49c0568e1, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:43.144864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da31443-68d1-46cc-9c64-197507352ae7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:43.154783 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1163/2337] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:38:43 2022] PUT /identity/v3/projects/383124769bb544e1992dc6d934686e90/users/3feef08b530d4fcf9146bfe49c0568e1/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:43.769073 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452c57a-1ff9-4ef3-8451-296a442bf8b2 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:43.769397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452c57a-1ff9-4ef3-8451-296a442bf8b2 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:43.769680 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452c57a-1ff9-4ef3-8451-296a442bf8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:43.795207 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-2452c57a-1ff9-4ef3-8451-296a442bf8b2 None None] MFA Rules not processed for user `3feef08b530d4fcf9146bfe49c0568e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:43.796419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2452c57a-1ff9-4ef3-8451-296a442bf8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:43.865367 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1175/2338] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:43.877520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da31443-68d1-46cc-9c64-197507352ae7 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:43.879258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7da31443-68d1-46cc-9c64-197507352ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:43.936794 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da31443-68d1-46cc-9c64-197507352ae7 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:43.941491 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b28b2-6e2c-40eb-a412-f87de69be061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:43.942138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b28b2-6e2c-40eb-a412-f87de69be061 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:43.942595 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b28b2-6e2c-40eb-a412-f87de69be061 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:43.942875 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b28b2-6e2c-40eb-a412-f87de69be061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:43.998673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b28b2-6e2c-40eb-a412-f87de69be061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:44.000110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b28b2-6e2c-40eb-a412-f87de69be061 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:44.009147 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1164/2339] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:38:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:38:45.350910 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452c57a-1ff9-4ef3-8451-296a442bf8b2 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:45.352288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2452c57a-1ff9-4ef3-8451-296a442bf8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:45.364701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452c57a-1ff9-4ef3-8451-296a442bf8b2 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:45.368202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107f379-363f-4c47-bf9a-eb3010989266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:45.368828 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f379-363f-4c47-bf9a-eb3010989266 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:45.369104 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f379-363f-4c47-bf9a-eb3010989266 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:45.369369 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f379-363f-4c47-bf9a-eb3010989266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:45.378927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107f379-363f-4c47-bf9a-eb3010989266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:45.380341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107f379-363f-4c47-bf9a-eb3010989266 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:45.389630 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1176/2340] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:38:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:38:55.159540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f701e-5d46-44dd-8c55-63642b5f1973 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:55.160025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f701e-5d46-44dd-8c55-63642b5f1973 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:55.160140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f701e-5d46-44dd-8c55-63642b5f1973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:55.177463 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-226f701e-5d46-44dd-8c55-63642b5f1973 None None] MFA Rules not processed for user `4716dd7e4131445c823cef63cae49308`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:55.178688 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-226f701e-5d46-44dd-8c55-63642b5f1973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:55.237591 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1165/2341] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:55.536685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107f379-363f-4c47-bf9a-eb3010989266 service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:55.538341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b107f379-363f-4c47-bf9a-eb3010989266 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:55.596013 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107f379-363f-4c47-bf9a-eb3010989266 service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:55.599697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf670e2-3de7-4742-9af8-dabeae139559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:55.600280 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf670e2-3de7-4742-9af8-dabeae139559 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:55.600561 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf670e2-3de7-4742-9af8-dabeae139559 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:55.600858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf670e2-3de7-4742-9af8-dabeae139559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:55.602643 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-1bf670e2-3de7-4742-9af8-dabeae139559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:55.612795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf670e2-3de7-4742-9af8-dabeae139559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:55.614268 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf670e2-3de7-4742-9af8-dabeae139559 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:55.622851 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1177/2342] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:38:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:38:58.683600 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f701e-5d46-44dd-8c55-63642b5f1973 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:58.752750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f701e-5d46-44dd-8c55-63642b5f1973 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:58.757818 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde9a34-d6c1-4473-96dd-d86206124c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:58.758987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde9a34-d6c1-4473-96dd-d86206124c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:58.759907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde9a34-d6c1-4473-96dd-d86206124c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:58.759907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde9a34-d6c1-4473-96dd-d86206124c1a admin admin] PATH_INFO: `/v3/users/a96ab34a455646b1876a9e3916ede84d` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:58.761157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde9a34-d6c1-4473-96dd-d86206124c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a96ab34a455646b1876a9e3916ede84d)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:58.763240 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde9a34-d6c1-4473-96dd-d86206124c1a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:58.825822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5fde9a34-d6c1-4473-96dd-d86206124c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a96ab34a455646b1876a9e3916ede84d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:58.833588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5fde9a34-d6c1-4473-96dd-d86206124c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a96ab34a455646b1876a9e3916ede84d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:58.834448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5fde9a34-d6c1-4473-96dd-d86206124c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a96ab34a455646b1876a9e3916ede84d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:58.850527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5fde9a34-d6c1-4473-96dd-d86206124c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a96ab34a455646b1876a9e3916ede84d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:58.858544 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-5fde9a34-d6c1-4473-96dd-d86206124c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a96ab34a455646b1876a9e3916ede84d'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:58.866680 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1166/2343] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:38:58 2022] DELETE /identity/v3/users/a96ab34a455646b1876a9e3916ede84d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:59.054344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf670e2-3de7-4742-9af8-dabeae139559 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:59.068626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf670e2-3de7-4742-9af8-dabeae139559 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:59.127858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1883cf-f463-4c60-a201-2138982ddad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:59.128713 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1883cf-f463-4c60-a201-2138982ddad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:59.129004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1883cf-f463-4c60-a201-2138982ddad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:59.129284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1883cf-f463-4c60-a201-2138982ddad7 admin admin] PATH_INFO: `/v3/projects/acd13e4d60cb461db5fe09a904b3d764` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:59.130526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1883cf-f463-4c60-a201-2138982ddad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd13e4d60cb461db5fe09a904b3d764)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:59.132510 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1883cf-f463-4c60-a201-2138982ddad7 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:59.182449 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-dc1883cf-f463-4c60-a201-2138982ddad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd13e4d60cb461db5fe09a904b3d764', 'request_id': 'req-dc1883cf-f463-4c60-a201-2138982ddad7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:59.189557 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-dc1883cf-f463-4c60-a201-2138982ddad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd13e4d60cb461db5fe09a904b3d764', 'request_id': 'req-dc1883cf-f463-4c60-a201-2138982ddad7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:59.199236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-dc1883cf-f463-4c60-a201-2138982ddad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd13e4d60cb461db5fe09a904b3d764', 'request_id': 'req-dc1883cf-f463-4c60-a201-2138982ddad7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:59.210083 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-dc1883cf-f463-4c60-a201-2138982ddad7 admin admin] The token cache is being invalidate because project acd13e4d60cb461db5fe09a904b3d764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:38:59.210490 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-dc1883cf-f463-4c60-a201-2138982ddad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:59.211341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-dc1883cf-f463-4c60-a201-2138982ddad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:59.212887 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1178/2344] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:38:59 2022] DELETE /identity/v3/projects/acd13e4d60cb461db5fe09a904b3d764 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:59.216842 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde9a34-d6c1-4473-96dd-d86206124c1a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:59.218285 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5fde9a34-d6c1-4473-96dd-d86206124c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:59.232216 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde9a34-d6c1-4473-96dd-d86206124c1a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:59.294378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b453e-fcec-494d-942c-3ddbf1709460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:59.295259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b453e-fcec-494d-942c-3ddbf1709460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:59.295550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b453e-fcec-494d-942c-3ddbf1709460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:59.295858 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b453e-fcec-494d-942c-3ddbf1709460 admin admin] PATH_INFO: `/v3/users/3feef08b530d4fcf9146bfe49c0568e1` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:59.297083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b453e-fcec-494d-942c-3ddbf1709460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3feef08b530d4fcf9146bfe49c0568e1)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:59.299965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b453e-fcec-494d-942c-3ddbf1709460 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:59.348475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-036b453e-fcec-494d-942c-3ddbf1709460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3feef08b530d4fcf9146bfe49c0568e1'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:59.356209 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-036b453e-fcec-494d-942c-3ddbf1709460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3feef08b530d4fcf9146bfe49c0568e1'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:59.356968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-036b453e-fcec-494d-942c-3ddbf1709460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3feef08b530d4fcf9146bfe49c0568e1'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:59.375575 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-036b453e-fcec-494d-942c-3ddbf1709460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3feef08b530d4fcf9146bfe49c0568e1'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:59.396827 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-036b453e-fcec-494d-942c-3ddbf1709460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3feef08b530d4fcf9146bfe49c0568e1'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:59.404006 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1167/2345] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:38:59 2022] DELETE /identity/v3/users/3feef08b530d4fcf9146bfe49c0568e1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:59.599377 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1883cf-f463-4c60-a201-2138982ddad7 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:38:59.600846 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-dc1883cf-f463-4c60-a201-2138982ddad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:59.622520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1883cf-f463-4c60-a201-2138982ddad7 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:38:59.728404 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bb657-e2db-4827-bef1-65bb3421a18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:38:59.729162 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bb657-e2db-4827-bef1-65bb3421a18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:59.729443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bb657-e2db-4827-bef1-65bb3421a18c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:59.729713 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bb657-e2db-4827-bef1-65bb3421a18c admin admin] PATH_INFO: `/v3/projects/383124769bb544e1992dc6d934686e90` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:59.730999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bb657-e2db-4827-bef1-65bb3421a18c admin admin] RBAC: Authorizing `identity:delete_project(project_id=383124769bb544e1992dc6d934686e90)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:38:59.733257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bb657-e2db-4827-bef1-65bb3421a18c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:38:59.787802 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f49bb657-e2db-4827-bef1-65bb3421a18c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '383124769bb544e1992dc6d934686e90', 'request_id': 'req-f49bb657-e2db-4827-bef1-65bb3421a18c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:59.800264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f49bb657-e2db-4827-bef1-65bb3421a18c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '383124769bb544e1992dc6d934686e90', 'request_id': 'req-f49bb657-e2db-4827-bef1-65bb3421a18c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:59.810577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f49bb657-e2db-4827-bef1-65bb3421a18c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '383124769bb544e1992dc6d934686e90', 'request_id': 'req-f49bb657-e2db-4827-bef1-65bb3421a18c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:59.823490 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f49bb657-e2db-4827-bef1-65bb3421a18c admin admin] The token cache is being invalidate because project 383124769bb544e1992dc6d934686e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:38:59.824068 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f49bb657-e2db-4827-bef1-65bb3421a18c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:59.826119 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f49bb657-e2db-4827-bef1-65bb3421a18c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:38:59.828176 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1179/2346] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:38:59 2022] DELETE /identity/v3/projects/383124769bb544e1992dc6d934686e90 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:38:59.835427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1d56c-cf70-4425-a596-377cd376b34b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:59.835904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1d56c-cf70-4425-a596-377cd376b34b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:59.836317 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1d56c-cf70-4425-a596-377cd376b34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:59.856192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-16b1d56c-cf70-4425-a596-377cd376b34b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:59.857538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-16b1d56c-cf70-4425-a596-377cd376b34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:59.924949 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1168/2347] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:59.935752 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafac65a-d6ec-486f-9e2e-840a6385de42 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:38:59.936108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafac65a-d6ec-486f-9e2e-840a6385de42 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:38:59.936553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafac65a-d6ec-486f-9e2e-840a6385de42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:38:59.971098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-cafac65a-d6ec-486f-9e2e-840a6385de42 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:38:59.971098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-cafac65a-d6ec-486f-9e2e-840a6385de42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:38:59.988972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1180/2348] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:38:59.993405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1d56c-cf70-4425-a596-377cd376b34b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:00.003829 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1d56c-cf70-4425-a596-377cd376b34b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:00.009513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7812b2-be00-46e4-9d82-58d8e9ead1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:00.010223 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7812b2-be00-46e4-9d82-58d8e9ead1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:00.010810 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7812b2-be00-46e4-9d82-58d8e9ead1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:00.010984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7812b2-be00-46e4-9d82-58d8e9ead1d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:00.012172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7812b2-be00-46e4-9d82-58d8e9ead1d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:39:00.012630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7812b2-be00-46e4-9d82-58d8e9ead1d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:00.014489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7812b2-be00-46e4-9d82-58d8e9ead1d8 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:00.031772 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1169/2349] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:39:00.033732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafac65a-d6ec-486f-9e2e-840a6385de42 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:00.045223 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafac65a-d6ec-486f-9e2e-840a6385de42 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:00.050985 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d223e-d9b0-4c4c-904b-458baceb4d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:00.051699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d223e-d9b0-4c4c-904b-458baceb4d7e admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:00.051988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d223e-d9b0-4c4c-904b-458baceb4d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:00.052264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d223e-d9b0-4c4c-904b-458baceb4d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:00.053075 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d223e-d9b0-4c4c-904b-458baceb4d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:00.055049 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d223e-d9b0-4c4c-904b-458baceb4d7e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:00.084707 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1181/2350] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:39:00 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:39:00.088948 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7812b2-be00-46e4-9d82-58d8e9ead1d8 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:00.100443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7812b2-be00-46e4-9d82-58d8e9ead1d8 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:00.160478 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b8c2c-1a44-4341-a161-b53fab74f43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:00.161077 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b8c2c-1a44-4341-a161-b53fab74f43d admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:00.161360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b8c2c-1a44-4341-a161-b53fab74f43d admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:00.161638 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b8c2c-1a44-4341-a161-b53fab74f43d admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:00.162370 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b8c2c-1a44-4341-a161-b53fab74f43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:00.164303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b8c2c-1a44-4341-a161-b53fab74f43d admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:00.186766 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1170/2351] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:39:00 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:39:00.187897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d223e-d9b0-4c4c-904b-458baceb4d7e admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:00.198773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d223e-d9b0-4c4c-904b-458baceb4d7e admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:00.203423 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e3401-fbfe-4d87-9e6a-2a743b446abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:00.204078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e3401-fbfe-4d87-9e6a-2a743b446abf admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:00.204397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e3401-fbfe-4d87-9e6a-2a743b446abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:00.205075 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e3401-fbfe-4d87-9e6a-2a743b446abf admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:00.205585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e3401-fbfe-4d87-9e6a-2a743b446abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:00.207242 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e3401-fbfe-4d87-9e6a-2a743b446abf admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:00.217515 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1182/2352] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:39:00.221996 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b8c2c-1a44-4341-a161-b53fab74f43d admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:00.232104 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b8c2c-1a44-4341-a161-b53fab74f43d admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:00.237394 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445495e-cf87-40af-8df4-5faf2bcc74e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:00.238046 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445495e-cf87-40af-8df4-5faf2bcc74e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:00.238376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445495e-cf87-40af-8df4-5faf2bcc74e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:00.238656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445495e-cf87-40af-8df4-5faf2bcc74e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:00.239379 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445495e-cf87-40af-8df4-5faf2bcc74e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:00.240981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445495e-cf87-40af-8df4-5faf2bcc74e2 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:00.251014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1171/2353] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:39:00.255249 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e3401-fbfe-4d87-9e6a-2a743b446abf admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:00.265254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e3401-fbfe-4d87-9e6a-2a743b446abf admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:00.270528 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d623d6e-2bb9-4c18-8289-f0a3bf132ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:00.271626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d623d6e-2bb9-4c18-8289-f0a3bf132ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:00.271917 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d623d6e-2bb9-4c18-8289-f0a3bf132ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:00.272251 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d623d6e-2bb9-4c18-8289-f0a3bf132ddb admin admin] PATH_INFO: `/v3/projects/a516be7ae1d14523a45959ee15d194cb/users/4c2f1ea9a53343719247ce7b0e5ecb72/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:00.287672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d623d6e-2bb9-4c18-8289-f0a3bf132ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a516be7ae1d14523a45959ee15d194cb, user_id=4c2f1ea9a53343719247ce7b0e5ecb72, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:00.290425 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d623d6e-2bb9-4c18-8289-f0a3bf132ddb admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:00.303603 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1183/2354] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:39:00 2022] PUT /identity/v3/projects/a516be7ae1d14523a45959ee15d194cb/users/4c2f1ea9a53343719247ce7b0e5ecb72/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:39:00.314111 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e54e8a-5510-4abd-bf98-f8e714407f30 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:00.314422 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e54e8a-5510-4abd-bf98-f8e714407f30 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:00.314689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e54e8a-5510-4abd-bf98-f8e714407f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:00.341488 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-18e54e8a-5510-4abd-bf98-f8e714407f30 None None] MFA Rules not processed for user `4c2f1ea9a53343719247ce7b0e5ecb72`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:39:00.342712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-18e54e8a-5510-4abd-bf98-f8e714407f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:00.405500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1172/2355] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:39:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:39:00.410771 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d623d6e-2bb9-4c18-8289-f0a3bf132ddb admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:00.474095 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d623d6e-2bb9-4c18-8289-f0a3bf132ddb admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:00.478794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196f373-b45c-461a-a843-419daccfd38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:00.479482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196f373-b45c-461a-a843-419daccfd38c admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:00.479766 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196f373-b45c-461a-a843-419daccfd38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:00.480042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196f373-b45c-461a-a843-419daccfd38c admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:00.480744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196f373-b45c-461a-a843-419daccfd38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:00.482679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196f373-b45c-461a-a843-419daccfd38c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:00.508388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1184/2356] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:39:00 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:39:00.512523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e54e8a-5510-4abd-bf98-f8e714407f30 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:00.523992 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e54e8a-5510-4abd-bf98-f8e714407f30 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:00.581407 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be8cc7-c865-4baf-936c-8163cab97e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:00.582078 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be8cc7-c865-4baf-936c-8163cab97e9a admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:00.582405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be8cc7-c865-4baf-936c-8163cab97e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:00.582670 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be8cc7-c865-4baf-936c-8163cab97e9a admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:00.583436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be8cc7-c865-4baf-936c-8163cab97e9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:00.585346 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be8cc7-c865-4baf-936c-8163cab97e9a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:00.605370 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1173/2357] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:39:00 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:39:00.609390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196f373-b45c-461a-a843-419daccfd38c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:00.619586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196f373-b45c-461a-a843-419daccfd38c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:00.625071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc8450-613e-435f-93aa-e3ef7e18c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:00.625440 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc8450-613e-435f-93aa-e3ef7e18c56e admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:00.625833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc8450-613e-435f-93aa-e3ef7e18c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:00.626117 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc8450-613e-435f-93aa-e3ef7e18c56e admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:00.627162 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc8450-613e-435f-93aa-e3ef7e18c56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:00.629307 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc8450-613e-435f-93aa-e3ef7e18c56e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:00.640591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1185/2358] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:39:00.645235 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be8cc7-c865-4baf-936c-8163cab97e9a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:00.655025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be8cc7-c865-4baf-936c-8163cab97e9a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:00.660375 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd02a8d-7088-4185-8106-4876bc2fc672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:00.661079 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd02a8d-7088-4185-8106-4876bc2fc672 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:00.661314 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd02a8d-7088-4185-8106-4876bc2fc672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:00.661594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd02a8d-7088-4185-8106-4876bc2fc672 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:00.662350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd02a8d-7088-4185-8106-4876bc2fc672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:00.664008 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd02a8d-7088-4185-8106-4876bc2fc672 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:00.673983 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1174/2359] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:39:00.678285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc8450-613e-435f-93aa-e3ef7e18c56e admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:00.688107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc8450-613e-435f-93aa-e3ef7e18c56e admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:00.693294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38693723-3e48-42f2-b19d-831fd7df8255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:00.694164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38693723-3e48-42f2-b19d-831fd7df8255 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:00.694483 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38693723-3e48-42f2-b19d-831fd7df8255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:00.694765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38693723-3e48-42f2-b19d-831fd7df8255 admin admin] PATH_INFO: `/v3/projects/8404c14cbc674482a06de14507080374/users/38bea6d377264db5a466defacdc241fe/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:00.715138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38693723-3e48-42f2-b19d-831fd7df8255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8404c14cbc674482a06de14507080374, user_id=38bea6d377264db5a466defacdc241fe, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:00.720027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38693723-3e48-42f2-b19d-831fd7df8255 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:00.735739 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1186/2360] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:39:00 2022] PUT /identity/v3/projects/8404c14cbc674482a06de14507080374/users/38bea6d377264db5a466defacdc241fe/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:39:00.747629 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a9fbe-1f19-4571-a9d8-88d5a25d4b21 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:00.748071 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a9fbe-1f19-4571-a9d8-88d5a25d4b21 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:00.748348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a9fbe-1f19-4571-a9d8-88d5a25d4b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:00.775289 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-ef0a9fbe-1f19-4571-a9d8-88d5a25d4b21 None None] MFA Rules not processed for user `38bea6d377264db5a466defacdc241fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:39:00.776494 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ef0a9fbe-1f19-4571-a9d8-88d5a25d4b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:00.840973 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1175/2361] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:39:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:39:00.845490 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38693723-3e48-42f2-b19d-831fd7df8255 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:00.905752 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38693723-3e48-42f2-b19d-831fd7df8255 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:00.910475 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcb543-e29e-47ca-8fa9-f3dfe20a0038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:00.911174 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcb543-e29e-47ca-8fa9-f3dfe20a0038 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:00.911402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcb543-e29e-47ca-8fa9-f3dfe20a0038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:00.911683 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcb543-e29e-47ca-8fa9-f3dfe20a0038 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:00.912415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcb543-e29e-47ca-8fa9-f3dfe20a0038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:00.914412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcb543-e29e-47ca-8fa9-f3dfe20a0038 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:00.938591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1187/2362] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:39:00 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:39:00.943469 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a9fbe-1f19-4571-a9d8-88d5a25d4b21 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:00.954157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a9fbe-1f19-4571-a9d8-88d5a25d4b21 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:01.010785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514bfc2-3539-4864-a7cd-94045bf1c872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:01.011453 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514bfc2-3539-4864-a7cd-94045bf1c872 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:01.011735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514bfc2-3539-4864-a7cd-94045bf1c872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:01.012010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514bfc2-3539-4864-a7cd-94045bf1c872 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:01.012711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514bfc2-3539-4864-a7cd-94045bf1c872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:01.014658 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514bfc2-3539-4864-a7cd-94045bf1c872 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:01.034487 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1176/2363] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:39:00 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:39:01.039571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcb543-e29e-47ca-8fa9-f3dfe20a0038 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:01.049888 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcb543-e29e-47ca-8fa9-f3dfe20a0038 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:01.054597 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9073d-3fb5-49a1-a717-794e012785c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:01.055254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9073d-3fb5-49a1-a717-794e012785c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:01.055791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9073d-3fb5-49a1-a717-794e012785c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:01.055791 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9073d-3fb5-49a1-a717-794e012785c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:01.056517 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9073d-3fb5-49a1-a717-794e012785c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:01.058222 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9073d-3fb5-49a1-a717-794e012785c5 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:01.069435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1188/2364] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:39:01.073912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514bfc2-3539-4864-a7cd-94045bf1c872 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:01.084111 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514bfc2-3539-4864-a7cd-94045bf1c872 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:01.089160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9ddcf-f791-45c7-9b66-e3a7e85e6b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:01.090154 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9ddcf-f791-45c7-9b66-e3a7e85e6b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:01.090578 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9ddcf-f791-45c7-9b66-e3a7e85e6b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:01.090862 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9ddcf-f791-45c7-9b66-e3a7e85e6b52 admin admin] PATH_INFO: `/v3/projects/aec8f72f3d7444ebb18564df6187b7c3/users/50870be03d0e4c8994c0b717889d6f4a/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:01.107258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9ddcf-f791-45c7-9b66-e3a7e85e6b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec8f72f3d7444ebb18564df6187b7c3, user_id=50870be03d0e4c8994c0b717889d6f4a, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:01.109966 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9ddcf-f791-45c7-9b66-e3a7e85e6b52 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:01.123067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1177/2365] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:39:01 2022] PUT /identity/v3/projects/aec8f72f3d7444ebb18564df6187b7c3/users/50870be03d0e4c8994c0b717889d6f4a/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:39:01.127084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9073d-3fb5-49a1-a717-794e012785c5 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:01.138041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9073d-3fb5-49a1-a717-794e012785c5 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:01.193459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd8ea4-db46-46d7-97ff-0e77907775ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:01.194050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd8ea4-db46-46d7-97ff-0e77907775ef admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:01.194369 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd8ea4-db46-46d7-97ff-0e77907775ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:01.194644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd8ea4-db46-46d7-97ff-0e77907775ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:01.195361 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd8ea4-db46-46d7-97ff-0e77907775ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:01.197004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd8ea4-db46-46d7-97ff-0e77907775ef admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:01.207581 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1189/2366] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:39:01.211718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9ddcf-f791-45c7-9b66-e3a7e85e6b52 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:01.221873 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9ddcf-f791-45c7-9b66-e3a7e85e6b52 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:01.226542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96881c-0027-4c3f-a80f-4bbaf6efaff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:01.227410 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96881c-0027-4c3f-a80f-4bbaf6efaff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:01.227687 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96881c-0027-4c3f-a80f-4bbaf6efaff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:01.227961 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96881c-0027-4c3f-a80f-4bbaf6efaff5 admin admin] PATH_INFO: `/v3/projects/aec8f72f3d7444ebb18564df6187b7c3/users/50870be03d0e4c8994c0b717889d6f4a/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:01.229898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96881c-0027-4c3f-a80f-4bbaf6efaff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec8f72f3d7444ebb18564df6187b7c3, user_id=50870be03d0e4c8994c0b717889d6f4a, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:01.232583 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96881c-0027-4c3f-a80f-4bbaf6efaff5 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:01.242950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1178/2367] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:39:01 2022] PUT /identity/v3/projects/aec8f72f3d7444ebb18564df6187b7c3/users/50870be03d0e4c8994c0b717889d6f4a/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:39:01.255034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90951c5-ef94-4831-ac61-9d8a67276908 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:01.255322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90951c5-ef94-4831-ac61-9d8a67276908 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:01.255601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90951c5-ef94-4831-ac61-9d8a67276908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:01.281637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-e90951c5-ef94-4831-ac61-9d8a67276908 None None] MFA Rules not processed for user `50870be03d0e4c8994c0b717889d6f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:39:01.283022 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e90951c5-ef94-4831-ac61-9d8a67276908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:01.348534 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1190/2368] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:39:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:39:01.359734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96881c-0027-4c3f-a80f-4bbaf6efaff5 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:01.362283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-9a96881c-0027-4c3f-a80f-4bbaf6efaff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:01.426356 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96881c-0027-4c3f-a80f-4bbaf6efaff5 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:01.430063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bf582-8925-45e4-a005-1a1729c742b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:01.430778 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bf582-8925-45e4-a005-1a1729c742b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:01.431067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bf582-8925-45e4-a005-1a1729c742b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:01.431362 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bf582-8925-45e4-a005-1a1729c742b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:01.490081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bf582-8925-45e4-a005-1a1729c742b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:01.491491 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bf582-8925-45e4-a005-1a1729c742b1 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:01.500432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1179/2369] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:39:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:39:03.010857 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90951c5-ef94-4831-ac61-9d8a67276908 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:03.012299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e90951c5-ef94-4831-ac61-9d8a67276908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:03.025711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90951c5-ef94-4831-ac61-9d8a67276908 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:03.030584 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b0c1e-f163-4087-9779-008f0d58e514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:03.031219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b0c1e-f163-4087-9779-008f0d58e514 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:03.031801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b0c1e-f163-4087-9779-008f0d58e514 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:03.031801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b0c1e-f163-4087-9779-008f0d58e514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:03.099365 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b0c1e-f163-4087-9779-008f0d58e514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:03.100927 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b0c1e-f163-4087-9779-008f0d58e514 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:03.112691 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1191/2370] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:39:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:39:03.674421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bf582-8925-45e4-a005-1a1729c742b1 service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:03.683520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bf582-8925-45e4-a005-1a1729c742b1 service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:03.687121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea668d-3797-4544-aa37-8ff1ccd2db9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:03.687758 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea668d-3797-4544-aa37-8ff1ccd2db9e service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:03.688040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea668d-3797-4544-aa37-8ff1ccd2db9e service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:03.688319 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea668d-3797-4544-aa37-8ff1ccd2db9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:03.698493 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea668d-3797-4544-aa37-8ff1ccd2db9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:03.699927 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea668d-3797-4544-aa37-8ff1ccd2db9e service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:03.710033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1180/2371] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:39:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:39:07.533442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b0c1e-f163-4087-9779-008f0d58e514 service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:07.610537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b0c1e-f163-4087-9779-008f0d58e514 service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:07.615391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f51405-697b-4948-ae5c-5d79bf925450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:07.616329 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f51405-697b-4948-ae5c-5d79bf925450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:07.616684 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f51405-697b-4948-ae5c-5d79bf925450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:07.617025 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f51405-697b-4948-ae5c-5d79bf925450 admin admin] PATH_INFO: `/v3/users/4c2f1ea9a53343719247ce7b0e5ecb72` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:07.618392 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f51405-697b-4948-ae5c-5d79bf925450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c2f1ea9a53343719247ce7b0e5ecb72)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:07.620402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f51405-697b-4948-ae5c-5d79bf925450 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:07.669257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f2f51405-697b-4948-ae5c-5d79bf925450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c2f1ea9a53343719247ce7b0e5ecb72'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:07.677125 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f2f51405-697b-4948-ae5c-5d79bf925450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c2f1ea9a53343719247ce7b0e5ecb72'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:07.677758 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f2f51405-697b-4948-ae5c-5d79bf925450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c2f1ea9a53343719247ce7b0e5ecb72'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:07.690150 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f2f51405-697b-4948-ae5c-5d79bf925450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c2f1ea9a53343719247ce7b0e5ecb72'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:07.696765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f2f51405-697b-4948-ae5c-5d79bf925450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c2f1ea9a53343719247ce7b0e5ecb72'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:07.702784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1192/2372] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:39:07 2022] DELETE /identity/v3/users/4c2f1ea9a53343719247ce7b0e5ecb72 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:39:07.708071 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f04c37-8187-44c3-a7ca-6145f3401126 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:07.708531 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f04c37-8187-44c3-a7ca-6145f3401126 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:07.708771 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f04c37-8187-44c3-a7ca-6145f3401126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:07.725554 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-d2f04c37-8187-44c3-a7ca-6145f3401126 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:39:07.726721 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d2f04c37-8187-44c3-a7ca-6145f3401126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:07.787963 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1181/2373] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:39:07.799484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f51405-697b-4948-ae5c-5d79bf925450 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:07.800913 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f2f51405-697b-4948-ae5c-5d79bf925450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:07.858211 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f51405-697b-4948-ae5c-5d79bf925450 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:07.862711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b806e0c-0005-41c8-894f-ff5d64657428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:07.863485 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b806e0c-0005-41c8-894f-ff5d64657428 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:07.863785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b806e0c-0005-41c8-894f-ff5d64657428 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:07.864052 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b806e0c-0005-41c8-894f-ff5d64657428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:07.873413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b806e0c-0005-41c8-894f-ff5d64657428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:07.874986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b806e0c-0005-41c8-894f-ff5d64657428 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:07.885900 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1193/2374] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:39:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:39:08.152152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f04c37-8187-44c3-a7ca-6145f3401126 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:08.153779 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d2f04c37-8187-44c3-a7ca-6145f3401126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:08.166246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f04c37-8187-44c3-a7ca-6145f3401126 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:08.170638 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:08.171504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:08.171784 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:08.172060 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06 admin admin] PATH_INFO: `/v3/projects/a516be7ae1d14523a45959ee15d194cb` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:08.173531 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a516be7ae1d14523a45959ee15d194cb)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:08.175269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:08.224218 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a516be7ae1d14523a45959ee15d194cb', 'request_id': 'req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:08.230379 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a516be7ae1d14523a45959ee15d194cb', 'request_id': 'req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:08.237365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a516be7ae1d14523a45959ee15d194cb', 'request_id': 'req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:08.248194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06 admin admin] The token cache is being invalidate because project a516be7ae1d14523a45959ee15d194cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:39:08.248557 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:08.249218 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:08.251528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1182/2375] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:39:08 2022] DELETE /identity/v3/projects/a516be7ae1d14523a45959ee15d194cb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:39:08.255653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b806e0c-0005-41c8-894f-ff5d64657428 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:08.265378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b806e0c-0005-41c8-894f-ff5d64657428 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:08.319190 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99c990-ddbc-4865-afa3-73bc74cdf35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:08.320049 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99c990-ddbc-4865-afa3-73bc74cdf35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:08.320332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99c990-ddbc-4865-afa3-73bc74cdf35d admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:08.320609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99c990-ddbc-4865-afa3-73bc74cdf35d admin admin] PATH_INFO: `/v3/users/38bea6d377264db5a466defacdc241fe` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:08.321779 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99c990-ddbc-4865-afa3-73bc74cdf35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=38bea6d377264db5a466defacdc241fe)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:08.324012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99c990-ddbc-4865-afa3-73bc74cdf35d admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:08.368715 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7b99c990-ddbc-4865-afa3-73bc74cdf35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38bea6d377264db5a466defacdc241fe'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:08.374981 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7b99c990-ddbc-4865-afa3-73bc74cdf35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38bea6d377264db5a466defacdc241fe'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:08.375693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7b99c990-ddbc-4865-afa3-73bc74cdf35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38bea6d377264db5a466defacdc241fe'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:08.387712 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7b99c990-ddbc-4865-afa3-73bc74cdf35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38bea6d377264db5a466defacdc241fe'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:08.395082 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7b99c990-ddbc-4865-afa3-73bc74cdf35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38bea6d377264db5a466defacdc241fe'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:08.401480 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1194/2376] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:39:08 2022] DELETE /identity/v3/users/38bea6d377264db5a466defacdc241fe => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:39:08.972218 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:08.973995 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:08.987746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4b9c4-79c0-4047-abb7-cb6ab577dc06 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:09.054165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936c034-e541-4965-a268-3f2175c9986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:09.055183 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936c034-e541-4965-a268-3f2175c9986c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:09.055540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936c034-e541-4965-a268-3f2175c9986c admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:09.055887 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936c034-e541-4965-a268-3f2175c9986c admin admin] PATH_INFO: `/v3/projects/8404c14cbc674482a06de14507080374` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:09.057176 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936c034-e541-4965-a268-3f2175c9986c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8404c14cbc674482a06de14507080374)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:09.059615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936c034-e541-4965-a268-3f2175c9986c admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:09.115918 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b936c034-e541-4965-a268-3f2175c9986c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8404c14cbc674482a06de14507080374', 'request_id': 'req-b936c034-e541-4965-a268-3f2175c9986c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:09.122610 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b936c034-e541-4965-a268-3f2175c9986c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8404c14cbc674482a06de14507080374', 'request_id': 'req-b936c034-e541-4965-a268-3f2175c9986c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:09.130558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b936c034-e541-4965-a268-3f2175c9986c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8404c14cbc674482a06de14507080374', 'request_id': 'req-b936c034-e541-4965-a268-3f2175c9986c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:09.140966 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b936c034-e541-4965-a268-3f2175c9986c admin admin] The token cache is being invalidate because project 8404c14cbc674482a06de14507080374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:39:09.141257 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b936c034-e541-4965-a268-3f2175c9986c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:09.142502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b936c034-e541-4965-a268-3f2175c9986c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:09.144064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1183/2377] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:39:08 2022] DELETE /identity/v3/projects/8404c14cbc674482a06de14507080374 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:39:09.148140 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99c990-ddbc-4865-afa3-73bc74cdf35d admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:09.149599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7b99c990-ddbc-4865-afa3-73bc74cdf35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:09.162971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99c990-ddbc-4865-afa3-73bc74cdf35d admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:09.220133 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbead45-fe67-4cce-bdb1-d6ff02a9a5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:09.221209 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbead45-fe67-4cce-bdb1-d6ff02a9a5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:09.221489 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbead45-fe67-4cce-bdb1-d6ff02a9a5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:09.221794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbead45-fe67-4cce-bdb1-d6ff02a9a5cc admin admin] PATH_INFO: `/v3/users/50870be03d0e4c8994c0b717889d6f4a` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:09.223055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbead45-fe67-4cce-bdb1-d6ff02a9a5cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=50870be03d0e4c8994c0b717889d6f4a)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:09.225040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbead45-fe67-4cce-bdb1-d6ff02a9a5cc admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:09.272428 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7bbead45-fe67-4cce-bdb1-d6ff02a9a5cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50870be03d0e4c8994c0b717889d6f4a'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:09.279386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7bbead45-fe67-4cce-bdb1-d6ff02a9a5cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50870be03d0e4c8994c0b717889d6f4a'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:09.280091 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7bbead45-fe67-4cce-bdb1-d6ff02a9a5cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50870be03d0e4c8994c0b717889d6f4a'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:09.292446 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7bbead45-fe67-4cce-bdb1-d6ff02a9a5cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50870be03d0e4c8994c0b717889d6f4a'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:09.300111 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7bbead45-fe67-4cce-bdb1-d6ff02a9a5cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50870be03d0e4c8994c0b717889d6f4a'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:09.306021 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1195/2378] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:39:09 2022] DELETE /identity/v3/users/50870be03d0e4c8994c0b717889d6f4a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:39:09.737934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936c034-e541-4965-a268-3f2175c9986c admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:09.739390 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b936c034-e541-4965-a268-3f2175c9986c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:09.754850 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936c034-e541-4965-a268-3f2175c9986c admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:09.812085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f5a20-9766-45f8-815d-7f225367320a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:09.812930 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5a20-9766-45f8-815d-7f225367320a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:09.813215 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5a20-9766-45f8-815d-7f225367320a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:09.814134 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5a20-9766-45f8-815d-7f225367320a admin admin] PATH_INFO: `/v3/projects/aec8f72f3d7444ebb18564df6187b7c3` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:09.815487 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f5a20-9766-45f8-815d-7f225367320a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec8f72f3d7444ebb18564df6187b7c3)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:09.817572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f5a20-9766-45f8-815d-7f225367320a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:09.866036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-603f5a20-9766-45f8-815d-7f225367320a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec8f72f3d7444ebb18564df6187b7c3', 'request_id': 'req-603f5a20-9766-45f8-815d-7f225367320a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:09.872149 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-603f5a20-9766-45f8-815d-7f225367320a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec8f72f3d7444ebb18564df6187b7c3', 'request_id': 'req-603f5a20-9766-45f8-815d-7f225367320a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:09.880003 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-603f5a20-9766-45f8-815d-7f225367320a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec8f72f3d7444ebb18564df6187b7c3', 'request_id': 'req-603f5a20-9766-45f8-815d-7f225367320a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:09.890436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-603f5a20-9766-45f8-815d-7f225367320a admin admin] The token cache is being invalidate because project aec8f72f3d7444ebb18564df6187b7c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:39:09.890728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-603f5a20-9766-45f8-815d-7f225367320a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:09.891423 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-603f5a20-9766-45f8-815d-7f225367320a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:39:09.894692 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1184/2379] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:39:09 2022] DELETE /identity/v3/projects/aec8f72f3d7444ebb18564df6187b7c3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:39:09.899518 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a42e5-2921-42b1-b6e3-a45c2262d647 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:09.899812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a42e5-2921-42b1-b6e3-a45c2262d647 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:09.900090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a42e5-2921-42b1-b6e3-a45c2262d647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:09.918901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-9c9a42e5-2921-42b1-b6e3-a45c2262d647 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:39:09.920508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-9c9a42e5-2921-42b1-b6e3-a45c2262d647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:09.991738 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1196/2380] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:39:09.993486 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bbb83-312c-4354-91db-3352176fbfec None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:09.993976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bbb83-312c-4354-91db-3352176fbfec None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:09.994070 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bbb83-312c-4354-91db-3352176fbfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:10.016415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-230bbb83-312c-4354-91db-3352176fbfec None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:39:10.018370 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-230bbb83-312c-4354-91db-3352176fbfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:10.030949 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1185/2381] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:39:10.031594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a42e5-2921-42b1-b6e3-a45c2262d647 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:10.043526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a42e5-2921-42b1-b6e3-a45c2262d647 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:10.049449 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c48767-38b3-4bce-bba8-0da831c7822a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:10.050121 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c48767-38b3-4bce-bba8-0da831c7822a admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:10.050443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c48767-38b3-4bce-bba8-0da831c7822a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:10.050720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c48767-38b3-4bce-bba8-0da831c7822a admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:10.051454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c48767-38b3-4bce-bba8-0da831c7822a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:39:10.051765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c48767-38b3-4bce-bba8-0da831c7822a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:10.053378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c48767-38b3-4bce-bba8-0da831c7822a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:10.068789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1197/2382] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:39:10.069983 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bbb83-312c-4354-91db-3352176fbfec None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:10.080857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bbb83-312c-4354-91db-3352176fbfec None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:10.085831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931bd3e-4fcd-4f9d-928a-b5186d32e3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:10.087500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931bd3e-4fcd-4f9d-928a-b5186d32e3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:10.087500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931bd3e-4fcd-4f9d-928a-b5186d32e3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:10.087748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931bd3e-4fcd-4f9d-928a-b5186d32e3d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:10.088458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931bd3e-4fcd-4f9d-928a-b5186d32e3d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:10.090830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931bd3e-4fcd-4f9d-928a-b5186d32e3d4 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:10.119438 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1186/2383] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:39:10 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:39:10.124732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c48767-38b3-4bce-bba8-0da831c7822a admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:10.136579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c48767-38b3-4bce-bba8-0da831c7822a admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:10.207731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb3336-25e4-407d-bad5-8c96c8165235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:10.209289 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb3336-25e4-407d-bad5-8c96c8165235 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:10.209771 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb3336-25e4-407d-bad5-8c96c8165235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:10.210291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb3336-25e4-407d-bad5-8c96c8165235 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:10.211193 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb3336-25e4-407d-bad5-8c96c8165235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:10.213334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb3336-25e4-407d-bad5-8c96c8165235 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:10.242109 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1198/2384] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:39:10 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:39:10.246759 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931bd3e-4fcd-4f9d-928a-b5186d32e3d4 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:10.264833 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931bd3e-4fcd-4f9d-928a-b5186d32e3d4 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:10.270639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bace16-8837-40ea-83aa-5810c19f7758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:10.271390 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bace16-8837-40ea-83aa-5810c19f7758 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:10.271784 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bace16-8837-40ea-83aa-5810c19f7758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:10.272159 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bace16-8837-40ea-83aa-5810c19f7758 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:10.272992 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bace16-8837-40ea-83aa-5810c19f7758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:10.274766 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bace16-8837-40ea-83aa-5810c19f7758 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:10.296326 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1187/2385] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:39:10.297898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb3336-25e4-407d-bad5-8c96c8165235 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:10.308660 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb3336-25e4-407d-bad5-8c96c8165235 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:10.313923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3b1d4-d39b-4c55-a080-b21cf26f4028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:10.314742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3b1d4-d39b-4c55-a080-b21cf26f4028 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:10.315026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3b1d4-d39b-4c55-a080-b21cf26f4028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:10.315419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3b1d4-d39b-4c55-a080-b21cf26f4028 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:10.316151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3b1d4-d39b-4c55-a080-b21cf26f4028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:10.326975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3b1d4-d39b-4c55-a080-b21cf26f4028 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:10.342213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1199/2386] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:39:10.344810 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bace16-8837-40ea-83aa-5810c19f7758 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:10.355123 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bace16-8837-40ea-83aa-5810c19f7758 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:10.361572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d24e6c-e572-49e1-a06a-d4e5d4590665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:10.362491 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24e6c-e572-49e1-a06a-d4e5d4590665 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:10.362778 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24e6c-e572-49e1-a06a-d4e5d4590665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:10.363059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24e6c-e572-49e1-a06a-d4e5d4590665 admin admin] PATH_INFO: `/v3/projects/67e29bf31a4a4c87bb5a9a359e4259ec/users/fc192ff884a04ed580ed171ed91b138c/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:10.379407 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d24e6c-e572-49e1-a06a-d4e5d4590665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e29bf31a4a4c87bb5a9a359e4259ec, user_id=fc192ff884a04ed580ed171ed91b138c, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:10.383130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d24e6c-e572-49e1-a06a-d4e5d4590665 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:10.398783 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1188/2387] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:39:10 2022] PUT /identity/v3/projects/67e29bf31a4a4c87bb5a9a359e4259ec/users/fc192ff884a04ed580ed171ed91b138c/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:39:10.403974 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9ac9-8417-4be7-a30e-f88c7688a0d4 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:10.404272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9ac9-8417-4be7-a30e-f88c7688a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:10.404555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9ac9-8417-4be7-a30e-f88c7688a0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:10.426137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-587c9ac9-8417-4be7-a30e-f88c7688a0d4 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:39:10.427398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-587c9ac9-8417-4be7-a30e-f88c7688a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:10.497170 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1200/2388] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:39:10.504033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d24e6c-e572-49e1-a06a-d4e5d4590665 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:10.505778 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e7d24e6c-e572-49e1-a06a-d4e5d4590665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:10.569608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d24e6c-e572-49e1-a06a-d4e5d4590665 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:10.574345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96461fe4-bc13-48fd-af64-893f1f3ea377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:10.575103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96461fe4-bc13-48fd-af64-893f1f3ea377 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:10.575301 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96461fe4-bc13-48fd-af64-893f1f3ea377 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:10.575735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96461fe4-bc13-48fd-af64-893f1f3ea377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:10.585252 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96461fe4-bc13-48fd-af64-893f1f3ea377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:10.586789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96461fe4-bc13-48fd-af64-893f1f3ea377 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:10.597313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1189/2389] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:39:11.246538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bc0e3-503d-4284-95a0-c9cebab90c79 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:11.247049 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bc0e3-503d-4284-95a0-c9cebab90c79 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:11.247144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bc0e3-503d-4284-95a0-c9cebab90c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:11.274676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-074bc0e3-503d-4284-95a0-c9cebab90c79 None None] MFA Rules not processed for user `fc192ff884a04ed580ed171ed91b138c`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:39:11.275909 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-074bc0e3-503d-4284-95a0-c9cebab90c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:11.343590 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1201/2390] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:39:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:39:11.355805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96461fe4-bc13-48fd-af64-893f1f3ea377 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:11.357781 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-96461fe4-bc13-48fd-af64-893f1f3ea377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:11.415387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96461fe4-bc13-48fd-af64-893f1f3ea377 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:11.420614 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364292e2-0098-46bd-b8d5-43e593162ed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:11.421375 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364292e2-0098-46bd-b8d5-43e593162ed4 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:11.421786 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364292e2-0098-46bd-b8d5-43e593162ed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:11.422341 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364292e2-0098-46bd-b8d5-43e593162ed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:11.432523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364292e2-0098-46bd-b8d5-43e593162ed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:11.434274 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364292e2-0098-46bd-b8d5-43e593162ed4 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:11.444330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1190/2391] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:39:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:39:12.784395 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f347f9-19a0-4c78-9eea-a4f348672b16 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:12.784886 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f347f9-19a0-4c78-9eea-a4f348672b16 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:12.784886 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f347f9-19a0-4c78-9eea-a4f348672b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:12.802272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-e6f347f9-19a0-4c78-9eea-a4f348672b16 None None] MFA Rules not processed for user `fc192ff884a04ed580ed171ed91b138c`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:39:12.803464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e6f347f9-19a0-4c78-9eea-a4f348672b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:12.810230 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1202/2392] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:39:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:39:20.861288 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dad23a-01cf-473c-90dd-ca00283e6e9b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:20.862151 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dad23a-01cf-473c-90dd-ca00283e6e9b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:20.862474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dad23a-01cf-473c-90dd-ca00283e6e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:20.880718 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-f1dad23a-01cf-473c-90dd-ca00283e6e9b None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:39:20.881923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f1dad23a-01cf-473c-90dd-ca00283e6e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:20.936595 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1191/2393] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 14:39:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:39:20.983937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f347f9-19a0-4c78-9eea-a4f348672b16 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:20.986167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e6f347f9-19a0-4c78-9eea-a4f348672b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:21.054494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f347f9-19a0-4c78-9eea-a4f348672b16 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:21.059355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64e76a-2b62-4fc6-a128-729132abb8f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:21.059989 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64e76a-2b62-4fc6-a128-729132abb8f9 service swift] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:21.060267 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64e76a-2b62-4fc6-a128-729132abb8f9 service swift] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:21.060537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64e76a-2b62-4fc6-a128-729132abb8f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:21.068378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64e76a-2b62-4fc6-a128-729132abb8f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:21.069947 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64e76a-2b62-4fc6-a128-729132abb8f9 service swift] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:21.078028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1203/2394] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:39:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:39:30.622225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590697c5-9dab-467d-8b9a-edab1045cc1a None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:30.622697 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590697c5-9dab-467d-8b9a-edab1045cc1a None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:30.622803 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590697c5-9dab-467d-8b9a-edab1045cc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:30.643058 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-590697c5-9dab-467d-8b9a-edab1045cc1a None None] MFA Rules not processed for user `fc192ff884a04ed580ed171ed91b138c`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:39:30.644251 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-590697c5-9dab-467d-8b9a-edab1045cc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:30.651132 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1192/2395] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:39:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:39:35.065643 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77f1d1-99fd-4d27-a3c8-446155894da4 None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:35.066258 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77f1d1-99fd-4d27-a3c8-446155894da4 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:35.066664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77f1d1-99fd-4d27-a3c8-446155894da4 None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:35.068605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1204/2396] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 14:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:39:35.075382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d195c7-ccfb-44d9-8f39-db0d22a0ad87 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:35.075931 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d195c7-ccfb-44d9-8f39-db0d22a0ad87 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:35.076191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d195c7-ccfb-44d9-8f39-db0d22a0ad87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:35.094809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-14d195c7-ccfb-44d9-8f39-db0d22a0ad87 None None] MFA Rules not processed for user `1f443d2ca1534249bb2c4096300ddffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:39:35.096097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-14d195c7-ccfb-44d9-8f39-db0d22a0ad87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:35.171549 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1193/2397] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 14:39:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:39:35.187865 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77f1d1-99fd-4d27-a3c8-446155894da4 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:35.190137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2c77f1d1-99fd-4d27-a3c8-446155894da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:35.277005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77f1d1-99fd-4d27-a3c8-446155894da4 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:35.282622 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a62b72-b4b2-458c-808c-5f00e04b5ace service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34ff47d8c4f4d99955340ddbdc3d475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:35.283491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a62b72-b4b2-458c-808c-5f00e04b5ace service glance] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:35.283937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a62b72-b4b2-458c-808c-5f00e04b5ace service glance] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:35.284389 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a62b72-b4b2-458c-808c-5f00e04b5ace service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:35.300495 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a62b72-b4b2-458c-808c-5f00e04b5ace service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:35.301975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a62b72-b4b2-458c-808c-5f00e04b5ace service glance] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:35.319869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1205/2398] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:39:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:39:35.400417 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e38b0-4380-4089-846b-352d695fcff4 None None] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:35.400769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e38b0-4380-4089-846b-352d695fcff4 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:35.401159 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e38b0-4380-4089-846b-352d695fcff4 None None] PATH_INFO: `/` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:35.403037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1194/2399] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 14:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:39:35.409331 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fc7a3-a98d-4452-abe8-23c785d845bc None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:35.409680 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fc7a3-a98d-4452-abe8-23c785d845bc None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:35.409961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fc7a3-a98d-4452-abe8-23c785d845bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:35.430356 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-b08fc7a3-a98d-4452-abe8-23c785d845bc None None] MFA Rules not processed for user `7b03ca44da654c3a9a5d9762b8eee189`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:39:35.431720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b08fc7a3-a98d-4452-abe8-23c785d845bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:35.440916 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1206/2400] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 14:39:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:39:35.457648 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e38b0-4380-4089-846b-352d695fcff4 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:35.474114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e38b0-4380-4089-846b-352d695fcff4 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:35.478130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f2038-75a2-4ff2-a92d-c44a1e1073f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:35.479142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f2038-75a2-4ff2-a92d-c44a1e1073f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:35.479815 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f2038-75a2-4ff2-a92d-c44a1e1073f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:35.480178 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f2038-75a2-4ff2-a92d-c44a1e1073f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:35.489511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f2038-75a2-4ff2-a92d-c44a1e1073f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:35.502424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f2038-75a2-4ff2-a92d-c44a1e1073f5 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:35.549971 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1195/2401] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:39:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:39:35.698280 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1d473-04cd-47b9-a1ce-79683e20a52d None None] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:35.698566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1d473-04cd-47b9-a1ce-79683e20a52d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:35.698869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1d473-04cd-47b9-a1ce-79683e20a52d None None] PATH_INFO: `/` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:35.700246 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1207/2402] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 17 14:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 14:39:35.707138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694571fa-4fb3-4fed-933d-38ced2aab2fe None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:35.707497 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694571fa-4fb3-4fed-933d-38ced2aab2fe None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:35.707834 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694571fa-4fb3-4fed-933d-38ced2aab2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:35.726675 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-694571fa-4fb3-4fed-933d-38ced2aab2fe None None] MFA Rules not processed for user `1f443d2ca1534249bb2c4096300ddffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:39:35.728011 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-694571fa-4fb3-4fed-933d-38ced2aab2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:35.738005 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1196/2403] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 17 14:39:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:39:35.748586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1d473-04cd-47b9-a1ce-79683e20a52d None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:35.761663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1d473-04cd-47b9-a1ce-79683e20a52d None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:35.765272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7804326-d4b8-4d92-abab-5dded4bb917c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:35.766525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7804326-d4b8-4d92-abab-5dded4bb917c service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:35.766805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7804326-d4b8-4d92-abab-5dded4bb917c service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:35.767051 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7804326-d4b8-4d92-abab-5dded4bb917c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:35.777670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7804326-d4b8-4d92-abab-5dded4bb917c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:35.779138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7804326-d4b8-4d92-abab-5dded4bb917c service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:35.790540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1208/2404] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:39:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:39:38.416970 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694571fa-4fb3-4fed-933d-38ced2aab2fe None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:38.418946 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-694571fa-4fb3-4fed-933d-38ced2aab2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:38.498723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694571fa-4fb3-4fed-933d-38ced2aab2fe None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:38.504620 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8c23d-3d96-43a0-8957-7803a39e9630 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fad90f42ebfe43eb8256611a88df87ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:38.505270 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8c23d-3d96-43a0-8957-7803a39e9630 service placement] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:38.505559 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8c23d-3d96-43a0-8957-7803a39e9630 service placement] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:38.505866 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8c23d-3d96-43a0-8957-7803a39e9630 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:38.507840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1fb8c23d-3d96-43a0-8957-7803a39e9630 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:38.521381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8c23d-3d96-43a0-8957-7803a39e9630 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:38.523143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8c23d-3d96-43a0-8957-7803a39e9630 service placement] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:38.541932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1197/2405] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:39:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:39:40.323084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f639f-a9da-467f-9ee7-ededd9877f80 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:40.323569 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f639f-a9da-467f-9ee7-ededd9877f80 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:40.323685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f639f-a9da-467f-9ee7-ededd9877f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:40.341759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-021f639f-a9da-467f-9ee7-ededd9877f80 None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:39:40.342976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-021f639f-a9da-467f-9ee7-ededd9877f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:39:40.351485 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1209/2406] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 14:39:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:39:40.363588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8c23d-3d96-43a0-8957-7803a39e9630 service placement] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:39:40.374631 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8c23d-3d96-43a0-8957-7803a39e9630 service placement] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:39:40.379634 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051f398-0e1a-4499-9064-d373ec1506a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:39:40.380272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051f398-0e1a-4499-9064-d373ec1506a4 service swift] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:39:40.380705 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051f398-0e1a-4499-9064-d373ec1506a4 service swift] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:39:40.380986 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051f398-0e1a-4499-9064-d373ec1506a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:39:40.389252 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051f398-0e1a-4499-9064-d373ec1506a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:39:40.391714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051f398-0e1a-4499-9064-d373ec1506a4 service swift] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:39:40.399848 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1198/2407] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:39:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:40:03.770452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c40f1a-8dad-49e3-98c0-0e0e361bf9da None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:03.771036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c40f1a-8dad-49e3-98c0-0e0e361bf9da None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:03.771036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c40f1a-8dad-49e3-98c0-0e0e361bf9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:03.791955 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-f0c40f1a-8dad-49e3-98c0-0e0e361bf9da None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:40:03.793871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f0c40f1a-8dad-49e3-98c0-0e0e361bf9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:03.810165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1210/2408] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 17 14:40:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:40:03.827840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051f398-0e1a-4499-9064-d373ec1506a4 service swift] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:03.839724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051f398-0e1a-4499-9064-d373ec1506a4 service swift] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:03.846946 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92eb29b-3b14-4fc0-b23f-ac7b097b68a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:03.847829 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92eb29b-3b14-4fc0-b23f-ac7b097b68a8 service swift] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:03.848639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92eb29b-3b14-4fc0-b23f-ac7b097b68a8 service swift] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:03.849217 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92eb29b-3b14-4fc0-b23f-ac7b097b68a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:03.861416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92eb29b-3b14-4fc0-b23f-ac7b097b68a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:03.863217 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92eb29b-3b14-4fc0-b23f-ac7b097b68a8 service swift] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:03.874850 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1199/2409] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:40:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 14:40:07.129956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1e798-9aaa-41d7-b17d-4f7411caef5c None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:07.130533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1e798-9aaa-41d7-b17d-4f7411caef5c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:07.130533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1e798-9aaa-41d7-b17d-4f7411caef5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:07.147587 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c9e1e798-9aaa-41d7-b17d-4f7411caef5c None None] MFA Rules not processed for user `5998f94809ee4001b031b901a8fc39c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:40:07.148760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c9e1e798-9aaa-41d7-b17d-4f7411caef5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:07.200971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1211/2410] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:40:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:40:10.762448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2a998-e348-4e1c-ba8f-63eaf76e7133 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:10.763346 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2a998-e348-4e1c-ba8f-63eaf76e7133 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:10.763845 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2a998-e348-4e1c-ba8f-63eaf76e7133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:10.786037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-e0b2a998-e348-4e1c-ba8f-63eaf76e7133 None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:40:10.787448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e0b2a998-e348-4e1c-ba8f-63eaf76e7133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:10.797064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1200/2411] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 14:40:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:40:10.809487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1e798-9aaa-41d7-b17d-4f7411caef5c None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:10.822737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1e798-9aaa-41d7-b17d-4f7411caef5c None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:10.828540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6953d88-c82b-4b1f-be98-789777d77d70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:10.829143 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6953d88-c82b-4b1f-be98-789777d77d70 service swift] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:10.829424 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6953d88-c82b-4b1f-be98-789777d77d70 service swift] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:10.829702 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6953d88-c82b-4b1f-be98-789777d77d70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:10.838819 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6953d88-c82b-4b1f-be98-789777d77d70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:10.840435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6953d88-c82b-4b1f-be98-789777d77d70 service swift] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:10.849587 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1212/2412] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:40:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:40:26.091499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715b6f4-2f5d-42f0-aed2-27a20f379e96 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:26.092588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715b6f4-2f5d-42f0-aed2-27a20f379e96 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:26.092797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715b6f4-2f5d-42f0-aed2-27a20f379e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:26.109841 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-9715b6f4-2f5d-42f0-aed2-27a20f379e96 None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:40:26.111038 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-9715b6f4-2f5d-42f0-aed2-27a20f379e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:26.117959 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1201/2413] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 17 14:40:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:40:26.129965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6953d88-c82b-4b1f-be98-789777d77d70 service swift] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:26.140996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6953d88-c82b-4b1f-be98-789777d77d70 service swift] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:26.145966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca2206-0d0a-43d3-9a53-17d88ba1bd6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:26.146641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2206-0d0a-43d3-9a53-17d88ba1bd6b service swift] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:26.146931 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2206-0d0a-43d3-9a53-17d88ba1bd6b service swift] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:26.147209 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2206-0d0a-43d3-9a53-17d88ba1bd6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:26.155780 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca2206-0d0a-43d3-9a53-17d88ba1bd6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:26.157355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca2206-0d0a-43d3-9a53-17d88ba1bd6b service swift] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:26.165219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1213/2414] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:40:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:40:28.046775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715b6f4-2f5d-42f0-aed2-27a20f379e96 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:28.057906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715b6f4-2f5d-42f0-aed2-27a20f379e96 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:28.063092 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae30cbc-2a19-453b-ae82-f30ff7cf9a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:28.063955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae30cbc-2a19-453b-ae82-f30ff7cf9a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:28.064234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae30cbc-2a19-453b-ae82-f30ff7cf9a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:28.064504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae30cbc-2a19-453b-ae82-f30ff7cf9a56 admin admin] PATH_INFO: `/v3/users/fc192ff884a04ed580ed171ed91b138c` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:28.065673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae30cbc-2a19-453b-ae82-f30ff7cf9a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc192ff884a04ed580ed171ed91b138c)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:28.067630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae30cbc-2a19-453b-ae82-f30ff7cf9a56 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:28.112776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8ae30cbc-2a19-453b-ae82-f30ff7cf9a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc192ff884a04ed580ed171ed91b138c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:28.119482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8ae30cbc-2a19-453b-ae82-f30ff7cf9a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc192ff884a04ed580ed171ed91b138c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:28.120147 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8ae30cbc-2a19-453b-ae82-f30ff7cf9a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc192ff884a04ed580ed171ed91b138c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:28.132170 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8ae30cbc-2a19-453b-ae82-f30ff7cf9a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc192ff884a04ed580ed171ed91b138c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:28.140278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8ae30cbc-2a19-453b-ae82-f30ff7cf9a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc192ff884a04ed580ed171ed91b138c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:28.146325 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1202/2415] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:40:28 2022] DELETE /identity/v3/users/fc192ff884a04ed580ed171ed91b138c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:40:28.312114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca2206-0d0a-43d3-9a53-17d88ba1bd6b service swift] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:28.322884 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca2206-0d0a-43d3-9a53-17d88ba1bd6b service swift] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:28.383939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fd360-e8a8-41b5-8a5a-32f208652ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:28.385131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fd360-e8a8-41b5-8a5a-32f208652ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:28.385715 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fd360-e8a8-41b5-8a5a-32f208652ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:28.386038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fd360-e8a8-41b5-8a5a-32f208652ba4 admin admin] PATH_INFO: `/v3/projects/67e29bf31a4a4c87bb5a9a359e4259ec` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:28.387686 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fd360-e8a8-41b5-8a5a-32f208652ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67e29bf31a4a4c87bb5a9a359e4259ec)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:28.390982 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fd360-e8a8-41b5-8a5a-32f208652ba4 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:28.438812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-cb3fd360-e8a8-41b5-8a5a-32f208652ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67e29bf31a4a4c87bb5a9a359e4259ec', 'request_id': 'req-cb3fd360-e8a8-41b5-8a5a-32f208652ba4'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:28.444749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-cb3fd360-e8a8-41b5-8a5a-32f208652ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67e29bf31a4a4c87bb5a9a359e4259ec', 'request_id': 'req-cb3fd360-e8a8-41b5-8a5a-32f208652ba4'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:28.452440 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-cb3fd360-e8a8-41b5-8a5a-32f208652ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67e29bf31a4a4c87bb5a9a359e4259ec', 'request_id': 'req-cb3fd360-e8a8-41b5-8a5a-32f208652ba4'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:28.462324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-cb3fd360-e8a8-41b5-8a5a-32f208652ba4 admin admin] The token cache is being invalidate because project 67e29bf31a4a4c87bb5a9a359e4259ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:40:28.462611 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-cb3fd360-e8a8-41b5-8a5a-32f208652ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:28.463233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-cb3fd360-e8a8-41b5-8a5a-32f208652ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:28.464768 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1214/2416] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:40:28 2022] DELETE /identity/v3/projects/67e29bf31a4a4c87bb5a9a359e4259ec => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:40:28.470566 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f126712-673f-4440-9a56-52141778877f None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:28.470857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f126712-673f-4440-9a56-52141778877f None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:28.471167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f126712-673f-4440-9a56-52141778877f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:28.489713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-5f126712-673f-4440-9a56-52141778877f None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:40:28.490935 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5f126712-673f-4440-9a56-52141778877f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:28.549904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1203/2417] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:40:28.557734 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbb524-158d-4c09-bd79-ea3570677414 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:28.558023 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbb524-158d-4c09-bd79-ea3570677414 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:28.558336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbb524-158d-4c09-bd79-ea3570677414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:28.577559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-30bbb524-158d-4c09-bd79-ea3570677414 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:40:28.578785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-30bbb524-158d-4c09-bd79-ea3570677414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:28.586645 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1215/2418] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:40:28.590822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f126712-673f-4440-9a56-52141778877f None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:28.601749 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f126712-673f-4440-9a56-52141778877f None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:28.606290 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7878b60-78c6-464b-b084-33089be86d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:28.606976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7878b60-78c6-464b-b084-33089be86d0d admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:28.607883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7878b60-78c6-464b-b084-33089be86d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:28.608308 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7878b60-78c6-464b-b084-33089be86d0d admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:28.609023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7878b60-78c6-464b-b084-33089be86d0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:40:28.609328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7878b60-78c6-464b-b084-33089be86d0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:28.610956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7878b60-78c6-464b-b084-33089be86d0d admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:28.622103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1204/2419] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:40:28.626787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbb524-158d-4c09-bd79-ea3570677414 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:28.636648 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbb524-158d-4c09-bd79-ea3570677414 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:28.641704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3091159-2379-4049-b2dd-23da5f4f8b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:28.642394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3091159-2379-4049-b2dd-23da5f4f8b01 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:28.642679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3091159-2379-4049-b2dd-23da5f4f8b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:28.642956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3091159-2379-4049-b2dd-23da5f4f8b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:28.643657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3091159-2379-4049-b2dd-23da5f4f8b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:28.645577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3091159-2379-4049-b2dd-23da5f4f8b01 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:28.672814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1216/2420] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:40:28 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:40:28.676217 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7878b60-78c6-464b-b084-33089be86d0d admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:28.686110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7878b60-78c6-464b-b084-33089be86d0d admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:28.740035 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be029a3-8e3c-4cd2-927d-7a7efbc61dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:28.740690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be029a3-8e3c-4cd2-927d-7a7efbc61dee admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:28.740968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be029a3-8e3c-4cd2-927d-7a7efbc61dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:28.741240 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be029a3-8e3c-4cd2-927d-7a7efbc61dee admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:28.741917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be029a3-8e3c-4cd2-927d-7a7efbc61dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:28.743991 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be029a3-8e3c-4cd2-927d-7a7efbc61dee admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:28.762522 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1205/2421] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:40:28 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:40:28.766794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3091159-2379-4049-b2dd-23da5f4f8b01 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:28.776880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3091159-2379-4049-b2dd-23da5f4f8b01 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:28.782116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422db493-29ef-441e-999d-551905b9170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:28.782798 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422db493-29ef-441e-999d-551905b9170f admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:28.783079 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422db493-29ef-441e-999d-551905b9170f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:28.783357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422db493-29ef-441e-999d-551905b9170f admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:28.784078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422db493-29ef-441e-999d-551905b9170f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:28.785683 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422db493-29ef-441e-999d-551905b9170f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:28.796524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1217/2422] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:40:28.800376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be029a3-8e3c-4cd2-927d-7a7efbc61dee admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:28.809946 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be029a3-8e3c-4cd2-927d-7a7efbc61dee admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:28.814685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502e09f-48f3-448c-9797-fce11a0e713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:28.815330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502e09f-48f3-448c-9797-fce11a0e713e admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:28.815612 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502e09f-48f3-448c-9797-fce11a0e713e admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:28.815883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502e09f-48f3-448c-9797-fce11a0e713e admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:28.816599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502e09f-48f3-448c-9797-fce11a0e713e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:28.818195 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502e09f-48f3-448c-9797-fce11a0e713e admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:28.828551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1206/2423] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:40:28.832624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422db493-29ef-441e-999d-551905b9170f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:28.843186 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422db493-29ef-441e-999d-551905b9170f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:28.847807 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d7154-bf11-4936-afd4-02b17abc4985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:28.848768 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d7154-bf11-4936-afd4-02b17abc4985 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:28.848951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d7154-bf11-4936-afd4-02b17abc4985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:28.849320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d7154-bf11-4936-afd4-02b17abc4985 admin admin] PATH_INFO: `/v3/projects/d269c08582364434854b8d6f59e0f019/users/11e5e9fca4ed4855a693bbcf43f57a0a/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:28.863955 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d7154-bf11-4936-afd4-02b17abc4985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d269c08582364434854b8d6f59e0f019, user_id=11e5e9fca4ed4855a693bbcf43f57a0a, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:28.866681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d7154-bf11-4936-afd4-02b17abc4985 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:28.880343 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1218/2424] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:40:28 2022] PUT /identity/v3/projects/d269c08582364434854b8d6f59e0f019/users/11e5e9fca4ed4855a693bbcf43f57a0a/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:40:28.944116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134bd8d-e59c-4719-8a40-355281d296ac None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:28.944310 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134bd8d-e59c-4719-8a40-355281d296ac None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:28.944584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134bd8d-e59c-4719-8a40-355281d296ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:28.971548 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-3134bd8d-e59c-4719-8a40-355281d296ac None None] MFA Rules not processed for user `11e5e9fca4ed4855a693bbcf43f57a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:40:28.972748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3134bd8d-e59c-4719-8a40-355281d296ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:29.035314 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1207/2425] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:40:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:40:29.046835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d7154-bf11-4936-afd4-02b17abc4985 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:29.048529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7e7d7154-bf11-4936-afd4-02b17abc4985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:29.105191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d7154-bf11-4936-afd4-02b17abc4985 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:29.109074 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cfe42-c546-434d-962f-7178e333b4af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:29.109707 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cfe42-c546-434d-962f-7178e333b4af service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:29.109992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cfe42-c546-434d-962f-7178e333b4af service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:29.110304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cfe42-c546-434d-962f-7178e333b4af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:29.118609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cfe42-c546-434d-962f-7178e333b4af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:29.120050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cfe42-c546-434d-962f-7178e333b4af service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:29.129034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1219/2426] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:40:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:40:38.946510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134bd8d-e59c-4719-8a40-355281d296ac None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:39.007367 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134bd8d-e59c-4719-8a40-355281d296ac None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:39.012020 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7082f4-d8a0-485b-bed2-1e239fb40261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:39.012891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7082f4-d8a0-485b-bed2-1e239fb40261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:39.013177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7082f4-d8a0-485b-bed2-1e239fb40261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:39.013460 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7082f4-d8a0-485b-bed2-1e239fb40261 admin admin] PATH_INFO: `/v3/users/11e5e9fca4ed4855a693bbcf43f57a0a` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:39.014852 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7082f4-d8a0-485b-bed2-1e239fb40261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e5e9fca4ed4855a693bbcf43f57a0a)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:39.016809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7082f4-d8a0-485b-bed2-1e239fb40261 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:39.067272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4b7082f4-d8a0-485b-bed2-1e239fb40261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e5e9fca4ed4855a693bbcf43f57a0a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:39.074312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4b7082f4-d8a0-485b-bed2-1e239fb40261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e5e9fca4ed4855a693bbcf43f57a0a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:39.075102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4b7082f4-d8a0-485b-bed2-1e239fb40261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e5e9fca4ed4855a693bbcf43f57a0a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:39.086966 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4b7082f4-d8a0-485b-bed2-1e239fb40261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e5e9fca4ed4855a693bbcf43f57a0a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:39.094934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4b7082f4-d8a0-485b-bed2-1e239fb40261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e5e9fca4ed4855a693bbcf43f57a0a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:39.101194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1208/2427] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:40:38 2022] DELETE /identity/v3/users/11e5e9fca4ed4855a693bbcf43f57a0a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:40:39.105692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1f4dd-c387-42ff-8136-7b7b112fc591 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:39.106168 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1f4dd-c387-42ff-8136-7b7b112fc591 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:39.106303 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1f4dd-c387-42ff-8136-7b7b112fc591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:39.123594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-aef1f4dd-c387-42ff-8136-7b7b112fc591 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:40:39.124790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-aef1f4dd-c387-42ff-8136-7b7b112fc591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:39.186513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1220/2428] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:40:39.195993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7082f4-d8a0-485b-bed2-1e239fb40261 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:39.201404 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-4b7082f4-d8a0-485b-bed2-1e239fb40261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:39.261783 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7082f4-d8a0-485b-bed2-1e239fb40261 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:39.266129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17037c-8638-450e-80ba-6f308a9c06e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:39.266810 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17037c-8638-450e-80ba-6f308a9c06e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:39.267099 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17037c-8638-450e-80ba-6f308a9c06e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:39.267376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17037c-8638-450e-80ba-6f308a9c06e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:39.276804 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17037c-8638-450e-80ba-6f308a9c06e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:39.278273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17037c-8638-450e-80ba-6f308a9c06e9 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:39.289301 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1209/2429] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:40:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:40:39.565770 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1f4dd-c387-42ff-8136-7b7b112fc591 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:39.567280 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-aef1f4dd-c387-42ff-8136-7b7b112fc591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:39.579647 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1f4dd-c387-42ff-8136-7b7b112fc591 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:39.584509 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9ab20-ad30-40b7-a229-38ec030c9892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:39.585419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9ab20-ad30-40b7-a229-38ec030c9892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:39.585777 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9ab20-ad30-40b7-a229-38ec030c9892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:39.586048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9ab20-ad30-40b7-a229-38ec030c9892 admin admin] PATH_INFO: `/v3/projects/d269c08582364434854b8d6f59e0f019` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:39.587264 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9ab20-ad30-40b7-a229-38ec030c9892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d269c08582364434854b8d6f59e0f019)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:39.589183 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9ab20-ad30-40b7-a229-38ec030c9892 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:39.637916 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-96b9ab20-ad30-40b7-a229-38ec030c9892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd269c08582364434854b8d6f59e0f019', 'request_id': 'req-96b9ab20-ad30-40b7-a229-38ec030c9892'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:39.644452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-96b9ab20-ad30-40b7-a229-38ec030c9892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd269c08582364434854b8d6f59e0f019', 'request_id': 'req-96b9ab20-ad30-40b7-a229-38ec030c9892'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:39.651115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-96b9ab20-ad30-40b7-a229-38ec030c9892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd269c08582364434854b8d6f59e0f019', 'request_id': 'req-96b9ab20-ad30-40b7-a229-38ec030c9892'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:39.661545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-96b9ab20-ad30-40b7-a229-38ec030c9892 admin admin] The token cache is being invalidate because project d269c08582364434854b8d6f59e0f019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:40:39.661825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-96b9ab20-ad30-40b7-a229-38ec030c9892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:39.662457 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-96b9ab20-ad30-40b7-a229-38ec030c9892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:40:39.663969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1221/2430] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:40:39 2022] DELETE /identity/v3/projects/d269c08582364434854b8d6f59e0f019 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:40:39.669335 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679acd1f-c10c-4db2-8893-3b8fbe8ccead None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:39.669631 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679acd1f-c10c-4db2-8893-3b8fbe8ccead None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:39.670625 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679acd1f-c10c-4db2-8893-3b8fbe8ccead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:39.688963 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-679acd1f-c10c-4db2-8893-3b8fbe8ccead None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:40:39.690241 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-679acd1f-c10c-4db2-8893-3b8fbe8ccead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:39.746917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1210/2431] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:40:39.754503 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc8a13-afbd-48fb-a06d-76c38f2c942a None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:39.754797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc8a13-afbd-48fb-a06d-76c38f2c942a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:39.755079 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc8a13-afbd-48fb-a06d-76c38f2c942a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:39.773629 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-95bc8a13-afbd-48fb-a06d-76c38f2c942a None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:40:39.774872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-95bc8a13-afbd-48fb-a06d-76c38f2c942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:39.783377 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1222/2432] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:40:39.787615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679acd1f-c10c-4db2-8893-3b8fbe8ccead None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:39.797766 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679acd1f-c10c-4db2-8893-3b8fbe8ccead None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:39.802339 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a76281-8bff-4918-af99-f7cfe6439c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:39.802987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a76281-8bff-4918-af99-f7cfe6439c50 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:39.803269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a76281-8bff-4918-af99-f7cfe6439c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:39.803542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a76281-8bff-4918-af99-f7cfe6439c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:39.804256 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a76281-8bff-4918-af99-f7cfe6439c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:40:39.804583 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a76281-8bff-4918-af99-f7cfe6439c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:39.806162 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a76281-8bff-4918-af99-f7cfe6439c50 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:39.818071 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1211/2433] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:40:39.822753 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc8a13-afbd-48fb-a06d-76c38f2c942a None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:39.833052 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc8a13-afbd-48fb-a06d-76c38f2c942a None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:39.837780 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bdb11-47ef-4836-b140-c078faa2ea04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:39.838464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bdb11-47ef-4836-b140-c078faa2ea04 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:39.838742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bdb11-47ef-4836-b140-c078faa2ea04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:39.839013 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bdb11-47ef-4836-b140-c078faa2ea04 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:39.839695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bdb11-47ef-4836-b140-c078faa2ea04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:39.842115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bdb11-47ef-4836-b140-c078faa2ea04 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:39.868344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1223/2434] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:40:39 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:40:39.872504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a76281-8bff-4918-af99-f7cfe6439c50 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:39.882421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a76281-8bff-4918-af99-f7cfe6439c50 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:39.940395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f5489-1ee6-4a07-84e3-1daec2f563d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:39.941063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f5489-1ee6-4a07-84e3-1daec2f563d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:39.941347 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f5489-1ee6-4a07-84e3-1daec2f563d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:39.941625 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f5489-1ee6-4a07-84e3-1daec2f563d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:39.942382 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f5489-1ee6-4a07-84e3-1daec2f563d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:39.944372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f5489-1ee6-4a07-84e3-1daec2f563d7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:39.963763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1212/2435] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:40:39 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:40:39.968520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bdb11-47ef-4836-b140-c078faa2ea04 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:39.979094 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bdb11-47ef-4836-b140-c078faa2ea04 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:39.984287 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fa742-c1de-427a-8289-01fa408f5c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:39.984939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fa742-c1de-427a-8289-01fa408f5c63 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:39.985222 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fa742-c1de-427a-8289-01fa408f5c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:39.985499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fa742-c1de-427a-8289-01fa408f5c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:39.986270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fa742-c1de-427a-8289-01fa408f5c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:39.987869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fa742-c1de-427a-8289-01fa408f5c63 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:39.998071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1224/2436] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:40:40.002013 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f5489-1ee6-4a07-84e3-1daec2f563d7 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:40.011803 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f5489-1ee6-4a07-84e3-1daec2f563d7 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:40.016590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b5ca6-a32c-4cb8-be95-8e48b5b343f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:40.017246 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b5ca6-a32c-4cb8-be95-8e48b5b343f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:40.017532 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b5ca6-a32c-4cb8-be95-8e48b5b343f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:40.017810 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b5ca6-a32c-4cb8-be95-8e48b5b343f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:40.018596 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b5ca6-a32c-4cb8-be95-8e48b5b343f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:40.020214 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b5ca6-a32c-4cb8-be95-8e48b5b343f4 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:40.030727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1213/2437] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:40:40.034826 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fa742-c1de-427a-8289-01fa408f5c63 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:40.044623 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fa742-c1de-427a-8289-01fa408f5c63 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:40.050236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9a588-7695-4b52-b3e6-e9ea9c705485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:40.051107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9a588-7695-4b52-b3e6-e9ea9c705485 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:40.051387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9a588-7695-4b52-b3e6-e9ea9c705485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:40.051662 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9a588-7695-4b52-b3e6-e9ea9c705485 admin admin] PATH_INFO: `/v3/projects/70b8ad858874449d8e4cc18f694ad9c5/users/1966dbc5f0b4494eb1cdede47778bfea/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:40.065733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9a588-7695-4b52-b3e6-e9ea9c705485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b8ad858874449d8e4cc18f694ad9c5, user_id=1966dbc5f0b4494eb1cdede47778bfea, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:40.068732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9a588-7695-4b52-b3e6-e9ea9c705485 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:40.082055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1225/2438] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:40:40 2022] PUT /identity/v3/projects/70b8ad858874449d8e4cc18f694ad9c5/users/1966dbc5f0b4494eb1cdede47778bfea/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:40:40.093553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faaa5c-32cd-470e-943e-e659ffe25453 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:40.093834 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faaa5c-32cd-470e-943e-e659ffe25453 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:40.094110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faaa5c-32cd-470e-943e-e659ffe25453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:40.120317 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-18faaa5c-32cd-470e-943e-e659ffe25453 None None] MFA Rules not processed for user `1966dbc5f0b4494eb1cdede47778bfea`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:40:40.121523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-18faaa5c-32cd-470e-943e-e659ffe25453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:40.184598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1214/2439] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:40:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:40:40.195267 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9a588-7695-4b52-b3e6-e9ea9c705485 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:40:40.197235 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-63a9a588-7695-4b52-b3e6-e9ea9c705485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:40.252810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9a588-7695-4b52-b3e6-e9ea9c705485 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:40:40.257373 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21848d07-0050-4de6-baf2-bcce683eb46e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:40:40.258353 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21848d07-0050-4de6-baf2-bcce683eb46e service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:40.258680 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21848d07-0050-4de6-baf2-bcce683eb46e service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:40.259085 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21848d07-0050-4de6-baf2-bcce683eb46e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:40.268589 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21848d07-0050-4de6-baf2-bcce683eb46e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:40:40.270023 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21848d07-0050-4de6-baf2-bcce683eb46e service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:40:40.278678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1226/2440] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:40:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:40:41.610552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9530bf9-fbd1-4e66-ba98-e4c84e297bab None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:41.611040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9530bf9-fbd1-4e66-ba98-e4c84e297bab None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:41.611186 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9530bf9-fbd1-4e66-ba98-e4c84e297bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:41.629071 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-e9530bf9-fbd1-4e66-ba98-e4c84e297bab None None] MFA Rules not processed for user `1966dbc5f0b4494eb1cdede47778bfea`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:40:41.630298 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e9530bf9-fbd1-4e66-ba98-e4c84e297bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:40:41.638528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1215/2441] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:40:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:40:59.970997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5d6c8-c60c-418c-8d4e-a6b20bca9f45 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:40:59.971501 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5d6c8-c60c-418c-8d4e-a6b20bca9f45 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:40:59.971602 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5d6c8-c60c-418c-8d4e-a6b20bca9f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:40:59.989337 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-2da5d6c8-c60c-418c-8d4e-a6b20bca9f45 None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:40:59.990565 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2da5d6c8-c60c-418c-8d4e-a6b20bca9f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:00.043692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1227/2442] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:41:00.056003 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9530bf9-fbd1-4e66-ba98-e4c84e297bab None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:00.057383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e9530bf9-fbd1-4e66-ba98-e4c84e297bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:00.125420 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9530bf9-fbd1-4e66-ba98-e4c84e297bab None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:00.130379 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41494f-202f-4be2-b8fb-f9edd8ee1710 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:00.131022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41494f-202f-4be2-b8fb-f9edd8ee1710 service swift] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:00.131303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41494f-202f-4be2-b8fb-f9edd8ee1710 service swift] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:00.131606 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41494f-202f-4be2-b8fb-f9edd8ee1710 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:00.140247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41494f-202f-4be2-b8fb-f9edd8ee1710 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:00.142005 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41494f-202f-4be2-b8fb-f9edd8ee1710 service swift] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:00.149796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1216/2443] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:41:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:41:00.677755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9efe4-da2e-4162-a15b-bf1fd45a80bc None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:00.678045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9efe4-da2e-4162-a15b-bf1fd45a80bc None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:00.678361 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9efe4-da2e-4162-a15b-bf1fd45a80bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:00.698009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-11c9efe4-da2e-4162-a15b-bf1fd45a80bc None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:00.699241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-11c9efe4-da2e-4162-a15b-bf1fd45a80bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:00.706907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1228/2444] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 17 14:41:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:00.719872 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41494f-202f-4be2-b8fb-f9edd8ee1710 service swift] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:00.730055 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41494f-202f-4be2-b8fb-f9edd8ee1710 service swift] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:00.735616 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d3d84-9841-47ee-a1d1-3867a9de294a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:00.736247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d3d84-9841-47ee-a1d1-3867a9de294a service swift] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:00.736531 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d3d84-9841-47ee-a1d1-3867a9de294a service swift] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:00.736809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d3d84-9841-47ee-a1d1-3867a9de294a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:00.744619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d3d84-9841-47ee-a1d1-3867a9de294a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:00.746207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d3d84-9841-47ee-a1d1-3867a9de294a service swift] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:00.755157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1217/2445] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:41:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:41:00.939573 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4371fb-fe6c-4588-a84c-a9b5222eafc2 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:00.939869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4371fb-fe6c-4588-a84c-a9b5222eafc2 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:00.940153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4371fb-fe6c-4588-a84c-a9b5222eafc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:00.958546 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-4a4371fb-fe6c-4588-a84c-a9b5222eafc2 None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:00.959733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-4a4371fb-fe6c-4588-a84c-a9b5222eafc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:00.966765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1229/2446] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 14:41:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:41:00.979278 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d3d84-9841-47ee-a1d1-3867a9de294a service swift] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:00.990566 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d3d84-9841-47ee-a1d1-3867a9de294a service swift] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:00.995553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a60f90-d81a-4528-86b6-db3161b737a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:00.996195 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a60f90-d81a-4528-86b6-db3161b737a6 service swift] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:00.996475 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a60f90-d81a-4528-86b6-db3161b737a6 service swift] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:00.996870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a60f90-d81a-4528-86b6-db3161b737a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:01.006041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a60f90-d81a-4528-86b6-db3161b737a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:01.007705 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a60f90-d81a-4528-86b6-db3161b737a6 service swift] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:01.015943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1218/2447] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:41:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:41:01.332203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdada95-bfd7-4b5e-9258-25804f18afdf None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:01.332670 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdada95-bfd7-4b5e-9258-25804f18afdf None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:01.332765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdada95-bfd7-4b5e-9258-25804f18afdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:01.351118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-6bdada95-bfd7-4b5e-9258-25804f18afdf None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:01.352332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6bdada95-bfd7-4b5e-9258-25804f18afdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:01.361312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1230/2448] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 17 14:41:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:01.373821 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a60f90-d81a-4528-86b6-db3161b737a6 service swift] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:01.385606 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a60f90-d81a-4528-86b6-db3161b737a6 service swift] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:01.390797 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5bc12-81e2-4d6b-9ff0-be11ae20d8d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:01.391441 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5bc12-81e2-4d6b-9ff0-be11ae20d8d2 service swift] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:01.391845 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5bc12-81e2-4d6b-9ff0-be11ae20d8d2 service swift] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:01.392134 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5bc12-81e2-4d6b-9ff0-be11ae20d8d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:01.401846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5bc12-81e2-4d6b-9ff0-be11ae20d8d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:01.403402 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5bc12-81e2-4d6b-9ff0-be11ae20d8d2 service swift] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:01.412130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1219/2449] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:41:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:41:03.468307 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdada95-bfd7-4b5e-9258-25804f18afdf None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:03.529915 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdada95-bfd7-4b5e-9258-25804f18afdf None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:03.535047 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12e32b-a617-49b6-bd3a-7c1bd60dad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:03.535904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12e32b-a617-49b6-bd3a-7c1bd60dad65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:03.536182 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12e32b-a617-49b6-bd3a-7c1bd60dad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:03.536455 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12e32b-a617-49b6-bd3a-7c1bd60dad65 admin admin] PATH_INFO: `/v3/users/1966dbc5f0b4494eb1cdede47778bfea` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:03.537620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12e32b-a617-49b6-bd3a-7c1bd60dad65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1966dbc5f0b4494eb1cdede47778bfea)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:03.539575 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12e32b-a617-49b6-bd3a-7c1bd60dad65 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:03.585040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7f12e32b-a617-49b6-bd3a-7c1bd60dad65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1966dbc5f0b4494eb1cdede47778bfea'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:03.591309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7f12e32b-a617-49b6-bd3a-7c1bd60dad65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1966dbc5f0b4494eb1cdede47778bfea'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:03.591909 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7f12e32b-a617-49b6-bd3a-7c1bd60dad65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1966dbc5f0b4494eb1cdede47778bfea'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:03.603912 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7f12e32b-a617-49b6-bd3a-7c1bd60dad65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1966dbc5f0b4494eb1cdede47778bfea'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:03.610594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7f12e32b-a617-49b6-bd3a-7c1bd60dad65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1966dbc5f0b4494eb1cdede47778bfea'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:03.616281 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1231/2450] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:03 2022] DELETE /identity/v3/users/1966dbc5f0b4494eb1cdede47778bfea => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:03.620795 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69120d9-26be-4e48-abd7-0125ebcecfb6 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:03.621294 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69120d9-26be-4e48-abd7-0125ebcecfb6 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:03.621420 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69120d9-26be-4e48-abd7-0125ebcecfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:03.640904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-d69120d9-26be-4e48-abd7-0125ebcecfb6 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:03.642111 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d69120d9-26be-4e48-abd7-0125ebcecfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:03.699479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1220/2451] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:03.710073 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12e32b-a617-49b6-bd3a-7c1bd60dad65 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:03.711496 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7f12e32b-a617-49b6-bd3a-7c1bd60dad65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:03.766419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12e32b-a617-49b6-bd3a-7c1bd60dad65 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:03.770031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694737a1-0115-4d92-9ffb-fb6d4b5dabe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:03.770701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694737a1-0115-4d92-9ffb-fb6d4b5dabe4 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:03.770980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694737a1-0115-4d92-9ffb-fb6d4b5dabe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:03.771249 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694737a1-0115-4d92-9ffb-fb6d4b5dabe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:03.779969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694737a1-0115-4d92-9ffb-fb6d4b5dabe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:03.781522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694737a1-0115-4d92-9ffb-fb6d4b5dabe4 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:03.790630 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1232/2452] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:03.959946 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69120d9-26be-4e48-abd7-0125ebcecfb6 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:03.961366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d69120d9-26be-4e48-abd7-0125ebcecfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:03.978760 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69120d9-26be-4e48-abd7-0125ebcecfb6 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:03.985628 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c20e5-ac52-4bc1-8b8f-8b2ea1606e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:03.987584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c20e5-ac52-4bc1-8b8f-8b2ea1606e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:03.987995 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c20e5-ac52-4bc1-8b8f-8b2ea1606e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:03.988425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c20e5-ac52-4bc1-8b8f-8b2ea1606e0a admin admin] PATH_INFO: `/v3/projects/70b8ad858874449d8e4cc18f694ad9c5` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:03.989981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c20e5-ac52-4bc1-8b8f-8b2ea1606e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b8ad858874449d8e4cc18f694ad9c5)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:03.991956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c20e5-ac52-4bc1-8b8f-8b2ea1606e0a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:04.037284 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fa3c20e5-ac52-4bc1-8b8f-8b2ea1606e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b8ad858874449d8e4cc18f694ad9c5', 'request_id': 'req-fa3c20e5-ac52-4bc1-8b8f-8b2ea1606e0a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:04.043299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fa3c20e5-ac52-4bc1-8b8f-8b2ea1606e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b8ad858874449d8e4cc18f694ad9c5', 'request_id': 'req-fa3c20e5-ac52-4bc1-8b8f-8b2ea1606e0a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:04.051181 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fa3c20e5-ac52-4bc1-8b8f-8b2ea1606e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b8ad858874449d8e4cc18f694ad9c5', 'request_id': 'req-fa3c20e5-ac52-4bc1-8b8f-8b2ea1606e0a'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:04.062117 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fa3c20e5-ac52-4bc1-8b8f-8b2ea1606e0a admin admin] The token cache is being invalidate because project 70b8ad858874449d8e4cc18f694ad9c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:04.062440 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fa3c20e5-ac52-4bc1-8b8f-8b2ea1606e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:04.063078 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fa3c20e5-ac52-4bc1-8b8f-8b2ea1606e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:04.064608 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1221/2453] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:03 2022] DELETE /identity/v3/projects/70b8ad858874449d8e4cc18f694ad9c5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:04.069553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7163b-27f2-45cf-9db3-22aaa3590565 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:04.069849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7163b-27f2-45cf-9db3-22aaa3590565 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:04.070129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7163b-27f2-45cf-9db3-22aaa3590565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:04.087594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-6ef7163b-27f2-45cf-9db3-22aaa3590565 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:04.088789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6ef7163b-27f2-45cf-9db3-22aaa3590565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:04.145475 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1233/2454] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:04.153891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45703c-85c9-46f7-ac7e-53096affd43b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:04.154200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45703c-85c9-46f7-ac7e-53096affd43b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:04.154504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45703c-85c9-46f7-ac7e-53096affd43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:04.173472 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-cb45703c-85c9-46f7-ac7e-53096affd43b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:04.174709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-cb45703c-85c9-46f7-ac7e-53096affd43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:04.182551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1222/2455] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:04.187168 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7163b-27f2-45cf-9db3-22aaa3590565 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:04.196947 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7163b-27f2-45cf-9db3-22aaa3590565 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:04.201604 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd839e7-3881-4f18-87c1-bf267a726438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:04.202470 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd839e7-3881-4f18-87c1-bf267a726438 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:04.202751 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd839e7-3881-4f18-87c1-bf267a726438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:04.203023 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd839e7-3881-4f18-87c1-bf267a726438 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:04.203738 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd839e7-3881-4f18-87c1-bf267a726438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:41:04.204039 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd839e7-3881-4f18-87c1-bf267a726438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:04.205632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd839e7-3881-4f18-87c1-bf267a726438 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:04.216904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1234/2456] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:41:04.221343 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45703c-85c9-46f7-ac7e-53096affd43b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:04.230501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45703c-85c9-46f7-ac7e-53096affd43b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:04.235762 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcf085-8b10-46c4-b235-f3baee4dde07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:04.236408 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcf085-8b10-46c4-b235-f3baee4dde07 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:04.236694 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcf085-8b10-46c4-b235-f3baee4dde07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:04.236973 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcf085-8b10-46c4-b235-f3baee4dde07 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:04.237700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcf085-8b10-46c4-b235-f3baee4dde07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:04.239644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcf085-8b10-46c4-b235-f3baee4dde07 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:04.265340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1223/2457] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:04 2022] POST /identity/v3/projects => generated 397 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:04.269523 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd839e7-3881-4f18-87c1-bf267a726438 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:04.279241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd839e7-3881-4f18-87c1-bf267a726438 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:04.334438 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb8909-b819-44d0-818d-8eff8c8052c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:04.335095 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8909-b819-44d0-818d-8eff8c8052c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:04.335378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8909-b819-44d0-818d-8eff8c8052c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:04.335653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8909-b819-44d0-818d-8eff8c8052c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:04.336341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb8909-b819-44d0-818d-8eff8c8052c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:04.338285 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb8909-b819-44d0-818d-8eff8c8052c0 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:04.359725 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1235/2458] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:04 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:04.363764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcf085-8b10-46c4-b235-f3baee4dde07 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:04.374792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcf085-8b10-46c4-b235-f3baee4dde07 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:04.379169 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2efdd6-cf9e-4a4b-a870-dfed3daa11c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:04.379833 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2efdd6-cf9e-4a4b-a870-dfed3daa11c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:04.380135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2efdd6-cf9e-4a4b-a870-dfed3daa11c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:04.380511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2efdd6-cf9e-4a4b-a870-dfed3daa11c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:04.381267 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2efdd6-cf9e-4a4b-a870-dfed3daa11c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:04.383071 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2efdd6-cf9e-4a4b-a870-dfed3daa11c0 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:04.396142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1224/2459] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:04.400555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb8909-b819-44d0-818d-8eff8c8052c0 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:04.411539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb8909-b819-44d0-818d-8eff8c8052c0 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:04.416254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f2636-c690-4979-80a7-01e71a9fe92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:04.416950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2636-c690-4979-80a7-01e71a9fe92a admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:04.417235 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2636-c690-4979-80a7-01e71a9fe92a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:04.417511 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2636-c690-4979-80a7-01e71a9fe92a admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:04.418295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f2636-c690-4979-80a7-01e71a9fe92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:04.420093 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f2636-c690-4979-80a7-01e71a9fe92a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:04.430969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1236/2460] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:04.435110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2efdd6-cf9e-4a4b-a870-dfed3daa11c0 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:04.445274 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2efdd6-cf9e-4a4b-a870-dfed3daa11c0 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:04.455509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a7854-6011-48a4-ae44-95b2f81b1dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:04.456334 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a7854-6011-48a4-ae44-95b2f81b1dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:04.456614 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a7854-6011-48a4-ae44-95b2f81b1dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:04.456886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a7854-6011-48a4-ae44-95b2f81b1dc2 admin admin] PATH_INFO: `/v3/projects/ed80063934834ec0a15fe9088f9a9b21/users/2add92f15d9a4b4e9e476acefeb5ebb8/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:04.473108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a7854-6011-48a4-ae44-95b2f81b1dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed80063934834ec0a15fe9088f9a9b21, user_id=2add92f15d9a4b4e9e476acefeb5ebb8, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:04.476461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a7854-6011-48a4-ae44-95b2f81b1dc2 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:04.491836 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1225/2461] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:04 2022] PUT /identity/v3/projects/ed80063934834ec0a15fe9088f9a9b21/users/2add92f15d9a4b4e9e476acefeb5ebb8/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:41:04.502275 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b1242-36f6-4101-924b-d5c407a3848b None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:04.502781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b1242-36f6-4101-924b-d5c407a3848b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:04.502781 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b1242-36f6-4101-924b-d5c407a3848b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:04.535525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-190b1242-36f6-4101-924b-d5c407a3848b None None] MFA Rules not processed for user `2add92f15d9a4b4e9e476acefeb5ebb8`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:04.536732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-190b1242-36f6-4101-924b-d5c407a3848b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:04.598252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1237/2462] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:04.610041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a7854-6011-48a4-ae44-95b2f81b1dc2 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:04.611724 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-fc7a7854-6011-48a4-ae44-95b2f81b1dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:04.675051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a7854-6011-48a4-ae44-95b2f81b1dc2 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:04.678871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff0e47-ac0c-4486-8db6-b4b3a2fe0df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:04.679524 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff0e47-ac0c-4486-8db6-b4b3a2fe0df2 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:04.679807 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff0e47-ac0c-4486-8db6-b4b3a2fe0df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:04.680083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff0e47-ac0c-4486-8db6-b4b3a2fe0df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:04.688819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff0e47-ac0c-4486-8db6-b4b3a2fe0df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:04.690314 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff0e47-ac0c-4486-8db6-b4b3a2fe0df2 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:04.699855 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1226/2463] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:13.815498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b1242-36f6-4101-924b-d5c407a3848b None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:13.876111 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b1242-36f6-4101-924b-d5c407a3848b None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:13.880678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a510dd7-eb14-40f1-a225-b9c68dd2aa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:13.881875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a510dd7-eb14-40f1-a225-b9c68dd2aa1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:13.881875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a510dd7-eb14-40f1-a225-b9c68dd2aa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:13.882063 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a510dd7-eb14-40f1-a225-b9c68dd2aa1f admin admin] PATH_INFO: `/v3/users/2add92f15d9a4b4e9e476acefeb5ebb8` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:13.883291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a510dd7-eb14-40f1-a225-b9c68dd2aa1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2add92f15d9a4b4e9e476acefeb5ebb8)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:13.885233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a510dd7-eb14-40f1-a225-b9c68dd2aa1f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:13.938025 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7a510dd7-eb14-40f1-a225-b9c68dd2aa1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2add92f15d9a4b4e9e476acefeb5ebb8'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:13.943241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7a510dd7-eb14-40f1-a225-b9c68dd2aa1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2add92f15d9a4b4e9e476acefeb5ebb8'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:13.943964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7a510dd7-eb14-40f1-a225-b9c68dd2aa1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2add92f15d9a4b4e9e476acefeb5ebb8'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:13.956599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7a510dd7-eb14-40f1-a225-b9c68dd2aa1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2add92f15d9a4b4e9e476acefeb5ebb8'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:13.963687 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7a510dd7-eb14-40f1-a225-b9c68dd2aa1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2add92f15d9a4b4e9e476acefeb5ebb8'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:13.976038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1238/2464] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:13 2022] DELETE /identity/v3/users/2add92f15d9a4b4e9e476acefeb5ebb8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:13.976399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f745d27-beef-41b4-8ff9-d77b4e7b8faf None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:13.976399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f745d27-beef-41b4-8ff9-d77b4e7b8faf None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:13.976399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f745d27-beef-41b4-8ff9-d77b4e7b8faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:13.979797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a510dd7-eb14-40f1-a225-b9c68dd2aa1f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:13.981121 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7a510dd7-eb14-40f1-a225-b9c68dd2aa1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:13.993067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-8f745d27-beef-41b4-8ff9-d77b4e7b8faf None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:13.994283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-8f745d27-beef-41b4-8ff9-d77b4e7b8faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:14.042678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a510dd7-eb14-40f1-a225-b9c68dd2aa1f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:14.049009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff224e-f1b7-4e0d-a60d-1cd5b1f8b978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:14.050012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff224e-f1b7-4e0d-a60d-1cd5b1f8b978 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:14.050536 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff224e-f1b7-4e0d-a60d-1cd5b1f8b978 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:14.051000 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff224e-f1b7-4e0d-a60d-1cd5b1f8b978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:14.053247 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-03ff224e-f1b7-4e0d-a60d-1cd5b1f8b978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:14.054877 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1227/2465] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:41:14.065565 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f745d27-beef-41b4-8ff9-d77b4e7b8faf None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:14.070866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff224e-f1b7-4e0d-a60d-1cd5b1f8b978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:14.072664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff224e-f1b7-4e0d-a60d-1cd5b1f8b978 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:14.075194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f745d27-beef-41b4-8ff9-d77b4e7b8faf None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:14.079418 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2e257-9a40-4630-b793-d36dfc1a45d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:14.080069 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2e257-9a40-4630-b793-d36dfc1a45d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:14.080861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2e257-9a40-4630-b793-d36dfc1a45d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:14.080861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2e257-9a40-4630-b793-d36dfc1a45d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:14.084823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1239/2466] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:41:14.090048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2e257-9a40-4630-b793-d36dfc1a45d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:14.091545 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2e257-9a40-4630-b793-d36dfc1a45d8 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:14.104423 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1228/2467] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:41:15.083704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff224e-f1b7-4e0d-a60d-1cd5b1f8b978 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:15.085414 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-03ff224e-f1b7-4e0d-a60d-1cd5b1f8b978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:15.107887 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff224e-f1b7-4e0d-a60d-1cd5b1f8b978 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:15.116664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9011d5-438e-4e02-8128-a66373010fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:15.119092 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9011d5-438e-4e02-8128-a66373010fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:15.119092 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9011d5-438e-4e02-8128-a66373010fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:15.122326 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9011d5-438e-4e02-8128-a66373010fde admin admin] PATH_INFO: `/v3/projects/ed80063934834ec0a15fe9088f9a9b21` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:15.125194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9011d5-438e-4e02-8128-a66373010fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed80063934834ec0a15fe9088f9a9b21)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:15.127889 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9011d5-438e-4e02-8128-a66373010fde admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:15.228279 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-dd9011d5-438e-4e02-8128-a66373010fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed80063934834ec0a15fe9088f9a9b21', 'request_id': 'req-dd9011d5-438e-4e02-8128-a66373010fde'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:15.237139 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-dd9011d5-438e-4e02-8128-a66373010fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed80063934834ec0a15fe9088f9a9b21', 'request_id': 'req-dd9011d5-438e-4e02-8128-a66373010fde'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:15.252862 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-dd9011d5-438e-4e02-8128-a66373010fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed80063934834ec0a15fe9088f9a9b21', 'request_id': 'req-dd9011d5-438e-4e02-8128-a66373010fde'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:15.271980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-dd9011d5-438e-4e02-8128-a66373010fde admin admin] The token cache is being invalidate because project ed80063934834ec0a15fe9088f9a9b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:15.272328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-dd9011d5-438e-4e02-8128-a66373010fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:15.273152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-dd9011d5-438e-4e02-8128-a66373010fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:15.275241 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1240/2468] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:15 2022] DELETE /identity/v3/projects/ed80063934834ec0a15fe9088f9a9b21 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:18.241900 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2e257-9a40-4630-b793-d36dfc1a45d8 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:18.243872 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-85c2e257-9a40-4630-b793-d36dfc1a45d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:18.258191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2e257-9a40-4630-b793-d36dfc1a45d8 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:18.350758 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40d50e-2137-4580-82ef-7bb03a0bf928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:18.351654 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40d50e-2137-4580-82ef-7bb03a0bf928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:18.351971 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40d50e-2137-4580-82ef-7bb03a0bf928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:18.352248 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40d50e-2137-4580-82ef-7bb03a0bf928 admin admin] PATH_INFO: `/v3/users/4716dd7e4131445c823cef63cae49308` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:18.353685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40d50e-2137-4580-82ef-7bb03a0bf928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4716dd7e4131445c823cef63cae49308)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:18.355730 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40d50e-2137-4580-82ef-7bb03a0bf928 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:18.417745 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0d40d50e-2137-4580-82ef-7bb03a0bf928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4716dd7e4131445c823cef63cae49308'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:18.425401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0d40d50e-2137-4580-82ef-7bb03a0bf928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4716dd7e4131445c823cef63cae49308'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:18.426126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0d40d50e-2137-4580-82ef-7bb03a0bf928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4716dd7e4131445c823cef63cae49308'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:18.438785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0d40d50e-2137-4580-82ef-7bb03a0bf928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4716dd7e4131445c823cef63cae49308'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:18.447728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0d40d50e-2137-4580-82ef-7bb03a0bf928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4716dd7e4131445c823cef63cae49308'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:18.454536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1229/2469] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:18 2022] DELETE /identity/v3/users/4716dd7e4131445c823cef63cae49308 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:18.653037 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9011d5-438e-4e02-8128-a66373010fde admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:18.654637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-dd9011d5-438e-4e02-8128-a66373010fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:18.669913 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9011d5-438e-4e02-8128-a66373010fde admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:18.742312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff91c7-a77d-40c6-b848-9b66a4191467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:18.743274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff91c7-a77d-40c6-b848-9b66a4191467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:18.743558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff91c7-a77d-40c6-b848-9b66a4191467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:18.743841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff91c7-a77d-40c6-b848-9b66a4191467 admin admin] PATH_INFO: `/v3/projects/1c0f2b9b46fb405a834f6b1e179f8bf8` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:18.745094 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff91c7-a77d-40c6-b848-9b66a4191467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c0f2b9b46fb405a834f6b1e179f8bf8)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:18.747081 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff91c7-a77d-40c6-b848-9b66a4191467 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:18.800826 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-fbff91c7-a77d-40c6-b848-9b66a4191467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0f2b9b46fb405a834f6b1e179f8bf8', 'request_id': 'req-fbff91c7-a77d-40c6-b848-9b66a4191467'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:18.808293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-fbff91c7-a77d-40c6-b848-9b66a4191467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0f2b9b46fb405a834f6b1e179f8bf8', 'request_id': 'req-fbff91c7-a77d-40c6-b848-9b66a4191467'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:18.816650 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-fbff91c7-a77d-40c6-b848-9b66a4191467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0f2b9b46fb405a834f6b1e179f8bf8', 'request_id': 'req-fbff91c7-a77d-40c6-b848-9b66a4191467'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:18.829324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-fbff91c7-a77d-40c6-b848-9b66a4191467 admin admin] The token cache is being invalidate because project 1c0f2b9b46fb405a834f6b1e179f8bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:18.830732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-fbff91c7-a77d-40c6-b848-9b66a4191467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:18.831421 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-fbff91c7-a77d-40c6-b848-9b66a4191467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:18.832979 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1241/2470] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:18 2022] DELETE /identity/v3/projects/1c0f2b9b46fb405a834f6b1e179f8bf8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:18.839446 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e83250-b457-4fba-a0b7-acd838b9e540 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:18.840007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e83250-b457-4fba-a0b7-acd838b9e540 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:18.840633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e83250-b457-4fba-a0b7-acd838b9e540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:18.864949 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-b1e83250-b457-4fba-a0b7-acd838b9e540 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:18.866194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b1e83250-b457-4fba-a0b7-acd838b9e540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:18.929845 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1230/2471] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:18.938575 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e62c14-1071-4b08-9c0e-428317fe6a43 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:18.938869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e62c14-1071-4b08-9c0e-428317fe6a43 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:18.939153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e62c14-1071-4b08-9c0e-428317fe6a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:18.959794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-b7e62c14-1071-4b08-9c0e-428317fe6a43 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:18.961010 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b7e62c14-1071-4b08-9c0e-428317fe6a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:18.970902 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1242/2472] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:18.975479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e83250-b457-4fba-a0b7-acd838b9e540 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:18.985290 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e83250-b457-4fba-a0b7-acd838b9e540 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:18.991019 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fe559-c3e8-46d3-bdf6-74db1e4c5386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:18.991688 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fe559-c3e8-46d3-bdf6-74db1e4c5386 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:18.991974 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fe559-c3e8-46d3-bdf6-74db1e4c5386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:18.992255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fe559-c3e8-46d3-bdf6-74db1e4c5386 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:18.992983 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fe559-c3e8-46d3-bdf6-74db1e4c5386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:41:18.993293 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fe559-c3e8-46d3-bdf6-74db1e4c5386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:18.995000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fe559-c3e8-46d3-bdf6-74db1e4c5386 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:19.011014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1231/2473] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:41:19.015868 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e62c14-1071-4b08-9c0e-428317fe6a43 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:19.026306 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e62c14-1071-4b08-9c0e-428317fe6a43 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:19.032103 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8da549-b466-4b33-bc85-d3e8380812a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:19.032763 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8da549-b466-4b33-bc85-d3e8380812a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:19.033069 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8da549-b466-4b33-bc85-d3e8380812a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:19.033344 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8da549-b466-4b33-bc85-d3e8380812a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:19.034068 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8da549-b466-4b33-bc85-d3e8380812a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:19.036048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8da549-b466-4b33-bc85-d3e8380812a1 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:19.061870 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1243/2474] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:19 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:19.066365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fe559-c3e8-46d3-bdf6-74db1e4c5386 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:19.076511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fe559-c3e8-46d3-bdf6-74db1e4c5386 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:19.133391 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c4f1a-bc25-4f21-8685-1b82405a4ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:19.134068 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4f1a-bc25-4f21-8685-1b82405a4ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:19.134389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4f1a-bc25-4f21-8685-1b82405a4ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:19.134673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4f1a-bc25-4f21-8685-1b82405a4ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:19.135360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c4f1a-bc25-4f21-8685-1b82405a4ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:19.137292 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c4f1a-bc25-4f21-8685-1b82405a4ce7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:19.157912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1232/2475] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:19 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:41:19.162009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8da549-b466-4b33-bc85-d3e8380812a1 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:19.172211 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8da549-b466-4b33-bc85-d3e8380812a1 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:19.176737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff1170-ed8d-4fff-befb-7335e53a4f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:19.177379 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff1170-ed8d-4fff-befb-7335e53a4f0d admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:19.177655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff1170-ed8d-4fff-befb-7335e53a4f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:19.177925 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff1170-ed8d-4fff-befb-7335e53a4f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:19.178679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff1170-ed8d-4fff-befb-7335e53a4f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:19.180307 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff1170-ed8d-4fff-befb-7335e53a4f0d admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:19.190161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1244/2476] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:19.194228 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c4f1a-bc25-4f21-8685-1b82405a4ce7 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:19.204717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c4f1a-bc25-4f21-8685-1b82405a4ce7 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:19.209271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b64d4-3f61-4f86-9191-00d20be6464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:19.209925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b64d4-3f61-4f86-9191-00d20be6464e admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:19.210230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b64d4-3f61-4f86-9191-00d20be6464e admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:19.210510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b64d4-3f61-4f86-9191-00d20be6464e admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:19.211227 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b64d4-3f61-4f86-9191-00d20be6464e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:19.212827 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b64d4-3f61-4f86-9191-00d20be6464e admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:19.223376 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1233/2477] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:19.227610 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff1170-ed8d-4fff-befb-7335e53a4f0d admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:19.237469 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff1170-ed8d-4fff-befb-7335e53a4f0d admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:19.241969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfa82e-4e44-458d-95f1-647e08b73084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:19.242872 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfa82e-4e44-458d-95f1-647e08b73084 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:19.243156 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfa82e-4e44-458d-95f1-647e08b73084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:19.243429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfa82e-4e44-458d-95f1-647e08b73084 admin admin] PATH_INFO: `/v3/projects/12ecdddf4be8429ebb9531161f44842a/users/678926cdc4214adc921ee3abd0de3ecf/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:19.258032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfa82e-4e44-458d-95f1-647e08b73084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ecdddf4be8429ebb9531161f44842a, user_id=678926cdc4214adc921ee3abd0de3ecf, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:19.260877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfa82e-4e44-458d-95f1-647e08b73084 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:19.274743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1245/2478] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:19 2022] PUT /identity/v3/projects/12ecdddf4be8429ebb9531161f44842a/users/678926cdc4214adc921ee3abd0de3ecf/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:19.287061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dce086-f5ad-4726-811b-f88793abcd9d None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:19.287570 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dce086-f5ad-4726-811b-f88793abcd9d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:19.287762 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dce086-f5ad-4726-811b-f88793abcd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:19.314267 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-a2dce086-f5ad-4726-811b-f88793abcd9d None None] MFA Rules not processed for user `678926cdc4214adc921ee3abd0de3ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:19.315476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a2dce086-f5ad-4726-811b-f88793abcd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:19.379473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1234/2479] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:19.383968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfa82e-4e44-458d-95f1-647e08b73084 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:19.444807 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfa82e-4e44-458d-95f1-647e08b73084 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:19.449725 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124fdbb-95da-4fbc-a800-b8b7ef4dbcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:19.450404 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124fdbb-95da-4fbc-a800-b8b7ef4dbcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:19.450685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124fdbb-95da-4fbc-a800-b8b7ef4dbcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:19.450956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124fdbb-95da-4fbc-a800-b8b7ef4dbcc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:19.451754 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124fdbb-95da-4fbc-a800-b8b7ef4dbcc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:19.453866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124fdbb-95da-4fbc-a800-b8b7ef4dbcc2 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:19.479127 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1246/2480] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:19 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:19.483214 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dce086-f5ad-4726-811b-f88793abcd9d None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:19.496177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dce086-f5ad-4726-811b-f88793abcd9d None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:19.540486 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124fdbb-95da-4fbc-a800-b8b7ef4dbcc2 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:19.542593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a124fdbb-95da-4fbc-a800-b8b7ef4dbcc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:19.557934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a6730-446e-4e79-8809-aecac3221764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:19.558643 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6730-446e-4e79-8809-aecac3221764 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:19.558924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6730-446e-4e79-8809-aecac3221764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:19.559200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6730-446e-4e79-8809-aecac3221764 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:19.559880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a6730-446e-4e79-8809-aecac3221764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:19.561800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a6730-446e-4e79-8809-aecac3221764 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:19.584384 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1235/2481] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:19 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:41:19.585460 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a6730-446e-4e79-8809-aecac3221764 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:19.595585 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a6730-446e-4e79-8809-aecac3221764 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:19.600411 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9a6cc-bc5b-4b16-9e4b-0e7eeff783bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:19.600882 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124fdbb-95da-4fbc-a800-b8b7ef4dbcc2 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:19.601059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9a6cc-bc5b-4b16-9e4b-0e7eeff783bf admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:19.601340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9a6cc-bc5b-4b16-9e4b-0e7eeff783bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:19.601612 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9a6cc-bc5b-4b16-9e4b-0e7eeff783bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:19.602365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9a6cc-bc5b-4b16-9e4b-0e7eeff783bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:19.603967 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9a6cc-bc5b-4b16-9e4b-0e7eeff783bf admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:19.604723 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f849d31-73c3-4e37-8cf9-5f9ba3984dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:19.605392 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f849d31-73c3-4e37-8cf9-5f9ba3984dfa service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:19.605649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f849d31-73c3-4e37-8cf9-5f9ba3984dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:19.605928 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f849d31-73c3-4e37-8cf9-5f9ba3984dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:19.607783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-0f849d31-73c3-4e37-8cf9-5f9ba3984dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:19.614442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1236/2482] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:19.618539 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9a6cc-bc5b-4b16-9e4b-0e7eeff783bf admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:19.620592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f849d31-73c3-4e37-8cf9-5f9ba3984dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:19.622033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f849d31-73c3-4e37-8cf9-5f9ba3984dfa service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:19.628261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9a6cc-bc5b-4b16-9e4b-0e7eeff783bf admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:19.631955 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1247/2483] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:19.632779 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470b7e0-1a67-4926-82a2-5892b3c1bd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:19.633757 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b7e0-1a67-4926-82a2-5892b3c1bd0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:19.634040 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b7e0-1a67-4926-82a2-5892b3c1bd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:19.634365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b7e0-1a67-4926-82a2-5892b3c1bd0e admin admin] PATH_INFO: `/v3/projects/e136394fe68a4703a21d50f39ff9ce6c/users/1e5d4cd4c3c04e6ebad4bc7812d64bb9/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:19.652307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470b7e0-1a67-4926-82a2-5892b3c1bd0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e136394fe68a4703a21d50f39ff9ce6c, user_id=1e5d4cd4c3c04e6ebad4bc7812d64bb9, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:19.655051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470b7e0-1a67-4926-82a2-5892b3c1bd0e admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:19.668682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1237/2484] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:19 2022] PUT /identity/v3/projects/e136394fe68a4703a21d50f39ff9ce6c/users/1e5d4cd4c3c04e6ebad4bc7812d64bb9/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:19.673239 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f849d31-73c3-4e37-8cf9-5f9ba3984dfa service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:19.683102 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f849d31-73c3-4e37-8cf9-5f9ba3984dfa service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:19.740459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1741a72-2747-4b01-86ec-d7c038330616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:19.741224 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1741a72-2747-4b01-86ec-d7c038330616 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:19.741505 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1741a72-2747-4b01-86ec-d7c038330616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:19.741778 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1741a72-2747-4b01-86ec-d7c038330616 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:19.742527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1741a72-2747-4b01-86ec-d7c038330616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:19.744136 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1741a72-2747-4b01-86ec-d7c038330616 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:19.754160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1248/2485] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:41:19.758312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470b7e0-1a67-4926-82a2-5892b3c1bd0e admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:19.769305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470b7e0-1a67-4926-82a2-5892b3c1bd0e admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:19.774107 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524fc93-ddbf-4cf7-846a-f85c36c5b8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:19.775141 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524fc93-ddbf-4cf7-846a-f85c36c5b8af admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:19.775492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524fc93-ddbf-4cf7-846a-f85c36c5b8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:19.775804 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524fc93-ddbf-4cf7-846a-f85c36c5b8af admin admin] PATH_INFO: `/v3/projects/e136394fe68a4703a21d50f39ff9ce6c/users/1e5d4cd4c3c04e6ebad4bc7812d64bb9/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:19.777771 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524fc93-ddbf-4cf7-846a-f85c36c5b8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e136394fe68a4703a21d50f39ff9ce6c, user_id=1e5d4cd4c3c04e6ebad4bc7812d64bb9, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:19.780562 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524fc93-ddbf-4cf7-846a-f85c36c5b8af admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:19.791860 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1238/2486] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:19 2022] PUT /identity/v3/projects/e136394fe68a4703a21d50f39ff9ce6c/users/1e5d4cd4c3c04e6ebad4bc7812d64bb9/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:19.802421 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4660b35-272d-49e3-ab4f-ba4c7e1494f9 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:19.802734 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4660b35-272d-49e3-ab4f-ba4c7e1494f9 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:19.803010 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4660b35-272d-49e3-ab4f-ba4c7e1494f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:19.830039 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-a4660b35-272d-49e3-ab4f-ba4c7e1494f9 None None] MFA Rules not processed for user `1e5d4cd4c3c04e6ebad4bc7812d64bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:19.831336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a4660b35-272d-49e3-ab4f-ba4c7e1494f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:19.897875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1249/2487] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:41:19.909227 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524fc93-ddbf-4cf7-846a-f85c36c5b8af admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:19.910939 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1524fc93-ddbf-4cf7-846a-f85c36c5b8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:19.969332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524fc93-ddbf-4cf7-846a-f85c36c5b8af admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:19.972942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91be471-b1b3-435e-8351-302a8afedb73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:19.973579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91be471-b1b3-435e-8351-302a8afedb73 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:19.973861 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91be471-b1b3-435e-8351-302a8afedb73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:19.974130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91be471-b1b3-435e-8351-302a8afedb73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:20.032030 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91be471-b1b3-435e-8351-302a8afedb73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:20.033398 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91be471-b1b3-435e-8351-302a8afedb73 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:20.042406 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1239/2488] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:22.829181 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4660b35-272d-49e3-ab4f-ba4c7e1494f9 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:22.830851 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a4660b35-272d-49e3-ab4f-ba4c7e1494f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:22.899161 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4660b35-272d-49e3-ab4f-ba4c7e1494f9 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:22.903721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ced09b-5d79-41b5-9d87-c638b1e7efc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:22.904612 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ced09b-5d79-41b5-9d87-c638b1e7efc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:22.904894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ced09b-5d79-41b5-9d87-c638b1e7efc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:22.905198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ced09b-5d79-41b5-9d87-c638b1e7efc7 admin admin] PATH_INFO: `/v3/users/357500181e4a43de8b1326d3db0b6f7b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:22.919210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ced09b-5d79-41b5-9d87-c638b1e7efc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=357500181e4a43de8b1326d3db0b6f7b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:22.921188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ced09b-5d79-41b5-9d87-c638b1e7efc7 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:22.965040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-37ced09b-5d79-41b5-9d87-c638b1e7efc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '357500181e4a43de8b1326d3db0b6f7b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:22.971638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-37ced09b-5d79-41b5-9d87-c638b1e7efc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '357500181e4a43de8b1326d3db0b6f7b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:22.972517 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-37ced09b-5d79-41b5-9d87-c638b1e7efc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '357500181e4a43de8b1326d3db0b6f7b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:22.983788 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-37ced09b-5d79-41b5-9d87-c638b1e7efc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '357500181e4a43de8b1326d3db0b6f7b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:22.991078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-37ced09b-5d79-41b5-9d87-c638b1e7efc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '357500181e4a43de8b1326d3db0b6f7b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:22.996871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1250/2489] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:22 2022] DELETE /identity/v3/users/357500181e4a43de8b1326d3db0b6f7b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:23.168128 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91be471-b1b3-435e-8351-302a8afedb73 service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:23.181268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91be471-b1b3-435e-8351-302a8afedb73 service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:23.239917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c8330-aa4c-4d72-a3fd-7fe959ad9666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:23.240697 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c8330-aa4c-4d72-a3fd-7fe959ad9666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:23.240981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c8330-aa4c-4d72-a3fd-7fe959ad9666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:23.241260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c8330-aa4c-4d72-a3fd-7fe959ad9666 admin admin] PATH_INFO: `/v3/projects/75507feeb9a54014b6bda2075ea1e146` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:23.252880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c8330-aa4c-4d72-a3fd-7fe959ad9666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75507feeb9a54014b6bda2075ea1e146)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:23.254863 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c8330-aa4c-4d72-a3fd-7fe959ad9666 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:23.301065 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fc9c8330-aa4c-4d72-a3fd-7fe959ad9666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75507feeb9a54014b6bda2075ea1e146', 'request_id': 'req-fc9c8330-aa4c-4d72-a3fd-7fe959ad9666'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:23.308126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fc9c8330-aa4c-4d72-a3fd-7fe959ad9666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75507feeb9a54014b6bda2075ea1e146', 'request_id': 'req-fc9c8330-aa4c-4d72-a3fd-7fe959ad9666'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:23.315499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fc9c8330-aa4c-4d72-a3fd-7fe959ad9666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75507feeb9a54014b6bda2075ea1e146', 'request_id': 'req-fc9c8330-aa4c-4d72-a3fd-7fe959ad9666'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:23.326109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fc9c8330-aa4c-4d72-a3fd-7fe959ad9666 admin admin] The token cache is being invalidate because project 75507feeb9a54014b6bda2075ea1e146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:23.326428 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fc9c8330-aa4c-4d72-a3fd-7fe959ad9666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:23.327048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fc9c8330-aa4c-4d72-a3fd-7fe959ad9666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:23.329135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1240/2490] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:23 2022] DELETE /identity/v3/projects/75507feeb9a54014b6bda2075ea1e146 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:23.333947 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37183a79-0b83-4503-83d6-2a0103e04b17 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:23.334272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37183a79-0b83-4503-83d6-2a0103e04b17 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:23.334554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37183a79-0b83-4503-83d6-2a0103e04b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:23.353122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-37183a79-0b83-4503-83d6-2a0103e04b17 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:23.354347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-37183a79-0b83-4503-83d6-2a0103e04b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:23.411100 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1251/2491] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:23.419539 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a134bb-9817-4ff1-8f9d-7b4508c95972 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:23.419830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a134bb-9817-4ff1-8f9d-7b4508c95972 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:23.420117 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a134bb-9817-4ff1-8f9d-7b4508c95972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:23.438545 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-48a134bb-9817-4ff1-8f9d-7b4508c95972 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:23.439663 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-48a134bb-9817-4ff1-8f9d-7b4508c95972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:23.447722 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1241/2492] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:23.451987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37183a79-0b83-4503-83d6-2a0103e04b17 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:23.462109 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37183a79-0b83-4503-83d6-2a0103e04b17 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:23.466689 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226892d-2834-400a-8d91-64c27ede70f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:23.467341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226892d-2834-400a-8d91-64c27ede70f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:23.467626 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226892d-2834-400a-8d91-64c27ede70f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:23.467928 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226892d-2834-400a-8d91-64c27ede70f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:23.469282 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226892d-2834-400a-8d91-64c27ede70f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:41:23.469591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226892d-2834-400a-8d91-64c27ede70f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:23.471227 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226892d-2834-400a-8d91-64c27ede70f0 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:23.482358 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1252/2493] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:41:23.486575 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a134bb-9817-4ff1-8f9d-7b4508c95972 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:23.497414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a134bb-9817-4ff1-8f9d-7b4508c95972 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:23.502121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f2748-2c7c-4442-abb3-42bac1d7de5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:23.503047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f2748-2c7c-4442-abb3-42bac1d7de5f admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:23.503333 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f2748-2c7c-4442-abb3-42bac1d7de5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:23.503623 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f2748-2c7c-4442-abb3-42bac1d7de5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:23.504313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f2748-2c7c-4442-abb3-42bac1d7de5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:23.506247 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f2748-2c7c-4442-abb3-42bac1d7de5f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:23.532283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1242/2494] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:23 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:23.538194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226892d-2834-400a-8d91-64c27ede70f0 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:23.548196 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226892d-2834-400a-8d91-64c27ede70f0 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:23.605785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01176b-83a6-4a28-97ac-227f633ffaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:23.606493 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01176b-83a6-4a28-97ac-227f633ffaab admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:23.606782 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01176b-83a6-4a28-97ac-227f633ffaab admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:23.607064 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01176b-83a6-4a28-97ac-227f633ffaab admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:23.607761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01176b-83a6-4a28-97ac-227f633ffaab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:23.609699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01176b-83a6-4a28-97ac-227f633ffaab admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:23.629098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1253/2495] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:23 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:23.633262 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f2748-2c7c-4442-abb3-42bac1d7de5f admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:23.645388 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f2748-2c7c-4442-abb3-42bac1d7de5f admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:23.649905 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71b7d2-20bb-4374-9786-a6b26aee75fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:23.650588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71b7d2-20bb-4374-9786-a6b26aee75fd admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:23.650868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71b7d2-20bb-4374-9786-a6b26aee75fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:23.651142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71b7d2-20bb-4374-9786-a6b26aee75fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:23.651850 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71b7d2-20bb-4374-9786-a6b26aee75fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:23.653444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71b7d2-20bb-4374-9786-a6b26aee75fd admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:23.664330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1243/2496] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:23.668254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01176b-83a6-4a28-97ac-227f633ffaab admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:23.678357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01176b-83a6-4a28-97ac-227f633ffaab admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:23.682970 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a248aa-c281-42d5-8366-f801273a5ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:23.683625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a248aa-c281-42d5-8366-f801273a5ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:23.683909 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a248aa-c281-42d5-8366-f801273a5ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:23.684188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a248aa-c281-42d5-8366-f801273a5ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:23.684909 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a248aa-c281-42d5-8366-f801273a5ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:23.686558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a248aa-c281-42d5-8366-f801273a5ed1 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:23.696686 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1254/2497] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:23.700721 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71b7d2-20bb-4374-9786-a6b26aee75fd admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:23.711002 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71b7d2-20bb-4374-9786-a6b26aee75fd admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:23.715687 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865df052-8754-47fa-85b3-531811163948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:23.716682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865df052-8754-47fa-85b3-531811163948 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:23.716965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865df052-8754-47fa-85b3-531811163948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:23.717249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865df052-8754-47fa-85b3-531811163948 admin admin] PATH_INFO: `/v3/projects/c9bc2d80fab743f4bd1969ba804ecebf/users/de65081cfa5641cdb40a8309e8d3ca83/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:23.732413 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865df052-8754-47fa-85b3-531811163948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9bc2d80fab743f4bd1969ba804ecebf, user_id=de65081cfa5641cdb40a8309e8d3ca83, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:23.735374 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865df052-8754-47fa-85b3-531811163948 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:23.747801 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1244/2498] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:23 2022] PUT /identity/v3/projects/c9bc2d80fab743f4bd1969ba804ecebf/users/de65081cfa5641cdb40a8309e8d3ca83/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:41:23.752910 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d2d1f-5853-4584-ac47-4f0fdbe0fe1b None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:23.753206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d2d1f-5853-4584-ac47-4f0fdbe0fe1b None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:23.753507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d2d1f-5853-4584-ac47-4f0fdbe0fe1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:23.771339 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-e20d2d1f-5853-4584-ac47-4f0fdbe0fe1b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:23.772531 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e20d2d1f-5853-4584-ac47-4f0fdbe0fe1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:23.830234 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1255/2499] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:23.839612 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865df052-8754-47fa-85b3-531811163948 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:23.841335 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-865df052-8754-47fa-85b3-531811163948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:23.899943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865df052-8754-47fa-85b3-531811163948 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:23.903554 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc01f4-4e01-4a4a-8da2-7385e63d99a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:23.904194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc01f4-4e01-4a4a-8da2-7385e63d99a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:23.904477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc01f4-4e01-4a4a-8da2-7385e63d99a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:23.904754 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc01f4-4e01-4a4a-8da2-7385e63d99a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:23.914075 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc01f4-4e01-4a4a-8da2-7385e63d99a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:23.915617 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc01f4-4e01-4a4a-8da2-7385e63d99a8 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:23.925338 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1245/2500] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:24.518511 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e108c47-5d40-43f1-b29d-35c31765799e None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:24.518806 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e108c47-5d40-43f1-b29d-35c31765799e None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:24.519088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e108c47-5d40-43f1-b29d-35c31765799e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:24.545322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-9e108c47-5d40-43f1-b29d-35c31765799e None None] MFA Rules not processed for user `de65081cfa5641cdb40a8309e8d3ca83`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:24.547038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-9e108c47-5d40-43f1-b29d-35c31765799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:24.613418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1256/2501] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:24.618396 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc01f4-4e01-4a4a-8da2-7385e63d99a8 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:24.629142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc01f4-4e01-4a4a-8da2-7385e63d99a8 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:24.634279 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cdeed-b0fb-4a83-b783-4103c9a9f6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:24.635114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cdeed-b0fb-4a83-b783-4103c9a9f6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:24.635602 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cdeed-b0fb-4a83-b783-4103c9a9f6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:24.635793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cdeed-b0fb-4a83-b783-4103c9a9f6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:24.636569 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cdeed-b0fb-4a83-b783-4103c9a9f6f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:24.638821 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cdeed-b0fb-4a83-b783-4103c9a9f6f7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:24.670245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1246/2502] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:24 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:41:24.672678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e108c47-5d40-43f1-b29d-35c31765799e None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:24.683362 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e108c47-5d40-43f1-b29d-35c31765799e None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:24.740395 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca0c95-9f3d-4e03-90ab-cc254d510e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:24.741064 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca0c95-9f3d-4e03-90ab-cc254d510e99 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:24.741350 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca0c95-9f3d-4e03-90ab-cc254d510e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:24.741620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca0c95-9f3d-4e03-90ab-cc254d510e99 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:24.742335 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca0c95-9f3d-4e03-90ab-cc254d510e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:24.744255 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca0c95-9f3d-4e03-90ab-cc254d510e99 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:24.763968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1257/2503] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:24 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:24.768455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cdeed-b0fb-4a83-b783-4103c9a9f6f7 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:24.779438 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cdeed-b0fb-4a83-b783-4103c9a9f6f7 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:24.784039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e4e52-037d-4de9-829c-8cf47011a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:24.784727 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e4e52-037d-4de9-829c-8cf47011a9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:24.785039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e4e52-037d-4de9-829c-8cf47011a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:24.785275 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e4e52-037d-4de9-829c-8cf47011a9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:24.786100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e4e52-037d-4de9-829c-8cf47011a9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:24.788016 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e4e52-037d-4de9-829c-8cf47011a9e8 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:24.799532 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1247/2504] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:24.803745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca0c95-9f3d-4e03-90ab-cc254d510e99 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:24.814971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca0c95-9f3d-4e03-90ab-cc254d510e99 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:24.819951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18538e8-68c8-41a3-b9bb-6c0771c18d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:24.821687 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18538e8-68c8-41a3-b9bb-6c0771c18d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:24.822196 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18538e8-68c8-41a3-b9bb-6c0771c18d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:24.822757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18538e8-68c8-41a3-b9bb-6c0771c18d8f admin admin] PATH_INFO: `/v3/projects/18cc9c9247c84f40bd8da81591cce864/users/0bbfc0b8d96d4787a5edb9cdddcb83c2/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:24.840400 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18538e8-68c8-41a3-b9bb-6c0771c18d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=18cc9c9247c84f40bd8da81591cce864, user_id=0bbfc0b8d96d4787a5edb9cdddcb83c2, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:24.843113 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18538e8-68c8-41a3-b9bb-6c0771c18d8f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:24.855800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1258/2505] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:24 2022] PUT /identity/v3/projects/18cc9c9247c84f40bd8da81591cce864/users/0bbfc0b8d96d4787a5edb9cdddcb83c2/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:24.859935 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e4e52-037d-4de9-829c-8cf47011a9e8 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:24.869812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e4e52-037d-4de9-829c-8cf47011a9e8 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:24.925154 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35104058-9bbc-471a-a836-dce39b9bb099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:24.925956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35104058-9bbc-471a-a836-dce39b9bb099 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:24.926277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35104058-9bbc-471a-a836-dce39b9bb099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:24.926562 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35104058-9bbc-471a-a836-dce39b9bb099 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:24.927289 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35104058-9bbc-471a-a836-dce39b9bb099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:24.928908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35104058-9bbc-471a-a836-dce39b9bb099 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:24.939567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1248/2506] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:24.943785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18538e8-68c8-41a3-b9bb-6c0771c18d8f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:24.956017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18538e8-68c8-41a3-b9bb-6c0771c18d8f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:24.960548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805ae29-b687-416d-8f99-2af00f5d96c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:24.961421 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805ae29-b687-416d-8f99-2af00f5d96c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:24.961723 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805ae29-b687-416d-8f99-2af00f5d96c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:24.961996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805ae29-b687-416d-8f99-2af00f5d96c9 admin admin] PATH_INFO: `/v3/projects/18cc9c9247c84f40bd8da81591cce864/users/0bbfc0b8d96d4787a5edb9cdddcb83c2/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:24.963976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805ae29-b687-416d-8f99-2af00f5d96c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18cc9c9247c84f40bd8da81591cce864, user_id=0bbfc0b8d96d4787a5edb9cdddcb83c2, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:24.966650 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805ae29-b687-416d-8f99-2af00f5d96c9 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:24.977159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1259/2507] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:24 2022] PUT /identity/v3/projects/18cc9c9247c84f40bd8da81591cce864/users/0bbfc0b8d96d4787a5edb9cdddcb83c2/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:25.605270 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f2721-9f92-4596-b457-eed8ba9d6bf5 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:25.605562 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f2721-9f92-4596-b457-eed8ba9d6bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:25.605853 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f2721-9f92-4596-b457-eed8ba9d6bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:25.634311 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7d5f2721-9f92-4596-b457-eed8ba9d6bf5 None None] MFA Rules not processed for user `0bbfc0b8d96d4787a5edb9cdddcb83c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:25.635437 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7d5f2721-9f92-4596-b457-eed8ba9d6bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:25.719179 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1249/2508] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:25 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:26.716954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805ae29-b687-416d-8f99-2af00f5d96c9 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:26.718368 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7805ae29-b687-416d-8f99-2af00f5d96c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:26.722749 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f2721-9f92-4596-b457-eed8ba9d6bf5 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:26.778594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805ae29-b687-416d-8f99-2af00f5d96c9 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:26.782736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52dafc-f288-4cd4-b03e-e9e02856f0b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:26.783432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52dafc-f288-4cd4-b03e-e9e02856f0b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:26.783718 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52dafc-f288-4cd4-b03e-e9e02856f0b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:26.783999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52dafc-f288-4cd4-b03e-e9e02856f0b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:26.785771 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6b52dafc-f288-4cd4-b03e-e9e02856f0b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:26.788017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f2721-9f92-4596-b457-eed8ba9d6bf5 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:26.792484 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5f0f1-5ed7-42a2-b90d-bb14d8a82427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:26.793347 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5f0f1-5ed7-42a2-b90d-bb14d8a82427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:26.793627 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5f0f1-5ed7-42a2-b90d-bb14d8a82427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:26.793906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5f0f1-5ed7-42a2-b90d-bb14d8a82427 admin admin] PATH_INFO: `/v3/users/de65081cfa5641cdb40a8309e8d3ca83` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:26.795123 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5f0f1-5ed7-42a2-b90d-bb14d8a82427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de65081cfa5641cdb40a8309e8d3ca83)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:26.798298 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5f0f1-5ed7-42a2-b90d-bb14d8a82427 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:26.846584 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-02f5f0f1-5ed7-42a2-b90d-bb14d8a82427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de65081cfa5641cdb40a8309e8d3ca83'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:26.853352 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-02f5f0f1-5ed7-42a2-b90d-bb14d8a82427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de65081cfa5641cdb40a8309e8d3ca83'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:26.854013 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-02f5f0f1-5ed7-42a2-b90d-bb14d8a82427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de65081cfa5641cdb40a8309e8d3ca83'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:26.857491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52dafc-f288-4cd4-b03e-e9e02856f0b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:26.859113 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52dafc-f288-4cd4-b03e-e9e02856f0b0 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:26.865689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-02f5f0f1-5ed7-42a2-b90d-bb14d8a82427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de65081cfa5641cdb40a8309e8d3ca83'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:26.868651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1260/2509] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:26.873425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-02f5f0f1-5ed7-42a2-b90d-bb14d8a82427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de65081cfa5641cdb40a8309e8d3ca83'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:26.880775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1250/2510] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:26 2022] DELETE /identity/v3/users/de65081cfa5641cdb40a8309e8d3ca83 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:27.063688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52dafc-f288-4cd4-b03e-e9e02856f0b0 service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:27.075001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52dafc-f288-4cd4-b03e-e9e02856f0b0 service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:27.134659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:27.135512 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:27.135819 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:27.136096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87 admin admin] PATH_INFO: `/v3/projects/c9bc2d80fab743f4bd1969ba804ecebf` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:27.137403 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9bc2d80fab743f4bd1969ba804ecebf)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:27.139547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:27.188554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9bc2d80fab743f4bd1969ba804ecebf', 'request_id': 'req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:27.194966 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9bc2d80fab743f4bd1969ba804ecebf', 'request_id': 'req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:27.204658 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9bc2d80fab743f4bd1969ba804ecebf', 'request_id': 'req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:27.216593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87 admin admin] The token cache is being invalidate because project c9bc2d80fab743f4bd1969ba804ecebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:27.217474 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:27.218141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:27.221242 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1261/2511] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:27 2022] DELETE /identity/v3/projects/c9bc2d80fab743f4bd1969ba804ecebf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:27.224920 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5f0f1-5ed7-42a2-b90d-bb14d8a82427 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:27.226573 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-02f5f0f1-5ed7-42a2-b90d-bb14d8a82427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:27.240048 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5f0f1-5ed7-42a2-b90d-bb14d8a82427 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:27.297236 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c1811-8f56-42ef-a19f-cc964c8bcade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:27.298021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c1811-8f56-42ef-a19f-cc964c8bcade admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:27.298344 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c1811-8f56-42ef-a19f-cc964c8bcade admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:27.298621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c1811-8f56-42ef-a19f-cc964c8bcade admin admin] PATH_INFO: `/v3/users/0bbfc0b8d96d4787a5edb9cdddcb83c2` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:27.299810 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c1811-8f56-42ef-a19f-cc964c8bcade admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bbfc0b8d96d4787a5edb9cdddcb83c2)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:27.301748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c1811-8f56-42ef-a19f-cc964c8bcade admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:27.348635 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a54c1811-8f56-42ef-a19f-cc964c8bcade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bbfc0b8d96d4787a5edb9cdddcb83c2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:27.355312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a54c1811-8f56-42ef-a19f-cc964c8bcade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bbfc0b8d96d4787a5edb9cdddcb83c2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:27.355978 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a54c1811-8f56-42ef-a19f-cc964c8bcade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bbfc0b8d96d4787a5edb9cdddcb83c2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:27.367706 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a54c1811-8f56-42ef-a19f-cc964c8bcade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bbfc0b8d96d4787a5edb9cdddcb83c2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:27.375174 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a54c1811-8f56-42ef-a19f-cc964c8bcade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bbfc0b8d96d4787a5edb9cdddcb83c2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:27.381059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1251/2512] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:27 2022] DELETE /identity/v3/users/0bbfc0b8d96d4787a5edb9cdddcb83c2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:27.553543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:27.555009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:27.568017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8bf76-be80-42c8-9ca2-5bded80a3d87 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:27.625554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9606db-fcb7-4dce-ab36-7893faaf4511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:27.626453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9606db-fcb7-4dce-ab36-7893faaf4511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:27.626737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9606db-fcb7-4dce-ab36-7893faaf4511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:27.627012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9606db-fcb7-4dce-ab36-7893faaf4511 admin admin] PATH_INFO: `/v3/projects/18cc9c9247c84f40bd8da81591cce864` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:27.628199 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9606db-fcb7-4dce-ab36-7893faaf4511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18cc9c9247c84f40bd8da81591cce864)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:27.630127 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9606db-fcb7-4dce-ab36-7893faaf4511 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:27.676058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-8d9606db-fcb7-4dce-ab36-7893faaf4511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18cc9c9247c84f40bd8da81591cce864', 'request_id': 'req-8d9606db-fcb7-4dce-ab36-7893faaf4511'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:27.681894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-8d9606db-fcb7-4dce-ab36-7893faaf4511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18cc9c9247c84f40bd8da81591cce864', 'request_id': 'req-8d9606db-fcb7-4dce-ab36-7893faaf4511'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:27.689416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-8d9606db-fcb7-4dce-ab36-7893faaf4511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18cc9c9247c84f40bd8da81591cce864', 'request_id': 'req-8d9606db-fcb7-4dce-ab36-7893faaf4511'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:27.699918 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-8d9606db-fcb7-4dce-ab36-7893faaf4511 admin admin] The token cache is being invalidate because project 18cc9c9247c84f40bd8da81591cce864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:27.700204 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-8d9606db-fcb7-4dce-ab36-7893faaf4511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:27.700832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-8d9606db-fcb7-4dce-ab36-7893faaf4511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:27.702431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1262/2513] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:27 2022] DELETE /identity/v3/projects/18cc9c9247c84f40bd8da81591cce864 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:27.708128 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68668d69-2771-4346-a37b-2c455659a0ce None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:27.708419 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68668d69-2771-4346-a37b-2c455659a0ce None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:27.708693 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68668d69-2771-4346-a37b-2c455659a0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:27.727225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-68668d69-2771-4346-a37b-2c455659a0ce None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:27.728414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-68668d69-2771-4346-a37b-2c455659a0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:27.785618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1252/2514] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:27.794748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d09ea-fdde-4841-bb9e-5a3a79018ad2 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:27.795299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d09ea-fdde-4841-bb9e-5a3a79018ad2 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:27.795299 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d09ea-fdde-4841-bb9e-5a3a79018ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:27.814089 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-4c4d09ea-fdde-4841-bb9e-5a3a79018ad2 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:27.815246 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-4c4d09ea-fdde-4841-bb9e-5a3a79018ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:27.823547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1263/2515] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:27.827858 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68668d69-2771-4346-a37b-2c455659a0ce None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:27.838101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68668d69-2771-4346-a37b-2c455659a0ce None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:27.842940 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acbafa-1dbc-418f-ae2f-66bb39ba718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:27.843616 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acbafa-1dbc-418f-ae2f-66bb39ba718c admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:27.843891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acbafa-1dbc-418f-ae2f-66bb39ba718c admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:27.844164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acbafa-1dbc-418f-ae2f-66bb39ba718c admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:27.844875 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acbafa-1dbc-418f-ae2f-66bb39ba718c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:41:27.845179 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acbafa-1dbc-418f-ae2f-66bb39ba718c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:27.846810 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acbafa-1dbc-418f-ae2f-66bb39ba718c admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:27.858378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1253/2516] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:41:27.862625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d09ea-fdde-4841-bb9e-5a3a79018ad2 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:27.871773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d09ea-fdde-4841-bb9e-5a3a79018ad2 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:27.876980 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496f6a5-223c-4c42-b429-7e83bea50def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:27.877620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496f6a5-223c-4c42-b429-7e83bea50def admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:27.877901 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496f6a5-223c-4c42-b429-7e83bea50def admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:27.878204 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496f6a5-223c-4c42-b429-7e83bea50def admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:27.878887 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496f6a5-223c-4c42-b429-7e83bea50def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:27.880833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496f6a5-223c-4c42-b429-7e83bea50def admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:27.906260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1264/2517] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:27 2022] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:27.909899 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acbafa-1dbc-418f-ae2f-66bb39ba718c admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:27.919628 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acbafa-1dbc-418f-ae2f-66bb39ba718c admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:27.975105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd52c9-7bc1-4ac2-be5b-bd71d99a555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:27.975763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd52c9-7bc1-4ac2-be5b-bd71d99a555f admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:27.976047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd52c9-7bc1-4ac2-be5b-bd71d99a555f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:27.976323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd52c9-7bc1-4ac2-be5b-bd71d99a555f admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:27.977010 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd52c9-7bc1-4ac2-be5b-bd71d99a555f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:27.979029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd52c9-7bc1-4ac2-be5b-bd71d99a555f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:27.998614 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1254/2518] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:27 2022] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:41:28.003464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496f6a5-223c-4c42-b429-7e83bea50def admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:28.014111 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496f6a5-223c-4c42-b429-7e83bea50def admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:28.018779 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10590c-0215-48c3-bcda-c7cfe4e6f4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:28.019428 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10590c-0215-48c3-bcda-c7cfe4e6f4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:28.019707 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10590c-0215-48c3-bcda-c7cfe4e6f4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:28.019977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10590c-0215-48c3-bcda-c7cfe4e6f4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:28.020690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10590c-0215-48c3-bcda-c7cfe4e6f4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:28.022305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10590c-0215-48c3-bcda-c7cfe4e6f4d9 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:28.032518 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1265/2519] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:28.037006 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd52c9-7bc1-4ac2-be5b-bd71d99a555f admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:28.047689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd52c9-7bc1-4ac2-be5b-bd71d99a555f admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:28.052373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0728b-8a24-49d4-96b4-f3e4312c68cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:28.053027 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0728b-8a24-49d4-96b4-f3e4312c68cf admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:28.053313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0728b-8a24-49d4-96b4-f3e4312c68cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:28.053593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0728b-8a24-49d4-96b4-f3e4312c68cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:28.054365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0728b-8a24-49d4-96b4-f3e4312c68cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:28.055987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0728b-8a24-49d4-96b4-f3e4312c68cf admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:28.066487 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1255/2520] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:28.070745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10590c-0215-48c3-bcda-c7cfe4e6f4d9 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:28.080907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10590c-0215-48c3-bcda-c7cfe4e6f4d9 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:28.085541 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c97e9-e84a-4b37-a329-b3b7babe76e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:28.086450 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c97e9-e84a-4b37-a329-b3b7babe76e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:28.086738 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c97e9-e84a-4b37-a329-b3b7babe76e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:28.087014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c97e9-e84a-4b37-a329-b3b7babe76e6 admin admin] PATH_INFO: `/v3/projects/9ac70e66ac1e4951af4ba1c952612baa/users/f3bca9984ccf4e23a4922a25ebf20aaa/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:28.101255 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c97e9-e84a-4b37-a329-b3b7babe76e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac70e66ac1e4951af4ba1c952612baa, user_id=f3bca9984ccf4e23a4922a25ebf20aaa, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:28.103978 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c97e9-e84a-4b37-a329-b3b7babe76e6 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:28.116926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1266/2521] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:28 2022] PUT /identity/v3/projects/9ac70e66ac1e4951af4ba1c952612baa/users/f3bca9984ccf4e23a4922a25ebf20aaa/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:28.128133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6aded-55f7-43ec-a96d-e22a60bbbaff None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:28.128524 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6aded-55f7-43ec-a96d-e22a60bbbaff None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:28.128906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6aded-55f7-43ec-a96d-e22a60bbbaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:28.154741 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-40c6aded-55f7-43ec-a96d-e22a60bbbaff None None] MFA Rules not processed for user `f3bca9984ccf4e23a4922a25ebf20aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:28.156060 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-40c6aded-55f7-43ec-a96d-e22a60bbbaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:28.219273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1256/2522] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:28.223998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c97e9-e84a-4b37-a329-b3b7babe76e6 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:28.285485 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c97e9-e84a-4b37-a329-b3b7babe76e6 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:28.290032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ab79b-4111-4cb0-8914-efb3c8e0bf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:28.290711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ab79b-4111-4cb0-8914-efb3c8e0bf9d admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:28.290990 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ab79b-4111-4cb0-8914-efb3c8e0bf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:28.291262 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ab79b-4111-4cb0-8914-efb3c8e0bf9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:28.291939 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ab79b-4111-4cb0-8914-efb3c8e0bf9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:28.293828 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ab79b-4111-4cb0-8914-efb3c8e0bf9d admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:28.318581 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1267/2523] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:28 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:28.323023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6aded-55f7-43ec-a96d-e22a60bbbaff None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:28.335265 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6aded-55f7-43ec-a96d-e22a60bbbaff None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:28.392182 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996b901-cd24-4157-a7c2-a24be3c0c859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:28.393047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996b901-cd24-4157-a7c2-a24be3c0c859 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:28.393342 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996b901-cd24-4157-a7c2-a24be3c0c859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:28.393936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996b901-cd24-4157-a7c2-a24be3c0c859 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:28.394342 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996b901-cd24-4157-a7c2-a24be3c0c859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:28.396298 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996b901-cd24-4157-a7c2-a24be3c0c859 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:28.416011 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1257/2524] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:28 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:41:28.419962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ab79b-4111-4cb0-8914-efb3c8e0bf9d admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:28.430131 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ab79b-4111-4cb0-8914-efb3c8e0bf9d admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:28.434693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6e17b-3229-4f38-899d-9882bf551bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:28.435362 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6e17b-3229-4f38-899d-9882bf551bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:28.435640 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6e17b-3229-4f38-899d-9882bf551bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:28.435912 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6e17b-3229-4f38-899d-9882bf551bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:28.436627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6e17b-3229-4f38-899d-9882bf551bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:28.439026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6e17b-3229-4f38-899d-9882bf551bb8 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:28.449356 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1268/2525] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:28.453603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996b901-cd24-4157-a7c2-a24be3c0c859 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:28.463457 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996b901-cd24-4157-a7c2-a24be3c0c859 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:28.468060 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e8247-1d14-4b17-ae11-a55cde2cdc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:28.469426 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e8247-1d14-4b17-ae11-a55cde2cdc9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:28.469710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e8247-1d14-4b17-ae11-a55cde2cdc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:28.470021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e8247-1d14-4b17-ae11-a55cde2cdc9f admin admin] PATH_INFO: `/v3/projects/407c029739c043159c66fd65adc27050/users/af51647277a04aedaddbcce553f9da3b/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:28.486290 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e8247-1d14-4b17-ae11-a55cde2cdc9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=407c029739c043159c66fd65adc27050, user_id=af51647277a04aedaddbcce553f9da3b, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:28.489052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e8247-1d14-4b17-ae11-a55cde2cdc9f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:28.501462 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1258/2526] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:28 2022] PUT /identity/v3/projects/407c029739c043159c66fd65adc27050/users/af51647277a04aedaddbcce553f9da3b/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:41:28.505307 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6e17b-3229-4f38-899d-9882bf551bb8 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:28.515769 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6e17b-3229-4f38-899d-9882bf551bb8 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:28.572853 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311929df-14e1-41fa-a956-885d9197af4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:28.573442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311929df-14e1-41fa-a956-885d9197af4c admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:28.573728 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311929df-14e1-41fa-a956-885d9197af4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:28.574007 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311929df-14e1-41fa-a956-885d9197af4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:28.574770 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311929df-14e1-41fa-a956-885d9197af4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:28.576381 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311929df-14e1-41fa-a956-885d9197af4c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:28.585815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1269/2527] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:28.589929 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e8247-1d14-4b17-ae11-a55cde2cdc9f admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:28.600668 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e8247-1d14-4b17-ae11-a55cde2cdc9f admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:28.605312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50165c-a5ff-4928-87da-2f1c5f5281fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:28.606194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50165c-a5ff-4928-87da-2f1c5f5281fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:28.606505 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50165c-a5ff-4928-87da-2f1c5f5281fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:28.606782 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50165c-a5ff-4928-87da-2f1c5f5281fb admin admin] PATH_INFO: `/v3/projects/407c029739c043159c66fd65adc27050/users/af51647277a04aedaddbcce553f9da3b/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:28.608747 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50165c-a5ff-4928-87da-2f1c5f5281fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=407c029739c043159c66fd65adc27050, user_id=af51647277a04aedaddbcce553f9da3b, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:28.612133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50165c-a5ff-4928-87da-2f1c5f5281fb admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:28.622557 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1259/2528] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:28 2022] PUT /identity/v3/projects/407c029739c043159c66fd65adc27050/users/af51647277a04aedaddbcce553f9da3b/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:28.633528 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad804a-a22b-485c-96c5-b0b1a078bf23 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:28.633818 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad804a-a22b-485c-96c5-b0b1a078bf23 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:28.634102 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad804a-a22b-485c-96c5-b0b1a078bf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:28.662027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-2aad804a-a22b-485c-96c5-b0b1a078bf23 None None] MFA Rules not processed for user `af51647277a04aedaddbcce553f9da3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:28.663270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2aad804a-a22b-485c-96c5-b0b1a078bf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:28.730580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1270/2529] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:28.741365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50165c-a5ff-4928-87da-2f1c5f5281fb admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:28.743105 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7e50165c-a5ff-4928-87da-2f1c5f5281fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:28.798396 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50165c-a5ff-4928-87da-2f1c5f5281fb admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:28.801957 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dda0ba-b03e-454e-b344-323b48bce558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:28.802620 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dda0ba-b03e-454e-b344-323b48bce558 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:28.802895 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dda0ba-b03e-454e-b344-323b48bce558 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:28.803166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dda0ba-b03e-454e-b344-323b48bce558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:28.811816 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dda0ba-b03e-454e-b344-323b48bce558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:28.813556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dda0ba-b03e-454e-b344-323b48bce558 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:28.823047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1260/2530] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:30.109098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad804a-a22b-485c-96c5-b0b1a078bf23 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:30.169262 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad804a-a22b-485c-96c5-b0b1a078bf23 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:30.173999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ac326-df56-469c-bb51-6d77694c5333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:30.174887 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ac326-df56-469c-bb51-6d77694c5333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:30.175168 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ac326-df56-469c-bb51-6d77694c5333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:30.175442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ac326-df56-469c-bb51-6d77694c5333 admin admin] PATH_INFO: `/v3/users/f3bca9984ccf4e23a4922a25ebf20aaa` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:30.176638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ac326-df56-469c-bb51-6d77694c5333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bca9984ccf4e23a4922a25ebf20aaa)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:30.178596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ac326-df56-469c-bb51-6d77694c5333 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:30.223871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9f3ac326-df56-469c-bb51-6d77694c5333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bca9984ccf4e23a4922a25ebf20aaa'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:30.231558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9f3ac326-df56-469c-bb51-6d77694c5333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bca9984ccf4e23a4922a25ebf20aaa'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:30.232202 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9f3ac326-df56-469c-bb51-6d77694c5333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bca9984ccf4e23a4922a25ebf20aaa'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:30.244330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9f3ac326-df56-469c-bb51-6d77694c5333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bca9984ccf4e23a4922a25ebf20aaa'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:30.251823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9f3ac326-df56-469c-bb51-6d77694c5333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bca9984ccf4e23a4922a25ebf20aaa'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:30.257804 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1271/2531] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:30 2022] DELETE /identity/v3/users/f3bca9984ccf4e23a4922a25ebf20aaa => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:30.262324 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a18299-ee99-4c14-a99c-dba14a70c07b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:30.262792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a18299-ee99-4c14-a99c-dba14a70c07b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:30.262890 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a18299-ee99-4c14-a99c-dba14a70c07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:30.280011 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-51a18299-ee99-4c14-a99c-dba14a70c07b None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:30.281414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-51a18299-ee99-4c14-a99c-dba14a70c07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:30.341902 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1261/2532] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:30.351751 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ac326-df56-469c-bb51-6d77694c5333 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:30.353198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-9f3ac326-df56-469c-bb51-6d77694c5333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:30.409715 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ac326-df56-469c-bb51-6d77694c5333 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:30.413598 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff32fc3-69ce-43c6-a093-94fd976ae15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:30.414298 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff32fc3-69ce-43c6-a093-94fd976ae15f service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:30.414583 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff32fc3-69ce-43c6-a093-94fd976ae15f service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:30.414856 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff32fc3-69ce-43c6-a093-94fd976ae15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:30.424607 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff32fc3-69ce-43c6-a093-94fd976ae15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:30.426042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff32fc3-69ce-43c6-a093-94fd976ae15f service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:30.435462 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1272/2533] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:30.696000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a18299-ee99-4c14-a99c-dba14a70c07b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:30.698572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-51a18299-ee99-4c14-a99c-dba14a70c07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:30.711556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a18299-ee99-4c14-a99c-dba14a70c07b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:30.716650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78858c67-9b9a-4bb8-b835-2137bdc89c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:30.717588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78858c67-9b9a-4bb8-b835-2137bdc89c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:30.717939 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78858c67-9b9a-4bb8-b835-2137bdc89c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:30.718460 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78858c67-9b9a-4bb8-b835-2137bdc89c35 admin admin] PATH_INFO: `/v3/projects/9ac70e66ac1e4951af4ba1c952612baa` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:30.719977 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78858c67-9b9a-4bb8-b835-2137bdc89c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac70e66ac1e4951af4ba1c952612baa)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:30.722220 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78858c67-9b9a-4bb8-b835-2137bdc89c35 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:30.769120 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-78858c67-9b9a-4bb8-b835-2137bdc89c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac70e66ac1e4951af4ba1c952612baa', 'request_id': 'req-78858c67-9b9a-4bb8-b835-2137bdc89c35'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:30.775165 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-78858c67-9b9a-4bb8-b835-2137bdc89c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac70e66ac1e4951af4ba1c952612baa', 'request_id': 'req-78858c67-9b9a-4bb8-b835-2137bdc89c35'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:30.782480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-78858c67-9b9a-4bb8-b835-2137bdc89c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac70e66ac1e4951af4ba1c952612baa', 'request_id': 'req-78858c67-9b9a-4bb8-b835-2137bdc89c35'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:30.792318 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-78858c67-9b9a-4bb8-b835-2137bdc89c35 admin admin] The token cache is being invalidate because project 9ac70e66ac1e4951af4ba1c952612baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:30.792604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-78858c67-9b9a-4bb8-b835-2137bdc89c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:30.793211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-78858c67-9b9a-4bb8-b835-2137bdc89c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:30.794753 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1262/2534] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:30 2022] DELETE /identity/v3/projects/9ac70e66ac1e4951af4ba1c952612baa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:41:30.798877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff32fc3-69ce-43c6-a093-94fd976ae15f service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:30.808351 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff32fc3-69ce-43c6-a093-94fd976ae15f service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:30.863375 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7000c4-a190-455e-9f83-9eae0b68c123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:30.864233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7000c4-a190-455e-9f83-9eae0b68c123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:30.864517 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7000c4-a190-455e-9f83-9eae0b68c123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:30.864795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7000c4-a190-455e-9f83-9eae0b68c123 admin admin] PATH_INFO: `/v3/users/af51647277a04aedaddbcce553f9da3b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:30.865984 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7000c4-a190-455e-9f83-9eae0b68c123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af51647277a04aedaddbcce553f9da3b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:30.867949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7000c4-a190-455e-9f83-9eae0b68c123 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:30.913960 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9d7000c4-a190-455e-9f83-9eae0b68c123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af51647277a04aedaddbcce553f9da3b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:30.920495 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9d7000c4-a190-455e-9f83-9eae0b68c123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af51647277a04aedaddbcce553f9da3b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:30.921388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9d7000c4-a190-455e-9f83-9eae0b68c123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af51647277a04aedaddbcce553f9da3b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:30.932732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9d7000c4-a190-455e-9f83-9eae0b68c123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af51647277a04aedaddbcce553f9da3b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:30.939919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9d7000c4-a190-455e-9f83-9eae0b68c123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af51647277a04aedaddbcce553f9da3b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:30.945640 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1273/2535] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:30 2022] DELETE /identity/v3/users/af51647277a04aedaddbcce553f9da3b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:41:31.211000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78858c67-9b9a-4bb8-b835-2137bdc89c35 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:31.212737 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-78858c67-9b9a-4bb8-b835-2137bdc89c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:31.226859 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78858c67-9b9a-4bb8-b835-2137bdc89c35 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:31.284960 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c185e48-e37e-447f-bada-f8cc87b4770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:31.285814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c185e48-e37e-447f-bada-f8cc87b4770f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:31.286093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c185e48-e37e-447f-bada-f8cc87b4770f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:31.286393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c185e48-e37e-447f-bada-f8cc87b4770f admin admin] PATH_INFO: `/v3/projects/407c029739c043159c66fd65adc27050` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:31.287556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c185e48-e37e-447f-bada-f8cc87b4770f admin admin] RBAC: Authorizing `identity:delete_project(project_id=407c029739c043159c66fd65adc27050)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:31.289462 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c185e48-e37e-447f-bada-f8cc87b4770f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:31.334752 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8c185e48-e37e-447f-bada-f8cc87b4770f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407c029739c043159c66fd65adc27050', 'request_id': 'req-8c185e48-e37e-447f-bada-f8cc87b4770f'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:31.341216 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8c185e48-e37e-447f-bada-f8cc87b4770f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407c029739c043159c66fd65adc27050', 'request_id': 'req-8c185e48-e37e-447f-bada-f8cc87b4770f'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:31.349387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8c185e48-e37e-447f-bada-f8cc87b4770f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407c029739c043159c66fd65adc27050', 'request_id': 'req-8c185e48-e37e-447f-bada-f8cc87b4770f'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:31.359560 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8c185e48-e37e-447f-bada-f8cc87b4770f admin admin] The token cache is being invalidate because project 407c029739c043159c66fd65adc27050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:31.359843 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8c185e48-e37e-447f-bada-f8cc87b4770f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:31.360981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8c185e48-e37e-447f-bada-f8cc87b4770f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:31.362548 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1263/2536] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:31 2022] DELETE /identity/v3/projects/407c029739c043159c66fd65adc27050 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:31.367482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9492e48-8fa1-4834-8416-80ba55791ab0 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:31.367950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9492e48-8fa1-4834-8416-80ba55791ab0 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:31.368045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9492e48-8fa1-4834-8416-80ba55791ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:31.386981 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-b9492e48-8fa1-4834-8416-80ba55791ab0 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:31.388176 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b9492e48-8fa1-4834-8416-80ba55791ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:31.445727 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1274/2537] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:31.453791 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2488e-7b96-4542-8d90-5ed0c8372253 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:31.454018 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2488e-7b96-4542-8d90-5ed0c8372253 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:31.454353 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2488e-7b96-4542-8d90-5ed0c8372253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:31.472573 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-e0f2488e-7b96-4542-8d90-5ed0c8372253 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:31.473748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e0f2488e-7b96-4542-8d90-5ed0c8372253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:31.481453 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1264/2538] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:41:31.486146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9492e48-8fa1-4834-8416-80ba55791ab0 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:31.495546 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9492e48-8fa1-4834-8416-80ba55791ab0 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:31.500263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f916e-4028-4d23-a8fc-16e965f6f793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:31.500906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f916e-4028-4d23-a8fc-16e965f6f793 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:31.501186 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f916e-4028-4d23-a8fc-16e965f6f793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:31.501465 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f916e-4028-4d23-a8fc-16e965f6f793 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:31.502195 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f916e-4028-4d23-a8fc-16e965f6f793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:41:31.502517 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f916e-4028-4d23-a8fc-16e965f6f793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:31.504095 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f916e-4028-4d23-a8fc-16e965f6f793 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:31.515266 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1275/2539] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:41:31.519614 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2488e-7b96-4542-8d90-5ed0c8372253 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:31.528741 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2488e-7b96-4542-8d90-5ed0c8372253 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:31.535514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8272d-770a-47ca-8844-933cd796ae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:31.536179 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8272d-770a-47ca-8844-933cd796ae39 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:31.536472 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8272d-770a-47ca-8844-933cd796ae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:31.536753 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8272d-770a-47ca-8844-933cd796ae39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:31.537448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8272d-770a-47ca-8844-933cd796ae39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:31.539389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8272d-770a-47ca-8844-933cd796ae39 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:31.565372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1265/2540] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:31 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:41:31.569397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f916e-4028-4d23-a8fc-16e965f6f793 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:31.579531 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f916e-4028-4d23-a8fc-16e965f6f793 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:31.633530 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c90d50-ab93-45f0-bc72-ed30ef3ad32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:31.634220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c90d50-ab93-45f0-bc72-ed30ef3ad32c admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:31.634510 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c90d50-ab93-45f0-bc72-ed30ef3ad32c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:31.634843 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c90d50-ab93-45f0-bc72-ed30ef3ad32c admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:31.635529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c90d50-ab93-45f0-bc72-ed30ef3ad32c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:31.637491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c90d50-ab93-45f0-bc72-ed30ef3ad32c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:31.656666 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1276/2541] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:31 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:31.660736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8272d-770a-47ca-8844-933cd796ae39 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:31.670937 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8272d-770a-47ca-8844-933cd796ae39 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:31.676027 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c063dc7-0247-4a73-940d-875c09877cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:31.676682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c063dc7-0247-4a73-940d-875c09877cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:31.676965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c063dc7-0247-4a73-940d-875c09877cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:31.677239 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c063dc7-0247-4a73-940d-875c09877cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:31.677958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c063dc7-0247-4a73-940d-875c09877cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:31.679600 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c063dc7-0247-4a73-940d-875c09877cfe admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:31.690715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1266/2542] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:31.694671 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c90d50-ab93-45f0-bc72-ed30ef3ad32c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:31.705186 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c90d50-ab93-45f0-bc72-ed30ef3ad32c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:31.709719 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e201f2-2bbe-4219-a6b7-57659723a0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:31.710408 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e201f2-2bbe-4219-a6b7-57659723a0de admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:31.710691 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e201f2-2bbe-4219-a6b7-57659723a0de admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:31.710967 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e201f2-2bbe-4219-a6b7-57659723a0de admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:31.711687 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e201f2-2bbe-4219-a6b7-57659723a0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:31.713477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e201f2-2bbe-4219-a6b7-57659723a0de admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:31.723758 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1277/2543] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:31.728231 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c063dc7-0247-4a73-940d-875c09877cfe admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:31.738704 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c063dc7-0247-4a73-940d-875c09877cfe admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:31.743264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51356a-2e79-457f-99f2-942bc1b4689b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:31.744134 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51356a-2e79-457f-99f2-942bc1b4689b admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:31.744420 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51356a-2e79-457f-99f2-942bc1b4689b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:31.744698 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51356a-2e79-457f-99f2-942bc1b4689b admin admin] PATH_INFO: `/v3/projects/23b516e6dcb545b2b86594a0cb88595d/users/5e18cad580e64ce0be9f863046c6e4c8/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:31.759568 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51356a-2e79-457f-99f2-942bc1b4689b admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b516e6dcb545b2b86594a0cb88595d, user_id=5e18cad580e64ce0be9f863046c6e4c8, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:31.762270 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51356a-2e79-457f-99f2-942bc1b4689b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:31.775045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1267/2544] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:31 2022] PUT /identity/v3/projects/23b516e6dcb545b2b86594a0cb88595d/users/5e18cad580e64ce0be9f863046c6e4c8/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:31.784998 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2af536-b2c4-4296-b87f-09647da2db83 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:31.785310 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2af536-b2c4-4296-b87f-09647da2db83 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:31.785586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2af536-b2c4-4296-b87f-09647da2db83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:31.811366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-ac2af536-b2c4-4296-b87f-09647da2db83 None None] MFA Rules not processed for user `5e18cad580e64ce0be9f863046c6e4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:31.813484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ac2af536-b2c4-4296-b87f-09647da2db83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:31.876135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1278/2545] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:31.880598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51356a-2e79-457f-99f2-942bc1b4689b admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:31.939459 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51356a-2e79-457f-99f2-942bc1b4689b admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:31.944110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66b120-c1e0-44ba-8076-10125e5c275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:31.944755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66b120-c1e0-44ba-8076-10125e5c275a admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:31.945036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66b120-c1e0-44ba-8076-10125e5c275a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:31.945310 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66b120-c1e0-44ba-8076-10125e5c275a admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:31.945998 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66b120-c1e0-44ba-8076-10125e5c275a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:31.948191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66b120-c1e0-44ba-8076-10125e5c275a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:31.972045 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1268/2546] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:31 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:31.976018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2af536-b2c4-4296-b87f-09647da2db83 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:31.987020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2af536-b2c4-4296-b87f-09647da2db83 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:32.040666 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90027f-1701-485d-bd64-a209fe5f21ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:32.041338 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90027f-1701-485d-bd64-a209fe5f21ef admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:32.041624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90027f-1701-485d-bd64-a209fe5f21ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:32.041900 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90027f-1701-485d-bd64-a209fe5f21ef admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:32.042702 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90027f-1701-485d-bd64-a209fe5f21ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:32.044738 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90027f-1701-485d-bd64-a209fe5f21ef admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:32.064724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1279/2547] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:31 2022] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:32.068749 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66b120-c1e0-44ba-8076-10125e5c275a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:32.079253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66b120-c1e0-44ba-8076-10125e5c275a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:32.084413 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9caf0-64fe-4041-8a09-9b3d40b9b8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:32.085174 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9caf0-64fe-4041-8a09-9b3d40b9b8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:32.085530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9caf0-64fe-4041-8a09-9b3d40b9b8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:32.085888 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9caf0-64fe-4041-8a09-9b3d40b9b8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:32.086728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9caf0-64fe-4041-8a09-9b3d40b9b8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:32.089301 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9caf0-64fe-4041-8a09-9b3d40b9b8d8 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:32.101838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1269/2548] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:32.106039 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90027f-1701-485d-bd64-a209fe5f21ef admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:32.117639 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90027f-1701-485d-bd64-a209fe5f21ef admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:32.122371 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f99ce9-1044-41bd-8fe1-63cb4a8f078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:32.123491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f99ce9-1044-41bd-8fe1-63cb4a8f078e admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:32.123923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f99ce9-1044-41bd-8fe1-63cb4a8f078e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:32.124235 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f99ce9-1044-41bd-8fe1-63cb4a8f078e admin admin] PATH_INFO: `/v3/projects/26686d14399d4c39b09013025e513643/users/7bf47220c26f4c958e185b8565427bea/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:32.139479 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f99ce9-1044-41bd-8fe1-63cb4a8f078e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26686d14399d4c39b09013025e513643, user_id=7bf47220c26f4c958e185b8565427bea, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:32.142220 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f99ce9-1044-41bd-8fe1-63cb4a8f078e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:32.154376 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1280/2549] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:32 2022] PUT /identity/v3/projects/26686d14399d4c39b09013025e513643/users/7bf47220c26f4c958e185b8565427bea/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:32.159042 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9caf0-64fe-4041-8a09-9b3d40b9b8d8 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:32.168768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9caf0-64fe-4041-8a09-9b3d40b9b8d8 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:32.224536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6d3bf-1905-451a-9c73-f7b559bd78df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:32.225132 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6d3bf-1905-451a-9c73-f7b559bd78df admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:32.225415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6d3bf-1905-451a-9c73-f7b559bd78df admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:32.225917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6d3bf-1905-451a-9c73-f7b559bd78df admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:32.226774 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6d3bf-1905-451a-9c73-f7b559bd78df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:32.228406 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6d3bf-1905-451a-9c73-f7b559bd78df admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:32.238780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1270/2550] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:41:32.242917 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f99ce9-1044-41bd-8fe1-63cb4a8f078e admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:32.253533 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f99ce9-1044-41bd-8fe1-63cb4a8f078e admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:32.258107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8d716-6f11-4c0b-8a01-ade93219a824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:32.259058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8d716-6f11-4c0b-8a01-ade93219a824 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:32.259338 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8d716-6f11-4c0b-8a01-ade93219a824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:32.259609 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8d716-6f11-4c0b-8a01-ade93219a824 admin admin] PATH_INFO: `/v3/projects/26686d14399d4c39b09013025e513643/users/7bf47220c26f4c958e185b8565427bea/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:32.261560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8d716-6f11-4c0b-8a01-ade93219a824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26686d14399d4c39b09013025e513643, user_id=7bf47220c26f4c958e185b8565427bea, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:32.264211 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8d716-6f11-4c0b-8a01-ade93219a824 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:32.275697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1281/2551] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:32 2022] PUT /identity/v3/projects/26686d14399d4c39b09013025e513643/users/7bf47220c26f4c958e185b8565427bea/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:32.287350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14556cb1-6982-43b9-b856-5ecd3c813195 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:32.287838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14556cb1-6982-43b9-b856-5ecd3c813195 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:32.287950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14556cb1-6982-43b9-b856-5ecd3c813195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:32.313976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-14556cb1-6982-43b9-b856-5ecd3c813195 None None] MFA Rules not processed for user `7bf47220c26f4c958e185b8565427bea`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:32.315236 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-14556cb1-6982-43b9-b856-5ecd3c813195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:32.384870 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1271/2552] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:32.401041 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8d716-6f11-4c0b-8a01-ade93219a824 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:32.403498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-b3c8d716-6f11-4c0b-8a01-ade93219a824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:32.474830 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8d716-6f11-4c0b-8a01-ade93219a824 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:32.478522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb5e82-9dab-4a14-84ca-27fcff4e1a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:32.479289 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb5e82-9dab-4a14-84ca-27fcff4e1a0b service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:32.479576 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb5e82-9dab-4a14-84ca-27fcff4e1a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:32.479854 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb5e82-9dab-4a14-84ca-27fcff4e1a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:32.490527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb5e82-9dab-4a14-84ca-27fcff4e1a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:32.492091 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb5e82-9dab-4a14-84ca-27fcff4e1a0b service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:32.503094 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1282/2553] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:32.807652 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14556cb1-6982-43b9-b856-5ecd3c813195 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:32.817005 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14556cb1-6982-43b9-b856-5ecd3c813195 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:32.821896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e01649-10e5-467b-84e2-28545175a12a tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bf47220c26f4c958e185b8565427bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26686d14399d4c39b09013025e513643', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:32.822578 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e01649-10e5-467b-84e2-28545175a12a tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:32.822868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e01649-10e5-467b-84e2-28545175a12a tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:32.823148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e01649-10e5-467b-84e2-28545175a12a tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:32.823945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e01649-10e5-467b-84e2-28545175a12a tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:41:32.824186 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e01649-10e5-467b-84e2-28545175a12a tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:32.825784 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e01649-10e5-467b-84e2-28545175a12a tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:32.837947 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1272/2554] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:41:32.842019 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb5e82-9dab-4a14-84ca-27fcff4e1a0b service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:32.851994 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb5e82-9dab-4a14-84ca-27fcff4e1a0b service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:32.856575 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec5cf7-bc05-427c-b045-b9c900d9cda6 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bf47220c26f4c958e185b8565427bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26686d14399d4c39b09013025e513643', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:32.857225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec5cf7-bc05-427c-b045-b9c900d9cda6 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:32.857512 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec5cf7-bc05-427c-b045-b9c900d9cda6 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:32.857793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec5cf7-bc05-427c-b045-b9c900d9cda6 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:32.858537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec5cf7-bc05-427c-b045-b9c900d9cda6 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:32.860467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec5cf7-bc05-427c-b045-b9c900d9cda6 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:32.885589 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1283/2555] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:32 2022] POST /identity/v3/projects => generated 355 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:32.889661 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e01649-10e5-467b-84e2-28545175a12a tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:32.900244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e01649-10e5-467b-84e2-28545175a12a tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:32.960493 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6144154-d8f5-4d13-9e2a-2fd212d3e247 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bf47220c26f4c958e185b8565427bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26686d14399d4c39b09013025e513643', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:32.961153 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6144154-d8f5-4d13-9e2a-2fd212d3e247 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:32.961436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6144154-d8f5-4d13-9e2a-2fd212d3e247 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:32.961713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6144154-d8f5-4d13-9e2a-2fd212d3e247 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:32.962454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6144154-d8f5-4d13-9e2a-2fd212d3e247 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:41:32.962761 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6144154-d8f5-4d13-9e2a-2fd212d3e247 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:32.964363 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6144154-d8f5-4d13-9e2a-2fd212d3e247 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:32.975301 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1273/2556] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:41:33.010880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec5cf7-bc05-427c-b045-b9c900d9cda6 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:33.021748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec5cf7-bc05-427c-b045-b9c900d9cda6 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:33.026432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718d3b2-6e59-477a-8180-63a4c341c22f tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bf47220c26f4c958e185b8565427bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26686d14399d4c39b09013025e513643', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:33.027276 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718d3b2-6e59-477a-8180-63a4c341c22f tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:33.027563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718d3b2-6e59-477a-8180-63a4c341c22f tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:33.027840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718d3b2-6e59-477a-8180-63a4c341c22f tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] PATH_INFO: `/v3/projects/e611d173308c417294c90fa217ffe974` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:33.029018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718d3b2-6e59-477a-8180-63a4c341c22f tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e611d173308c417294c90fa217ffe974)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:33.031074 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718d3b2-6e59-477a-8180-63a4c341c22f tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:33.075298 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e718d3b2-6e59-477a-8180-63a4c341c22f tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e611d173308c417294c90fa217ffe974', 'request_id': 'req-e718d3b2-6e59-477a-8180-63a4c341c22f'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:33.081755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e718d3b2-6e59-477a-8180-63a4c341c22f tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e611d173308c417294c90fa217ffe974', 'request_id': 'req-e718d3b2-6e59-477a-8180-63a4c341c22f'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:33.088894 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e718d3b2-6e59-477a-8180-63a4c341c22f tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e611d173308c417294c90fa217ffe974', 'request_id': 'req-e718d3b2-6e59-477a-8180-63a4c341c22f'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:33.098811 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e718d3b2-6e59-477a-8180-63a4c341c22f tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] The token cache is being invalidate because project e611d173308c417294c90fa217ffe974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:33.099097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e718d3b2-6e59-477a-8180-63a4c341c22f tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:33.099729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e718d3b2-6e59-477a-8180-63a4c341c22f tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:33.101252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1284/2557] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:33 2022] DELETE /identity/v3/projects/e611d173308c417294c90fa217ffe974 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:33.285468 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6144154-d8f5-4d13-9e2a-2fd212d3e247 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:33.287184 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c6144154-d8f5-4d13-9e2a-2fd212d3e247 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:33.350500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6144154-d8f5-4d13-9e2a-2fd212d3e247 tempest-VolumeQuotaClassesTest-840054468 tempest-VolumeQuotaClassesTest-840054468-project-admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:33.404535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30708999-f17b-4016-bb05-4d63e9f2f312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:33.405401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30708999-f17b-4016-bb05-4d63e9f2f312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:33.405778 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30708999-f17b-4016-bb05-4d63e9f2f312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:33.406263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30708999-f17b-4016-bb05-4d63e9f2f312 admin admin] PATH_INFO: `/v3/users/5e18cad580e64ce0be9f863046c6e4c8` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:33.407557 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30708999-f17b-4016-bb05-4d63e9f2f312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e18cad580e64ce0be9f863046c6e4c8)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:33.409499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30708999-f17b-4016-bb05-4d63e9f2f312 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:33.453439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-30708999-f17b-4016-bb05-4d63e9f2f312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e18cad580e64ce0be9f863046c6e4c8'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:33.460144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-30708999-f17b-4016-bb05-4d63e9f2f312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e18cad580e64ce0be9f863046c6e4c8'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:33.460838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-30708999-f17b-4016-bb05-4d63e9f2f312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e18cad580e64ce0be9f863046c6e4c8'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:33.472446 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-30708999-f17b-4016-bb05-4d63e9f2f312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e18cad580e64ce0be9f863046c6e4c8'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:33.480060 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-30708999-f17b-4016-bb05-4d63e9f2f312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e18cad580e64ce0be9f863046c6e4c8'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:33.486640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1274/2558] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:33 2022] DELETE /identity/v3/users/5e18cad580e64ce0be9f863046c6e4c8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:33.491246 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75878d8b-85d4-4d7c-938a-b4f174e93e19 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:33.491730 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75878d8b-85d4-4d7c-938a-b4f174e93e19 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:33.491868 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75878d8b-85d4-4d7c-938a-b4f174e93e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:33.510042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-75878d8b-85d4-4d7c-938a-b4f174e93e19 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:33.511294 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-75878d8b-85d4-4d7c-938a-b4f174e93e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:33.570678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1285/2559] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:33.580518 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30708999-f17b-4016-bb05-4d63e9f2f312 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:33.581959 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-30708999-f17b-4016-bb05-4d63e9f2f312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:33.644232 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30708999-f17b-4016-bb05-4d63e9f2f312 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:33.648303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128c62a-6abf-480d-aed5-3df6b2e91230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:33.648952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128c62a-6abf-480d-aed5-3df6b2e91230 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:33.649230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128c62a-6abf-480d-aed5-3df6b2e91230 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:33.649502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128c62a-6abf-480d-aed5-3df6b2e91230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:33.659471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128c62a-6abf-480d-aed5-3df6b2e91230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:33.660897 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128c62a-6abf-480d-aed5-3df6b2e91230 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:33.670480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1275/2560] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:33.981473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75878d8b-85d4-4d7c-938a-b4f174e93e19 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:33.983054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-75878d8b-85d4-4d7c-938a-b4f174e93e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:34.002152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75878d8b-85d4-4d7c-938a-b4f174e93e19 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:34.008052 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cffc5-ddc4-442f-8fdf-6dadc0750302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:34.009076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cffc5-ddc4-442f-8fdf-6dadc0750302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:34.009540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cffc5-ddc4-442f-8fdf-6dadc0750302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:34.009888 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cffc5-ddc4-442f-8fdf-6dadc0750302 admin admin] PATH_INFO: `/v3/projects/23b516e6dcb545b2b86594a0cb88595d` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:34.011253 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cffc5-ddc4-442f-8fdf-6dadc0750302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b516e6dcb545b2b86594a0cb88595d)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:34.013543 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cffc5-ddc4-442f-8fdf-6dadc0750302 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:34.063058 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e44cffc5-ddc4-442f-8fdf-6dadc0750302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b516e6dcb545b2b86594a0cb88595d', 'request_id': 'req-e44cffc5-ddc4-442f-8fdf-6dadc0750302'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:34.069175 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e44cffc5-ddc4-442f-8fdf-6dadc0750302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b516e6dcb545b2b86594a0cb88595d', 'request_id': 'req-e44cffc5-ddc4-442f-8fdf-6dadc0750302'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:34.076808 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e44cffc5-ddc4-442f-8fdf-6dadc0750302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b516e6dcb545b2b86594a0cb88595d', 'request_id': 'req-e44cffc5-ddc4-442f-8fdf-6dadc0750302'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:34.087839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e44cffc5-ddc4-442f-8fdf-6dadc0750302 admin admin] The token cache is being invalidate because project 23b516e6dcb545b2b86594a0cb88595d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:34.088124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e44cffc5-ddc4-442f-8fdf-6dadc0750302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:34.088750 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e44cffc5-ddc4-442f-8fdf-6dadc0750302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:34.090510 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1286/2561] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:33 2022] DELETE /identity/v3/projects/23b516e6dcb545b2b86594a0cb88595d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:34.094759 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128c62a-6abf-480d-aed5-3df6b2e91230 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:34.103935 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128c62a-6abf-480d-aed5-3df6b2e91230 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:34.159678 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ca123-84a7-4ee7-a212-a67eff09ba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:34.160563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ca123-84a7-4ee7-a212-a67eff09ba2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:34.160849 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ca123-84a7-4ee7-a212-a67eff09ba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:34.161126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ca123-84a7-4ee7-a212-a67eff09ba2b admin admin] PATH_INFO: `/v3/users/7bf47220c26f4c958e185b8565427bea` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:34.162371 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ca123-84a7-4ee7-a212-a67eff09ba2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf47220c26f4c958e185b8565427bea)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:34.164325 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ca123-84a7-4ee7-a212-a67eff09ba2b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:34.211071 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-694ca123-84a7-4ee7-a212-a67eff09ba2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf47220c26f4c958e185b8565427bea'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:34.217790 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-694ca123-84a7-4ee7-a212-a67eff09ba2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf47220c26f4c958e185b8565427bea'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:34.218743 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-694ca123-84a7-4ee7-a212-a67eff09ba2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf47220c26f4c958e185b8565427bea'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:34.230801 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-694ca123-84a7-4ee7-a212-a67eff09ba2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf47220c26f4c958e185b8565427bea'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:34.238476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-694ca123-84a7-4ee7-a212-a67eff09ba2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf47220c26f4c958e185b8565427bea'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:34.244673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1276/2562] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:34 2022] DELETE /identity/v3/users/7bf47220c26f4c958e185b8565427bea => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:34.513282 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cffc5-ddc4-442f-8fdf-6dadc0750302 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:34.514881 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e44cffc5-ddc4-442f-8fdf-6dadc0750302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:34.527971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cffc5-ddc4-442f-8fdf-6dadc0750302 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:34.585234 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedb52b-5803-4e33-96ad-20e56a9a7b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:34.586089 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedb52b-5803-4e33-96ad-20e56a9a7b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:34.586407 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedb52b-5803-4e33-96ad-20e56a9a7b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:34.586690 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedb52b-5803-4e33-96ad-20e56a9a7b8f admin admin] PATH_INFO: `/v3/projects/26686d14399d4c39b09013025e513643` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:34.587869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedb52b-5803-4e33-96ad-20e56a9a7b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=26686d14399d4c39b09013025e513643)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:34.589793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedb52b-5803-4e33-96ad-20e56a9a7b8f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:34.634684 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9eedb52b-5803-4e33-96ad-20e56a9a7b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26686d14399d4c39b09013025e513643', 'request_id': 'req-9eedb52b-5803-4e33-96ad-20e56a9a7b8f'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:34.641393 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9eedb52b-5803-4e33-96ad-20e56a9a7b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26686d14399d4c39b09013025e513643', 'request_id': 'req-9eedb52b-5803-4e33-96ad-20e56a9a7b8f'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:34.647720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9eedb52b-5803-4e33-96ad-20e56a9a7b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26686d14399d4c39b09013025e513643', 'request_id': 'req-9eedb52b-5803-4e33-96ad-20e56a9a7b8f'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:34.658075 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9eedb52b-5803-4e33-96ad-20e56a9a7b8f admin admin] The token cache is being invalidate because project 26686d14399d4c39b09013025e513643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:34.658394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9eedb52b-5803-4e33-96ad-20e56a9a7b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:34.659099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-9eedb52b-5803-4e33-96ad-20e56a9a7b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:34.660625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1287/2563] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:34 2022] DELETE /identity/v3/projects/26686d14399d4c39b09013025e513643 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:34.665545 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5b9fc-da7e-45d3-ad30-e78502d89b95 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:34.666008 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5b9fc-da7e-45d3-ad30-e78502d89b95 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:34.666102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5b9fc-da7e-45d3-ad30-e78502d89b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:34.684687 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-eff5b9fc-da7e-45d3-ad30-e78502d89b95 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:34.685883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-eff5b9fc-da7e-45d3-ad30-e78502d89b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:34.745503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1277/2564] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:34.753221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccbc6a-d2f0-447a-b999-43dd5c763681 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:34.753508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccbc6a-d2f0-447a-b999-43dd5c763681 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:34.753785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccbc6a-d2f0-447a-b999-43dd5c763681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:34.772173 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-3cccbc6a-d2f0-447a-b999-43dd5c763681 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:34.773355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-3cccbc6a-d2f0-447a-b999-43dd5c763681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:34.781405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1288/2565] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:34.785454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5b9fc-da7e-45d3-ad30-e78502d89b95 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:34.794873 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5b9fc-da7e-45d3-ad30-e78502d89b95 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:34.800477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e16b8-1f10-4daa-ad10-3d87afc2ea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:34.800876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e16b8-1f10-4daa-ad10-3d87afc2ea8f admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:34.801183 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e16b8-1f10-4daa-ad10-3d87afc2ea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:34.801482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e16b8-1f10-4daa-ad10-3d87afc2ea8f admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:34.802218 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e16b8-1f10-4daa-ad10-3d87afc2ea8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:41:34.802530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e16b8-1f10-4daa-ad10-3d87afc2ea8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:34.804130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e16b8-1f10-4daa-ad10-3d87afc2ea8f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:34.816977 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1278/2566] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:41:34.824055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccbc6a-d2f0-447a-b999-43dd5c763681 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:34.833309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccbc6a-d2f0-447a-b999-43dd5c763681 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:34.837968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174165d-4a92-4f11-81ff-58a7fe9f09f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:34.838643 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174165d-4a92-4f11-81ff-58a7fe9f09f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:34.838921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174165d-4a92-4f11-81ff-58a7fe9f09f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:34.839197 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174165d-4a92-4f11-81ff-58a7fe9f09f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:34.839892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174165d-4a92-4f11-81ff-58a7fe9f09f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:34.841809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174165d-4a92-4f11-81ff-58a7fe9f09f6 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:34.866121 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1289/2567] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:34 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:34.870251 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e16b8-1f10-4daa-ad10-3d87afc2ea8f admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:34.880996 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e16b8-1f10-4daa-ad10-3d87afc2ea8f admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:34.936977 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d50411-eb95-4e48-9726-07138923aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:34.938258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d50411-eb95-4e48-9726-07138923aa44 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:34.938546 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d50411-eb95-4e48-9726-07138923aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:34.938823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d50411-eb95-4e48-9726-07138923aa44 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:34.939553 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d50411-eb95-4e48-9726-07138923aa44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:34.941482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d50411-eb95-4e48-9726-07138923aa44 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:34.961923 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1279/2568] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:34 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:41:34.966143 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174165d-4a92-4f11-81ff-58a7fe9f09f6 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:34.977334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174165d-4a92-4f11-81ff-58a7fe9f09f6 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:34.982022 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae744853-56ba-4f8e-8b08-1e176defbc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:34.982724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae744853-56ba-4f8e-8b08-1e176defbc18 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:34.983033 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae744853-56ba-4f8e-8b08-1e176defbc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:34.983313 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae744853-56ba-4f8e-8b08-1e176defbc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:34.984535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae744853-56ba-4f8e-8b08-1e176defbc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:34.986213 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae744853-56ba-4f8e-8b08-1e176defbc18 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:34.997216 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1290/2569] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:41:35.001959 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d50411-eb95-4e48-9726-07138923aa44 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:35.011815 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d50411-eb95-4e48-9726-07138923aa44 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:35.016915 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9bed6-6867-4131-bae1-3f4428e1d9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:35.017590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9bed6-6867-4131-bae1-3f4428e1d9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:35.017879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9bed6-6867-4131-bae1-3f4428e1d9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:35.018160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9bed6-6867-4131-bae1-3f4428e1d9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:35.018909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9bed6-6867-4131-bae1-3f4428e1d9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:35.020575 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9bed6-6867-4131-bae1-3f4428e1d9d6 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:35.030819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1280/2570] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:35.034900 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae744853-56ba-4f8e-8b08-1e176defbc18 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:35.044764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae744853-56ba-4f8e-8b08-1e176defbc18 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:35.050050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b3944-b421-4409-8ed0-1aa02ac3befc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:35.050944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b3944-b421-4409-8ed0-1aa02ac3befc admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:35.051224 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b3944-b421-4409-8ed0-1aa02ac3befc admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:35.051530 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b3944-b421-4409-8ed0-1aa02ac3befc admin admin] PATH_INFO: `/v3/projects/dd3410e7b42942e09dd59bb0fdd1a3e2/users/419aa4237b42434ba556c678a8cfaa5d/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:35.066613 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b3944-b421-4409-8ed0-1aa02ac3befc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3410e7b42942e09dd59bb0fdd1a3e2, user_id=419aa4237b42434ba556c678a8cfaa5d, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:35.069273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b3944-b421-4409-8ed0-1aa02ac3befc admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:35.082328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1291/2571] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:35 2022] PUT /identity/v3/projects/dd3410e7b42942e09dd59bb0fdd1a3e2/users/419aa4237b42434ba556c678a8cfaa5d/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:35.092425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ce577-6138-4f73-b7ad-9d3ff1434f89 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:35.092720 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ce577-6138-4f73-b7ad-9d3ff1434f89 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:35.093533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ce577-6138-4f73-b7ad-9d3ff1434f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:35.120273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-233ce577-6138-4f73-b7ad-9d3ff1434f89 None None] MFA Rules not processed for user `419aa4237b42434ba556c678a8cfaa5d`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:35.121748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-233ce577-6138-4f73-b7ad-9d3ff1434f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:35.183898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1281/2572] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:35.188518 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b3944-b421-4409-8ed0-1aa02ac3befc admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:35.248645 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b3944-b421-4409-8ed0-1aa02ac3befc admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:35.253411 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e39da8-dcb2-4ba1-9006-c2fe7f352567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:35.254070 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e39da8-dcb2-4ba1-9006-c2fe7f352567 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:35.254384 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e39da8-dcb2-4ba1-9006-c2fe7f352567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:35.254662 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e39da8-dcb2-4ba1-9006-c2fe7f352567 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:35.255350 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e39da8-dcb2-4ba1-9006-c2fe7f352567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:35.257282 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e39da8-dcb2-4ba1-9006-c2fe7f352567 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:35.281808 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1292/2573] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:35 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:35.285891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ce577-6138-4f73-b7ad-9d3ff1434f89 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:35.297366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ce577-6138-4f73-b7ad-9d3ff1434f89 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:35.352883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446ba47-865b-45e3-9689-1a13b24d15af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:35.353543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446ba47-865b-45e3-9689-1a13b24d15af admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:35.353824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446ba47-865b-45e3-9689-1a13b24d15af admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:35.354099 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446ba47-865b-45e3-9689-1a13b24d15af admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:35.354811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446ba47-865b-45e3-9689-1a13b24d15af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:35.356717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446ba47-865b-45e3-9689-1a13b24d15af admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:35.376147 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1282/2574] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:35 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:35.380060 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e39da8-dcb2-4ba1-9006-c2fe7f352567 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:35.390242 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e39da8-dcb2-4ba1-9006-c2fe7f352567 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:35.394871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678966c7-ef2c-4d80-a320-5640edb67dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:35.395525 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678966c7-ef2c-4d80-a320-5640edb67dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:35.395809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678966c7-ef2c-4d80-a320-5640edb67dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:35.396086 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678966c7-ef2c-4d80-a320-5640edb67dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:35.396814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678966c7-ef2c-4d80-a320-5640edb67dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:35.398458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678966c7-ef2c-4d80-a320-5640edb67dc2 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:35.410452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1293/2575] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:35.414385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446ba47-865b-45e3-9689-1a13b24d15af admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:35.426009 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446ba47-865b-45e3-9689-1a13b24d15af admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:35.431192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba85cfe-d9d7-42b3-a23d-1ee9809863d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:35.431876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba85cfe-d9d7-42b3-a23d-1ee9809863d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:35.432161 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba85cfe-d9d7-42b3-a23d-1ee9809863d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:35.432467 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba85cfe-d9d7-42b3-a23d-1ee9809863d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:35.433198 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba85cfe-d9d7-42b3-a23d-1ee9809863d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:35.434925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba85cfe-d9d7-42b3-a23d-1ee9809863d9 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:35.445579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1283/2576] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:35.449859 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678966c7-ef2c-4d80-a320-5640edb67dc2 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:35.460585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678966c7-ef2c-4d80-a320-5640edb67dc2 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:35.465255 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0101f-5f97-4d8f-bf56-ea405162de1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:35.466124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0101f-5f97-4d8f-bf56-ea405162de1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:35.466435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0101f-5f97-4d8f-bf56-ea405162de1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:35.466719 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0101f-5f97-4d8f-bf56-ea405162de1d admin admin] PATH_INFO: `/v3/projects/1b6216b230034f2b89d34b2984c4b89e/users/7c111fd8462b42729755c2c5518ef37b/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:35.482554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0101f-5f97-4d8f-bf56-ea405162de1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6216b230034f2b89d34b2984c4b89e, user_id=7c111fd8462b42729755c2c5518ef37b, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:35.485586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0101f-5f97-4d8f-bf56-ea405162de1d admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:35.498916 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1294/2577] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:35 2022] PUT /identity/v3/projects/1b6216b230034f2b89d34b2984c4b89e/users/7c111fd8462b42729755c2c5518ef37b/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:35.509898 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33945f9d-71f7-4ad3-8636-2223d7c2e662 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:35.510198 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33945f9d-71f7-4ad3-8636-2223d7c2e662 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:35.510528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33945f9d-71f7-4ad3-8636-2223d7c2e662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:35.538403 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-33945f9d-71f7-4ad3-8636-2223d7c2e662 None None] MFA Rules not processed for user `7c111fd8462b42729755c2c5518ef37b`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:35.539601 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-33945f9d-71f7-4ad3-8636-2223d7c2e662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:35.602306 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1284/2578] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:41:35.606738 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0101f-5f97-4d8f-bf56-ea405162de1d admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:35.668618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0101f-5f97-4d8f-bf56-ea405162de1d admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:35.673666 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149c144-aac2-4f2f-bbc8-26d9a746cf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:35.674366 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149c144-aac2-4f2f-bbc8-26d9a746cf7c admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:35.674655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149c144-aac2-4f2f-bbc8-26d9a746cf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:35.674932 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149c144-aac2-4f2f-bbc8-26d9a746cf7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:35.675632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149c144-aac2-4f2f-bbc8-26d9a746cf7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:35.677552 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149c144-aac2-4f2f-bbc8-26d9a746cf7c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:35.703539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1295/2579] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:35 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:35.707716 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33945f9d-71f7-4ad3-8636-2223d7c2e662 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:35.718987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33945f9d-71f7-4ad3-8636-2223d7c2e662 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:35.773244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1385e16-cab1-45dc-9762-afbf39310762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:35.773912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1385e16-cab1-45dc-9762-afbf39310762 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:35.774217 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1385e16-cab1-45dc-9762-afbf39310762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:35.774497 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1385e16-cab1-45dc-9762-afbf39310762 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:35.775192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1385e16-cab1-45dc-9762-afbf39310762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:35.777130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1385e16-cab1-45dc-9762-afbf39310762 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:35.797204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1285/2580] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:35 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:41:35.801218 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149c144-aac2-4f2f-bbc8-26d9a746cf7c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:35.811313 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149c144-aac2-4f2f-bbc8-26d9a746cf7c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:35.816186 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235397d-e479-4c13-ba32-8a9b1c3afc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:35.816826 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235397d-e479-4c13-ba32-8a9b1c3afc04 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:35.817109 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235397d-e479-4c13-ba32-8a9b1c3afc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:35.817385 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235397d-e479-4c13-ba32-8a9b1c3afc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:35.818106 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235397d-e479-4c13-ba32-8a9b1c3afc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:35.819884 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235397d-e479-4c13-ba32-8a9b1c3afc04 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:35.832279 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1296/2581] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:35.836195 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1385e16-cab1-45dc-9762-afbf39310762 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:35.846806 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1385e16-cab1-45dc-9762-afbf39310762 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:35.851510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db5ff3-c232-439f-ac5a-92aabc317f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:35.852406 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db5ff3-c232-439f-ac5a-92aabc317f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:35.852690 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db5ff3-c232-439f-ac5a-92aabc317f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:35.852969 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db5ff3-c232-439f-ac5a-92aabc317f26 admin admin] PATH_INFO: `/v3/projects/7025d7dce1744e53a3119eed4bc7aa7d/users/c13f4b8ca1ee4c08bc726515d8e45da9/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:35.867984 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db5ff3-c232-439f-ac5a-92aabc317f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7025d7dce1744e53a3119eed4bc7aa7d, user_id=c13f4b8ca1ee4c08bc726515d8e45da9, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:35.870916 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db5ff3-c232-439f-ac5a-92aabc317f26 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:35.883945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1286/2582] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:35 2022] PUT /identity/v3/projects/7025d7dce1744e53a3119eed4bc7aa7d/users/c13f4b8ca1ee4c08bc726515d8e45da9/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:35.887914 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235397d-e479-4c13-ba32-8a9b1c3afc04 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:35.899005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235397d-e479-4c13-ba32-8a9b1c3afc04 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:35.954766 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee4821-3b66-42c9-8ba1-a64010a1f3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:35.955352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee4821-3b66-42c9-8ba1-a64010a1f3cc admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:35.955640 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee4821-3b66-42c9-8ba1-a64010a1f3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:35.955918 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee4821-3b66-42c9-8ba1-a64010a1f3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:35.956634 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee4821-3b66-42c9-8ba1-a64010a1f3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:35.958260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee4821-3b66-42c9-8ba1-a64010a1f3cc admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:35.967539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1297/2583] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:35.971830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db5ff3-c232-439f-ac5a-92aabc317f26 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:35.981983 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db5ff3-c232-439f-ac5a-92aabc317f26 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:35.987151 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f2b7c-ba86-4d81-b43f-4ea8fbe710af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:35.988116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f2b7c-ba86-4d81-b43f-4ea8fbe710af admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:35.988404 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f2b7c-ba86-4d81-b43f-4ea8fbe710af admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:35.988684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f2b7c-ba86-4d81-b43f-4ea8fbe710af admin admin] PATH_INFO: `/v3/projects/7025d7dce1744e53a3119eed4bc7aa7d/users/c13f4b8ca1ee4c08bc726515d8e45da9/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:35.990822 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f2b7c-ba86-4d81-b43f-4ea8fbe710af admin admin] RBAC: Authorizing `identity:create_grant(project_id=7025d7dce1744e53a3119eed4bc7aa7d, user_id=c13f4b8ca1ee4c08bc726515d8e45da9, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:35.993571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f2b7c-ba86-4d81-b43f-4ea8fbe710af admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:36.004510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1287/2584] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:35 2022] PUT /identity/v3/projects/7025d7dce1744e53a3119eed4bc7aa7d/users/c13f4b8ca1ee4c08bc726515d8e45da9/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:36.014527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed393996-183c-4e90-a7a3-b1eb7b3119ca None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:36.014840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed393996-183c-4e90-a7a3-b1eb7b3119ca None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:36.016181 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed393996-183c-4e90-a7a3-b1eb7b3119ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:36.041733 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-ed393996-183c-4e90-a7a3-b1eb7b3119ca None None] MFA Rules not processed for user `c13f4b8ca1ee4c08bc726515d8e45da9`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:36.042967 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ed393996-183c-4e90-a7a3-b1eb7b3119ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:36.115596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1298/2585] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:36.127160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f2b7c-ba86-4d81-b43f-4ea8fbe710af admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:36.128969 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-8e9f2b7c-ba86-4d81-b43f-4ea8fbe710af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:36.184976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f2b7c-ba86-4d81-b43f-4ea8fbe710af admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:36.189619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5fd83-d151-42c1-ad8f-a74b09adc1c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:36.190283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5fd83-d151-42c1-ad8f-a74b09adc1c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:36.190571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5fd83-d151-42c1-ad8f-a74b09adc1c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:36.190850 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5fd83-d151-42c1-ad8f-a74b09adc1c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:36.200203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5fd83-d151-42c1-ad8f-a74b09adc1c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:36.201642 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5fd83-d151-42c1-ad8f-a74b09adc1c5 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:36.212200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1288/2586] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:36.690508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed393996-183c-4e90-a7a3-b1eb7b3119ca None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:36.691922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ed393996-183c-4e90-a7a3-b1eb7b3119ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:36.704124 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed393996-183c-4e90-a7a3-b1eb7b3119ca None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:36.708309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd533f0-9697-4f1b-ae23-f72e8f21d074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:36.708983 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd533f0-9697-4f1b-ae23-f72e8f21d074 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:36.709267 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd533f0-9697-4f1b-ae23-f72e8f21d074 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:36.709544 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd533f0-9697-4f1b-ae23-f72e8f21d074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:36.765658 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd533f0-9697-4f1b-ae23-f72e8f21d074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:36.767138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd533f0-9697-4f1b-ae23-f72e8f21d074 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:36.775824 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1299/2587] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:47.037715 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5fd83-d151-42c1-ad8f-a74b09adc1c5 service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:47.046551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5fd83-d151-42c1-ad8f-a74b09adc1c5 service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:47.050158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e99f8-cfe5-4669-9d5e-a858bc631ed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:47.050830 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e99f8-cfe5-4669-9d5e-a858bc631ed0 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:47.051110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e99f8-cfe5-4669-9d5e-a858bc631ed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:47.051388 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e99f8-cfe5-4669-9d5e-a858bc631ed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:47.106916 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e99f8-cfe5-4669-9d5e-a858bc631ed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:47.108468 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e99f8-cfe5-4669-9d5e-a858bc631ed0 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:47.117175 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1289/2588] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:52.133674 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd533f0-9697-4f1b-ae23-f72e8f21d074 service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:52.199941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd533f0-9697-4f1b-ae23-f72e8f21d074 service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:52.204720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89373ea6-0a78-4a52-bf11-fa3e203dae8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:52.205585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89373ea6-0a78-4a52-bf11-fa3e203dae8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:52.205865 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89373ea6-0a78-4a52-bf11-fa3e203dae8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:52.206135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89373ea6-0a78-4a52-bf11-fa3e203dae8f admin admin] PATH_INFO: `/v3/users/419aa4237b42434ba556c678a8cfaa5d` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:52.207364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89373ea6-0a78-4a52-bf11-fa3e203dae8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=419aa4237b42434ba556c678a8cfaa5d)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:52.209378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89373ea6-0a78-4a52-bf11-fa3e203dae8f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:52.257631 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-89373ea6-0a78-4a52-bf11-fa3e203dae8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419aa4237b42434ba556c678a8cfaa5d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:52.264242 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-89373ea6-0a78-4a52-bf11-fa3e203dae8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419aa4237b42434ba556c678a8cfaa5d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:52.265274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-89373ea6-0a78-4a52-bf11-fa3e203dae8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419aa4237b42434ba556c678a8cfaa5d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:52.277567 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-89373ea6-0a78-4a52-bf11-fa3e203dae8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419aa4237b42434ba556c678a8cfaa5d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:52.284603 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-89373ea6-0a78-4a52-bf11-fa3e203dae8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419aa4237b42434ba556c678a8cfaa5d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:52.290436 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1300/2589] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:52 2022] DELETE /identity/v3/users/419aa4237b42434ba556c678a8cfaa5d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:52.294879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb858b-12dc-4e0c-a0d6-9b3a0ea4b72a None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:52.295361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb858b-12dc-4e0c-a0d6-9b3a0ea4b72a None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:52.295457 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb858b-12dc-4e0c-a0d6-9b3a0ea4b72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:52.314679 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-eaeb858b-12dc-4e0c-a0d6-9b3a0ea4b72a None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:52.315871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-eaeb858b-12dc-4e0c-a0d6-9b3a0ea4b72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:52.377630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1290/2590] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:52.387535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89373ea6-0a78-4a52-bf11-fa3e203dae8f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:52.389190 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-89373ea6-0a78-4a52-bf11-fa3e203dae8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:52.447312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89373ea6-0a78-4a52-bf11-fa3e203dae8f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:52.451007 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bfe39-e565-4876-9fe0-00272feee55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:52.451585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bfe39-e565-4876-9fe0-00272feee55c service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:52.451866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bfe39-e565-4876-9fe0-00272feee55c service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:52.452198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bfe39-e565-4876-9fe0-00272feee55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:52.461038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bfe39-e565-4876-9fe0-00272feee55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:52.462508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bfe39-e565-4876-9fe0-00272feee55c service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:52.473886 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1301/2591] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:52.742740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb858b-12dc-4e0c-a0d6-9b3a0ea4b72a None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:52.744224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-eaeb858b-12dc-4e0c-a0d6-9b3a0ea4b72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:52.756980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb858b-12dc-4e0c-a0d6-9b3a0ea4b72a None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:52.761735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b680e07-ef99-43e7-9159-b08e645b59eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:52.762717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b680e07-ef99-43e7-9159-b08e645b59eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:52.763067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b680e07-ef99-43e7-9159-b08e645b59eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:52.763409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b680e07-ef99-43e7-9159-b08e645b59eb admin admin] PATH_INFO: `/v3/projects/dd3410e7b42942e09dd59bb0fdd1a3e2` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:52.765342 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b680e07-ef99-43e7-9159-b08e645b59eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3410e7b42942e09dd59bb0fdd1a3e2)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:52.767805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b680e07-ef99-43e7-9159-b08e645b59eb admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:52.813847 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8b680e07-ef99-43e7-9159-b08e645b59eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3410e7b42942e09dd59bb0fdd1a3e2', 'request_id': 'req-8b680e07-ef99-43e7-9159-b08e645b59eb'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:52.819793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8b680e07-ef99-43e7-9159-b08e645b59eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3410e7b42942e09dd59bb0fdd1a3e2', 'request_id': 'req-8b680e07-ef99-43e7-9159-b08e645b59eb'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:52.827530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8b680e07-ef99-43e7-9159-b08e645b59eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3410e7b42942e09dd59bb0fdd1a3e2', 'request_id': 'req-8b680e07-ef99-43e7-9159-b08e645b59eb'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:52.837605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8b680e07-ef99-43e7-9159-b08e645b59eb admin admin] The token cache is being invalidate because project dd3410e7b42942e09dd59bb0fdd1a3e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:52.837892 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8b680e07-ef99-43e7-9159-b08e645b59eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:52.838533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8b680e07-ef99-43e7-9159-b08e645b59eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:52.840060 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1291/2592] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:52 2022] DELETE /identity/v3/projects/dd3410e7b42942e09dd59bb0fdd1a3e2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:52.844903 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bfe39-e565-4876-9fe0-00272feee55c service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:52.854257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bfe39-e565-4876-9fe0-00272feee55c service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:52.908105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10118b29-6201-4f7b-beeb-a3b935dbd5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:52.908948 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10118b29-6201-4f7b-beeb-a3b935dbd5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:52.909232 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10118b29-6201-4f7b-beeb-a3b935dbd5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:52.909504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10118b29-6201-4f7b-beeb-a3b935dbd5a3 admin admin] PATH_INFO: `/v3/users/7c111fd8462b42729755c2c5518ef37b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:52.910702 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10118b29-6201-4f7b-beeb-a3b935dbd5a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c111fd8462b42729755c2c5518ef37b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:52.912623 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10118b29-6201-4f7b-beeb-a3b935dbd5a3 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:52.957444 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-10118b29-6201-4f7b-beeb-a3b935dbd5a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c111fd8462b42729755c2c5518ef37b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:52.964409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-10118b29-6201-4f7b-beeb-a3b935dbd5a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c111fd8462b42729755c2c5518ef37b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:52.965037 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-10118b29-6201-4f7b-beeb-a3b935dbd5a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c111fd8462b42729755c2c5518ef37b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:52.977867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-10118b29-6201-4f7b-beeb-a3b935dbd5a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c111fd8462b42729755c2c5518ef37b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:52.984642 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-10118b29-6201-4f7b-beeb-a3b935dbd5a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c111fd8462b42729755c2c5518ef37b'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:52.990406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1302/2593] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:52 2022] DELETE /identity/v3/users/7c111fd8462b42729755c2c5518ef37b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:53.271378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b680e07-ef99-43e7-9159-b08e645b59eb admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:53.273216 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-8b680e07-ef99-43e7-9159-b08e645b59eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:53.289536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b680e07-ef99-43e7-9159-b08e645b59eb admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:53.351948 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:53.352815 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:53.353099 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:53.353383 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8 admin admin] PATH_INFO: `/v3/projects/1b6216b230034f2b89d34b2984c4b89e` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:53.354598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6216b230034f2b89d34b2984c4b89e)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:53.356627 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:53.408451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6216b230034f2b89d34b2984c4b89e', 'request_id': 'req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:53.414811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6216b230034f2b89d34b2984c4b89e', 'request_id': 'req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:53.422707 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6216b230034f2b89d34b2984c4b89e', 'request_id': 'req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:53.433225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8 admin admin] The token cache is being invalidate because project 1b6216b230034f2b89d34b2984c4b89e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:53.433514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:53.434142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:53.436081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1292/2594] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:53 2022] DELETE /identity/v3/projects/1b6216b230034f2b89d34b2984c4b89e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:53.440897 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10118b29-6201-4f7b-beeb-a3b935dbd5a3 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:53.442418 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-10118b29-6201-4f7b-beeb-a3b935dbd5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:53.456971 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10118b29-6201-4f7b-beeb-a3b935dbd5a3 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:53.517755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ba9af-ae51-4384-940e-530a21875d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:53.518890 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ba9af-ae51-4384-940e-530a21875d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:53.519209 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ba9af-ae51-4384-940e-530a21875d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:53.519492 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ba9af-ae51-4384-940e-530a21875d8c admin admin] PATH_INFO: `/v3/users/c13f4b8ca1ee4c08bc726515d8e45da9` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:53.520773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ba9af-ae51-4384-940e-530a21875d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c13f4b8ca1ee4c08bc726515d8e45da9)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:53.522787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ba9af-ae51-4384-940e-530a21875d8c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:53.574277 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3a4ba9af-ae51-4384-940e-530a21875d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c13f4b8ca1ee4c08bc726515d8e45da9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:53.582081 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3a4ba9af-ae51-4384-940e-530a21875d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c13f4b8ca1ee4c08bc726515d8e45da9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:53.582720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3a4ba9af-ae51-4384-940e-530a21875d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c13f4b8ca1ee4c08bc726515d8e45da9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:53.595421 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3a4ba9af-ae51-4384-940e-530a21875d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c13f4b8ca1ee4c08bc726515d8e45da9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:53.602962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-3a4ba9af-ae51-4384-940e-530a21875d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c13f4b8ca1ee4c08bc726515d8e45da9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:53.609474 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1303/2595] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:53 2022] DELETE /identity/v3/users/c13f4b8ca1ee4c08bc726515d8e45da9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:53.876713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:53.878242 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:53.894101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7df11-b7e9-4df9-a3a2-fb69fe97f8a8 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:53.956862 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b978d-d6eb-47af-ba3c-b31793d33589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:53.957952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b978d-d6eb-47af-ba3c-b31793d33589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:53.958448 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b978d-d6eb-47af-ba3c-b31793d33589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:53.958709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b978d-d6eb-47af-ba3c-b31793d33589 admin admin] PATH_INFO: `/v3/projects/7025d7dce1744e53a3119eed4bc7aa7d` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:53.960303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b978d-d6eb-47af-ba3c-b31793d33589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7025d7dce1744e53a3119eed4bc7aa7d)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:53.962592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b978d-d6eb-47af-ba3c-b31793d33589 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:54.008820 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0e4b978d-d6eb-47af-ba3c-b31793d33589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7025d7dce1744e53a3119eed4bc7aa7d', 'request_id': 'req-0e4b978d-d6eb-47af-ba3c-b31793d33589'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:54.015877 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0e4b978d-d6eb-47af-ba3c-b31793d33589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7025d7dce1744e53a3119eed4bc7aa7d', 'request_id': 'req-0e4b978d-d6eb-47af-ba3c-b31793d33589'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:54.023026 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0e4b978d-d6eb-47af-ba3c-b31793d33589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7025d7dce1744e53a3119eed4bc7aa7d', 'request_id': 'req-0e4b978d-d6eb-47af-ba3c-b31793d33589'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:54.033444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0e4b978d-d6eb-47af-ba3c-b31793d33589 admin admin] The token cache is being invalidate because project 7025d7dce1744e53a3119eed4bc7aa7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:54.033731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0e4b978d-d6eb-47af-ba3c-b31793d33589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:54.034381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-0e4b978d-d6eb-47af-ba3c-b31793d33589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:54.036109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1293/2596] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:53 2022] DELETE /identity/v3/projects/7025d7dce1744e53a3119eed4bc7aa7d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:54.042119 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501cba1-1c24-433c-8d59-4d84e0642b83 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.042442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501cba1-1c24-433c-8d59-4d84e0642b83 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.042745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501cba1-1c24-433c-8d59-4d84e0642b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:54.060656 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-2501cba1-1c24-433c-8d59-4d84e0642b83 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:54.062410 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2501cba1-1c24-433c-8d59-4d84e0642b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:54.120375 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1304/2597] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:41:54.130159 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078838e-4420-40fa-8fd3-1714cf47a2eb None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.130479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078838e-4420-40fa-8fd3-1714cf47a2eb None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.130758 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078838e-4420-40fa-8fd3-1714cf47a2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:54.148993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-9078838e-4420-40fa-8fd3-1714cf47a2eb None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:54.150209 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-9078838e-4420-40fa-8fd3-1714cf47a2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:54.158148 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1294/2598] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:54.162240 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501cba1-1c24-433c-8d59-4d84e0642b83 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:54.172199 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501cba1-1c24-433c-8d59-4d84e0642b83 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:54.176692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a57ec-c504-4bb0-84c6-9bd876d0d804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:54.177333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a57ec-c504-4bb0-84c6-9bd876d0d804 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.177611 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a57ec-c504-4bb0-84c6-9bd876d0d804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.177884 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a57ec-c504-4bb0-84c6-9bd876d0d804 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:54.178638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a57ec-c504-4bb0-84c6-9bd876d0d804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:41:54.178942 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a57ec-c504-4bb0-84c6-9bd876d0d804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:54.180537 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a57ec-c504-4bb0-84c6-9bd876d0d804 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:54.192157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1305/2599] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:41:54.196819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078838e-4420-40fa-8fd3-1714cf47a2eb None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:54.206826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078838e-4420-40fa-8fd3-1714cf47a2eb None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:54.211599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77d12a-63ca-43d0-8a0a-4d5c0d885886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:54.212259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77d12a-63ca-43d0-8a0a-4d5c0d885886 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.212542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77d12a-63ca-43d0-8a0a-4d5c0d885886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.212820 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77d12a-63ca-43d0-8a0a-4d5c0d885886 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:54.213519 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77d12a-63ca-43d0-8a0a-4d5c0d885886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:54.215467 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77d12a-63ca-43d0-8a0a-4d5c0d885886 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:54.243434 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1295/2600] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:54 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:54.247736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a57ec-c504-4bb0-84c6-9bd876d0d804 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:54.258317 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a57ec-c504-4bb0-84c6-9bd876d0d804 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:54.313460 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a39f97-9902-479b-98a3-598dc90598dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:54.314061 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39f97-9902-479b-98a3-598dc90598dd admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.314378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39f97-9902-479b-98a3-598dc90598dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.314653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39f97-9902-479b-98a3-598dc90598dd admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:54.315342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a39f97-9902-479b-98a3-598dc90598dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:54.317269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a39f97-9902-479b-98a3-598dc90598dd admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:54.337645 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1306/2601] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:54 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:54.342008 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77d12a-63ca-43d0-8a0a-4d5c0d885886 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:54.352748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77d12a-63ca-43d0-8a0a-4d5c0d885886 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:54.357287 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aac774-5b68-4eea-b3cc-84e729f8ac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:54.357936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aac774-5b68-4eea-b3cc-84e729f8ac58 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.358900 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aac774-5b68-4eea-b3cc-84e729f8ac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.359660 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aac774-5b68-4eea-b3cc-84e729f8ac58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:54.360388 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aac774-5b68-4eea-b3cc-84e729f8ac58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:54.361988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aac774-5b68-4eea-b3cc-84e729f8ac58 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:54.372276 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1296/2602] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:54.376716 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a39f97-9902-479b-98a3-598dc90598dd admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:54.386468 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a39f97-9902-479b-98a3-598dc90598dd admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:54.391555 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec1e7e-71fc-424d-8cbe-37b748f3fedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:54.392203 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec1e7e-71fc-424d-8cbe-37b748f3fedd admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.392483 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec1e7e-71fc-424d-8cbe-37b748f3fedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.392756 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec1e7e-71fc-424d-8cbe-37b748f3fedd admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:54.393476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec1e7e-71fc-424d-8cbe-37b748f3fedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:54.395108 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec1e7e-71fc-424d-8cbe-37b748f3fedd admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:54.405697 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1307/2603] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:54.409138 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aac774-5b68-4eea-b3cc-84e729f8ac58 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:54.419153 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aac774-5b68-4eea-b3cc-84e729f8ac58 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:54.424368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adc5bd-e01a-430a-9df0-78be8093da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:54.425236 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adc5bd-e01a-430a-9df0-78be8093da7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.425520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adc5bd-e01a-430a-9df0-78be8093da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.425800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adc5bd-e01a-430a-9df0-78be8093da7f admin admin] PATH_INFO: `/v3/projects/381eabe5ae2d4123940682eac6a44ece/users/6548cb2b65594937867512c7346d315c/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:54.440543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adc5bd-e01a-430a-9df0-78be8093da7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=381eabe5ae2d4123940682eac6a44ece, user_id=6548cb2b65594937867512c7346d315c, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:54.443261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adc5bd-e01a-430a-9df0-78be8093da7f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:54.458206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1297/2604] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:54 2022] PUT /identity/v3/projects/381eabe5ae2d4123940682eac6a44ece/users/6548cb2b65594937867512c7346d315c/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:54.470367 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581b2ef-e0f1-4e11-bf67-c0f38faf78bc None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.470817 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581b2ef-e0f1-4e11-bf67-c0f38faf78bc None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.470935 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581b2ef-e0f1-4e11-bf67-c0f38faf78bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:54.496977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-3581b2ef-e0f1-4e11-bf67-c0f38faf78bc None None] MFA Rules not processed for user `6548cb2b65594937867512c7346d315c`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:54.498191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-3581b2ef-e0f1-4e11-bf67-c0f38faf78bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:54.559827 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1308/2605] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:54.565157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adc5bd-e01a-430a-9df0-78be8093da7f admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:54.629562 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adc5bd-e01a-430a-9df0-78be8093da7f admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:54.634939 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259eca8-e502-4163-b28d-6fb5f28d4810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:54.635612 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259eca8-e502-4163-b28d-6fb5f28d4810 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.635894 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259eca8-e502-4163-b28d-6fb5f28d4810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.636172 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259eca8-e502-4163-b28d-6fb5f28d4810 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:54.636880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259eca8-e502-4163-b28d-6fb5f28d4810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:54.639547 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259eca8-e502-4163-b28d-6fb5f28d4810 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:54.670674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1298/2606] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:54 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:54.673129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581b2ef-e0f1-4e11-bf67-c0f38faf78bc None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:54.683519 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581b2ef-e0f1-4e11-bf67-c0f38faf78bc None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:54.745062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b6d9d-1e61-4b9a-8870-9b6c54d0dffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:54.745742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b6d9d-1e61-4b9a-8870-9b6c54d0dffe admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.746026 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b6d9d-1e61-4b9a-8870-9b6c54d0dffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.746455 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b6d9d-1e61-4b9a-8870-9b6c54d0dffe admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:54.747166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b6d9d-1e61-4b9a-8870-9b6c54d0dffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:54.749729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b6d9d-1e61-4b9a-8870-9b6c54d0dffe admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:54.768914 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1309/2607] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:54 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:54.772880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259eca8-e502-4163-b28d-6fb5f28d4810 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:54.783202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259eca8-e502-4163-b28d-6fb5f28d4810 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:54.787832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e341a-9573-4fc7-b70e-31d2ad5bca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:54.788487 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e341a-9573-4fc7-b70e-31d2ad5bca32 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.788774 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e341a-9573-4fc7-b70e-31d2ad5bca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.789049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e341a-9573-4fc7-b70e-31d2ad5bca32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:54.789796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e341a-9573-4fc7-b70e-31d2ad5bca32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:54.791445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e341a-9573-4fc7-b70e-31d2ad5bca32 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:54.801944 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1299/2608] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:54.805884 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b6d9d-1e61-4b9a-8870-9b6c54d0dffe admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:54.816550 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b6d9d-1e61-4b9a-8870-9b6c54d0dffe admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:54.821006 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580df35-6f8b-40c0-afb8-8d45753b256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:54.822117 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580df35-6f8b-40c0-afb8-8d45753b256c admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.822430 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580df35-6f8b-40c0-afb8-8d45753b256c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.822700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580df35-6f8b-40c0-afb8-8d45753b256c admin admin] PATH_INFO: `/v3/projects/178fb111145a4def8ec4f5b64e2e24e1/users/9110dc613adc49e8affd52cd8c15aa63/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:54.837275 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580df35-6f8b-40c0-afb8-8d45753b256c admin admin] RBAC: Authorizing `identity:create_grant(project_id=178fb111145a4def8ec4f5b64e2e24e1, user_id=9110dc613adc49e8affd52cd8c15aa63, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:54.840087 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580df35-6f8b-40c0-afb8-8d45753b256c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:54.852406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1310/2609] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:54 2022] PUT /identity/v3/projects/178fb111145a4def8ec4f5b64e2e24e1/users/9110dc613adc49e8affd52cd8c15aa63/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:41:54.856404 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e341a-9573-4fc7-b70e-31d2ad5bca32 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:54.866443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e341a-9573-4fc7-b70e-31d2ad5bca32 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:54.925640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a43297-8382-4358-adca-7a595e5f7f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:54.926490 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a43297-8382-4358-adca-7a595e5f7f24 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.926780 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a43297-8382-4358-adca-7a595e5f7f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.927136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a43297-8382-4358-adca-7a595e5f7f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:54.927897 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a43297-8382-4358-adca-7a595e5f7f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:54.929628 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a43297-8382-4358-adca-7a595e5f7f24 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:54.943500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1300/2610] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:54.948456 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580df35-6f8b-40c0-afb8-8d45753b256c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:54.961934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580df35-6f8b-40c0-afb8-8d45753b256c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:54.967850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9c0bc-62e0-4fc0-b58d-68fb3b3fda6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:54.968975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9c0bc-62e0-4fc0-b58d-68fb3b3fda6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.969297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9c0bc-62e0-4fc0-b58d-68fb3b3fda6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.969574 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9c0bc-62e0-4fc0-b58d-68fb3b3fda6c admin admin] PATH_INFO: `/v3/projects/178fb111145a4def8ec4f5b64e2e24e1/users/9110dc613adc49e8affd52cd8c15aa63/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:54.972363 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9c0bc-62e0-4fc0-b58d-68fb3b3fda6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=178fb111145a4def8ec4f5b64e2e24e1, user_id=9110dc613adc49e8affd52cd8c15aa63, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:54.975260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9c0bc-62e0-4fc0-b58d-68fb3b3fda6c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:54.987357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1311/2611] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:54 2022] PUT /identity/v3/projects/178fb111145a4def8ec4f5b64e2e24e1/users/9110dc613adc49e8affd52cd8c15aa63/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:41:54.997590 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdaec2-d1f4-4c79-828c-251b08a44b60 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:54.997886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdaec2-d1f4-4c79-828c-251b08a44b60 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:54.998327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdaec2-d1f4-4c79-828c-251b08a44b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:55.025323 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-24cdaec2-d1f4-4c79-828c-251b08a44b60 None None] MFA Rules not processed for user `9110dc613adc49e8affd52cd8c15aa63`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:55.026582 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-24cdaec2-d1f4-4c79-828c-251b08a44b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:55.093891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1301/2612] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:55.104468 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9c0bc-62e0-4fc0-b58d-68fb3b3fda6c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:55.106266 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-88f9c0bc-62e0-4fc0-b58d-68fb3b3fda6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:55.162402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9c0bc-62e0-4fc0-b58d-68fb3b3fda6c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:55.166071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e51b2c-630e-4230-9e32-012a994071a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:55.166748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e51b2c-630e-4230-9e32-012a994071a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:55.167035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e51b2c-630e-4230-9e32-012a994071a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:55.167313 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e51b2c-630e-4230-9e32-012a994071a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:55.176724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e51b2c-630e-4230-9e32-012a994071a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:55.178159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e51b2c-630e-4230-9e32-012a994071a6 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:55.188057 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1312/2613] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:55.232840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdaec2-d1f4-4c79-828c-251b08a44b60 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:55.235519 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-24cdaec2-d1f4-4c79-828c-251b08a44b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:55.247137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdaec2-d1f4-4c79-828c-251b08a44b60 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:55.252041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16693fa9-32dd-4331-a775-34b6ca650923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:55.252700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16693fa9-32dd-4331-a775-34b6ca650923 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:55.252979 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16693fa9-32dd-4331-a775-34b6ca650923 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:55.253350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16693fa9-32dd-4331-a775-34b6ca650923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:55.310539 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16693fa9-32dd-4331-a775-34b6ca650923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:55.312709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16693fa9-32dd-4331-a775-34b6ca650923 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:55.321882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1302/2614] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:55.778721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e51b2c-630e-4230-9e32-012a994071a6 service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:55.780898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-80e51b2c-630e-4230-9e32-012a994071a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:55.845156 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e51b2c-630e-4230-9e32-012a994071a6 service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:55.849657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c35757-fc70-489d-9f0e-225212147b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:55.850536 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c35757-fc70-489d-9f0e-225212147b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:55.850816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c35757-fc70-489d-9f0e-225212147b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:55.851089 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c35757-fc70-489d-9f0e-225212147b09 admin admin] PATH_INFO: `/v3/users/678926cdc4214adc921ee3abd0de3ecf` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:55.852246 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c35757-fc70-489d-9f0e-225212147b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=678926cdc4214adc921ee3abd0de3ecf)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:55.854156 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c35757-fc70-489d-9f0e-225212147b09 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:55.897694 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e8c35757-fc70-489d-9f0e-225212147b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '678926cdc4214adc921ee3abd0de3ecf'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:55.903823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e8c35757-fc70-489d-9f0e-225212147b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '678926cdc4214adc921ee3abd0de3ecf'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:55.904442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e8c35757-fc70-489d-9f0e-225212147b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '678926cdc4214adc921ee3abd0de3ecf'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:55.916378 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e8c35757-fc70-489d-9f0e-225212147b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '678926cdc4214adc921ee3abd0de3ecf'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:55.922990 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-e8c35757-fc70-489d-9f0e-225212147b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '678926cdc4214adc921ee3abd0de3ecf'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:55.928701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1313/2615] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:55 2022] DELETE /identity/v3/users/678926cdc4214adc921ee3abd0de3ecf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:55.933196 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b267c1-e3d6-4bf3-a39c-3da2e9a85a7f None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:55.933681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b267c1-e3d6-4bf3-a39c-3da2e9a85a7f None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:55.933802 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b267c1-e3d6-4bf3-a39c-3da2e9a85a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:55.951720 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-e1b267c1-e3d6-4bf3-a39c-3da2e9a85a7f None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:55.953549 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e1b267c1-e3d6-4bf3-a39c-3da2e9a85a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:56.012763 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1303/2616] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:56.022919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c35757-fc70-489d-9f0e-225212147b09 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:56.024309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e8c35757-fc70-489d-9f0e-225212147b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:56.081359 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c35757-fc70-489d-9f0e-225212147b09 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:56.085035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec0659-4d35-4a95-b5f2-171471f19622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:56.085671 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec0659-4d35-4a95-b5f2-171471f19622 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:56.085956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec0659-4d35-4a95-b5f2-171471f19622 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:56.086263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec0659-4d35-4a95-b5f2-171471f19622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:56.095875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec0659-4d35-4a95-b5f2-171471f19622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:56.097309 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec0659-4d35-4a95-b5f2-171471f19622 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:56.106688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1314/2617] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:56.371147 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b267c1-e3d6-4bf3-a39c-3da2e9a85a7f None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:56.372660 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e1b267c1-e3d6-4bf3-a39c-3da2e9a85a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:56.385976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b267c1-e3d6-4bf3-a39c-3da2e9a85a7f None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:56.391863 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd487f9-df6c-4e75-8616-68127aa1db58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:56.392802 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd487f9-df6c-4e75-8616-68127aa1db58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:56.393155 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd487f9-df6c-4e75-8616-68127aa1db58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:56.393503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd487f9-df6c-4e75-8616-68127aa1db58 admin admin] PATH_INFO: `/v3/projects/12ecdddf4be8429ebb9531161f44842a` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:56.394937 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd487f9-df6c-4e75-8616-68127aa1db58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ecdddf4be8429ebb9531161f44842a)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:56.397443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd487f9-df6c-4e75-8616-68127aa1db58 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:56.443576 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fcd487f9-df6c-4e75-8616-68127aa1db58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ecdddf4be8429ebb9531161f44842a', 'request_id': 'req-fcd487f9-df6c-4e75-8616-68127aa1db58'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:56.450015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fcd487f9-df6c-4e75-8616-68127aa1db58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ecdddf4be8429ebb9531161f44842a', 'request_id': 'req-fcd487f9-df6c-4e75-8616-68127aa1db58'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:56.457935 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fcd487f9-df6c-4e75-8616-68127aa1db58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ecdddf4be8429ebb9531161f44842a', 'request_id': 'req-fcd487f9-df6c-4e75-8616-68127aa1db58'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:56.468001 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fcd487f9-df6c-4e75-8616-68127aa1db58 admin admin] The token cache is being invalidate because project 12ecdddf4be8429ebb9531161f44842a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:56.468286 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fcd487f9-df6c-4e75-8616-68127aa1db58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:56.468907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-fcd487f9-df6c-4e75-8616-68127aa1db58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:56.470478 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1304/2618] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:56 2022] DELETE /identity/v3/projects/12ecdddf4be8429ebb9531161f44842a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:41:56.474491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec0659-4d35-4a95-b5f2-171471f19622 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:56.484493 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec0659-4d35-4a95-b5f2-171471f19622 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:56.537906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5dd5f-827b-4c1d-b579-23cc60d36755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:56.538807 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5dd5f-827b-4c1d-b579-23cc60d36755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:56.539092 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5dd5f-827b-4c1d-b579-23cc60d36755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:56.539394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5dd5f-827b-4c1d-b579-23cc60d36755 admin admin] PATH_INFO: `/v3/users/1e5d4cd4c3c04e6ebad4bc7812d64bb9` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:56.540568 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5dd5f-827b-4c1d-b579-23cc60d36755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e5d4cd4c3c04e6ebad4bc7812d64bb9)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:56.542513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5dd5f-827b-4c1d-b579-23cc60d36755 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:56.586333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2dc5dd5f-827b-4c1d-b579-23cc60d36755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e5d4cd4c3c04e6ebad4bc7812d64bb9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:56.593881 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2dc5dd5f-827b-4c1d-b579-23cc60d36755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e5d4cd4c3c04e6ebad4bc7812d64bb9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:56.594538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2dc5dd5f-827b-4c1d-b579-23cc60d36755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e5d4cd4c3c04e6ebad4bc7812d64bb9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:56.606105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2dc5dd5f-827b-4c1d-b579-23cc60d36755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e5d4cd4c3c04e6ebad4bc7812d64bb9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:56.613608 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2dc5dd5f-827b-4c1d-b579-23cc60d36755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e5d4cd4c3c04e6ebad4bc7812d64bb9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:56.619560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1315/2619] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:56 2022] DELETE /identity/v3/users/1e5d4cd4c3c04e6ebad4bc7812d64bb9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:41:56.892840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd487f9-df6c-4e75-8616-68127aa1db58 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:56.894299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-fcd487f9-df6c-4e75-8616-68127aa1db58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:56.910008 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd487f9-df6c-4e75-8616-68127aa1db58 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:56.971897 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972d4ff-141d-4173-aed2-7e8a4ed43d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:56.972697 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972d4ff-141d-4173-aed2-7e8a4ed43d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:56.972980 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972d4ff-141d-4173-aed2-7e8a4ed43d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:56.973255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972d4ff-141d-4173-aed2-7e8a4ed43d5e admin admin] PATH_INFO: `/v3/projects/e136394fe68a4703a21d50f39ff9ce6c` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:56.974560 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972d4ff-141d-4173-aed2-7e8a4ed43d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e136394fe68a4703a21d50f39ff9ce6c)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:56.976474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972d4ff-141d-4173-aed2-7e8a4ed43d5e admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:57.024617 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a972d4ff-141d-4173-aed2-7e8a4ed43d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e136394fe68a4703a21d50f39ff9ce6c', 'request_id': 'req-a972d4ff-141d-4173-aed2-7e8a4ed43d5e'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:57.030879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a972d4ff-141d-4173-aed2-7e8a4ed43d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e136394fe68a4703a21d50f39ff9ce6c', 'request_id': 'req-a972d4ff-141d-4173-aed2-7e8a4ed43d5e'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:57.038417 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a972d4ff-141d-4173-aed2-7e8a4ed43d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e136394fe68a4703a21d50f39ff9ce6c', 'request_id': 'req-a972d4ff-141d-4173-aed2-7e8a4ed43d5e'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:57.049453 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a972d4ff-141d-4173-aed2-7e8a4ed43d5e admin admin] The token cache is being invalidate because project e136394fe68a4703a21d50f39ff9ce6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:57.049768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a972d4ff-141d-4173-aed2-7e8a4ed43d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:57.050858 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a972d4ff-141d-4173-aed2-7e8a4ed43d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:57.052771 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1305/2620] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:56 2022] DELETE /identity/v3/projects/e136394fe68a4703a21d50f39ff9ce6c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:57.058446 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6a711-3892-4bb8-8414-19a545fbcc14 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:57.058931 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6a711-3892-4bb8-8414-19a545fbcc14 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:57.059153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6a711-3892-4bb8-8414-19a545fbcc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:57.083194 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-2ac6a711-3892-4bb8-8414-19a545fbcc14 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:57.084410 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2ac6a711-3892-4bb8-8414-19a545fbcc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:57.146343 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1316/2621] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:57.156532 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e4100-c2c7-4bad-b5bf-4883f6d85187 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:57.157049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e4100-c2c7-4bad-b5bf-4883f6d85187 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:57.157562 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e4100-c2c7-4bad-b5bf-4883f6d85187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:57.177850 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-5a8e4100-c2c7-4bad-b5bf-4883f6d85187 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:57.179089 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5a8e4100-c2c7-4bad-b5bf-4883f6d85187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:57.187153 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1306/2622] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:57.191515 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6a711-3892-4bb8-8414-19a545fbcc14 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:57.207008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6a711-3892-4bb8-8414-19a545fbcc14 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:57.211804 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31964e22-c497-43d2-8746-7b7457f3066c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:57.212461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31964e22-c497-43d2-8746-7b7457f3066c admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:57.212746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31964e22-c497-43d2-8746-7b7457f3066c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:57.213018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31964e22-c497-43d2-8746-7b7457f3066c admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:57.213782 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31964e22-c497-43d2-8746-7b7457f3066c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:41:57.214086 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31964e22-c497-43d2-8746-7b7457f3066c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:57.215721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31964e22-c497-43d2-8746-7b7457f3066c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:57.227999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1317/2623] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:41:57.232414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e4100-c2c7-4bad-b5bf-4883f6d85187 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:57.242005 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e4100-c2c7-4bad-b5bf-4883f6d85187 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:57.246883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a5d12-b88a-47e0-8da6-09f8b9aa2efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:57.247560 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a5d12-b88a-47e0-8da6-09f8b9aa2efc admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:57.247824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a5d12-b88a-47e0-8da6-09f8b9aa2efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:57.248099 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a5d12-b88a-47e0-8da6-09f8b9aa2efc admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:57.248876 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a5d12-b88a-47e0-8da6-09f8b9aa2efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:57.250779 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a5d12-b88a-47e0-8da6-09f8b9aa2efc admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:57.278618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1307/2624] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:57 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:57.283455 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31964e22-c497-43d2-8746-7b7457f3066c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:57.294945 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31964e22-c497-43d2-8746-7b7457f3066c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:57.352297 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e0a3b-3a96-4d1c-9b36-233574a5fea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:57.353065 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e0a3b-3a96-4d1c-9b36-233574a5fea9 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:57.353351 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e0a3b-3a96-4d1c-9b36-233574a5fea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:57.353706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e0a3b-3a96-4d1c-9b36-233574a5fea9 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:57.354507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e0a3b-3a96-4d1c-9b36-233574a5fea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:57.356692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e0a3b-3a96-4d1c-9b36-233574a5fea9 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:57.378489 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1318/2625] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:57 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:57.383256 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a5d12-b88a-47e0-8da6-09f8b9aa2efc admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:57.394096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a5d12-b88a-47e0-8da6-09f8b9aa2efc admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:57.399110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b43a5-a101-402c-9f26-e79312ccbdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:57.399776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b43a5-a101-402c-9f26-e79312ccbdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:57.400055 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b43a5-a101-402c-9f26-e79312ccbdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:57.400327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b43a5-a101-402c-9f26-e79312ccbdf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:57.401044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b43a5-a101-402c-9f26-e79312ccbdf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:57.402685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b43a5-a101-402c-9f26-e79312ccbdf2 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:57.414217 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1308/2626] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:57.417490 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e0a3b-3a96-4d1c-9b36-233574a5fea9 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:57.428330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e0a3b-3a96-4d1c-9b36-233574a5fea9 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:57.433016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea360e9-63f1-452b-b49b-4ffbb1a84b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:57.433669 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea360e9-63f1-452b-b49b-4ffbb1a84b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:57.433954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea360e9-63f1-452b-b49b-4ffbb1a84b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:57.434273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea360e9-63f1-452b-b49b-4ffbb1a84b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:57.435000 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea360e9-63f1-452b-b49b-4ffbb1a84b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:57.437321 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea360e9-63f1-452b-b49b-4ffbb1a84b5a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:57.448333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1319/2627] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:57.452564 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b43a5-a101-402c-9f26-e79312ccbdf2 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:57.462514 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b43a5-a101-402c-9f26-e79312ccbdf2 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:57.467178 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c211c4d-b6cd-498d-bc28-7a11262f5b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:57.468360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c211c4d-b6cd-498d-bc28-7a11262f5b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:57.468648 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c211c4d-b6cd-498d-bc28-7a11262f5b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:57.468929 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c211c4d-b6cd-498d-bc28-7a11262f5b0a admin admin] PATH_INFO: `/v3/projects/35edc2b28a3745468765e97d866f8ac8/users/008a9394ff1843c99714f3c81c0a74c7/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:57.484237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c211c4d-b6cd-498d-bc28-7a11262f5b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=35edc2b28a3745468765e97d866f8ac8, user_id=008a9394ff1843c99714f3c81c0a74c7, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:57.486889 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c211c4d-b6cd-498d-bc28-7a11262f5b0a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:57.500239 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1309/2628] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:57 2022] PUT /identity/v3/projects/35edc2b28a3745468765e97d866f8ac8/users/008a9394ff1843c99714f3c81c0a74c7/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:41:57.510547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ed180-b08c-40bb-9ace-c7dd05e5dece None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:57.510842 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ed180-b08c-40bb-9ace-c7dd05e5dece None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:57.511119 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ed180-b08c-40bb-9ace-c7dd05e5dece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:57.538961 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-070ed180-b08c-40bb-9ace-c7dd05e5dece None None] MFA Rules not processed for user `008a9394ff1843c99714f3c81c0a74c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:57.540144 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-070ed180-b08c-40bb-9ace-c7dd05e5dece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:57.606473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1320/2629] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:57.612031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c211c4d-b6cd-498d-bc28-7a11262f5b0a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:57.675084 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c211c4d-b6cd-498d-bc28-7a11262f5b0a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:57.680142 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc08a1-316d-4419-bb68-ad79ad8682dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:57.680817 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc08a1-316d-4419-bb68-ad79ad8682dd admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:57.681100 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc08a1-316d-4419-bb68-ad79ad8682dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:57.681385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc08a1-316d-4419-bb68-ad79ad8682dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:57.682081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc08a1-316d-4419-bb68-ad79ad8682dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:57.684083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc08a1-316d-4419-bb68-ad79ad8682dd admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:57.709279 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1310/2630] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:41:57 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:57.713397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ed180-b08c-40bb-9ace-c7dd05e5dece None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:57.724417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ed180-b08c-40bb-9ace-c7dd05e5dece None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:57.777325 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3954ec-560e-4758-9f7e-6b2b91f847a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:57.777935 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3954ec-560e-4758-9f7e-6b2b91f847a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:57.778239 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3954ec-560e-4758-9f7e-6b2b91f847a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:57.778515 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3954ec-560e-4758-9f7e-6b2b91f847a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:57.779200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3954ec-560e-4758-9f7e-6b2b91f847a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:57.781632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3954ec-560e-4758-9f7e-6b2b91f847a6 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:57.800377 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1321/2631] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:41:57 2022] POST /identity/v3/users => generated 298 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:41:57.804393 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc08a1-316d-4419-bb68-ad79ad8682dd admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:57.815404 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc08a1-316d-4419-bb68-ad79ad8682dd admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:57.820094 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56584675-e101-4343-b53f-19acd640ff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:57.820752 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56584675-e101-4343-b53f-19acd640ff49 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:57.821039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56584675-e101-4343-b53f-19acd640ff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:57.821607 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56584675-e101-4343-b53f-19acd640ff49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:57.822487 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56584675-e101-4343-b53f-19acd640ff49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:57.824126 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56584675-e101-4343-b53f-19acd640ff49 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:57.835581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1311/2632] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:57.839554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3954ec-560e-4758-9f7e-6b2b91f847a6 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:57.850319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3954ec-560e-4758-9f7e-6b2b91f847a6 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:57.855030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ce410-5a0a-4d22-9e8f-b862076a125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:57.855898 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ce410-5a0a-4d22-9e8f-b862076a125d admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:57.856176 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ce410-5a0a-4d22-9e8f-b862076a125d admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:57.856446 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ce410-5a0a-4d22-9e8f-b862076a125d admin admin] PATH_INFO: `/v3/projects/aa041d11890847ddb00266e820c48ddf/users/39b3067cd2e04acb8cd604a39b4dff31/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:57.870669 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ce410-5a0a-4d22-9e8f-b862076a125d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa041d11890847ddb00266e820c48ddf, user_id=39b3067cd2e04acb8cd604a39b4dff31, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:57.873330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ce410-5a0a-4d22-9e8f-b862076a125d admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:57.886252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1322/2633] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:57 2022] PUT /identity/v3/projects/aa041d11890847ddb00266e820c48ddf/users/39b3067cd2e04acb8cd604a39b4dff31/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:57.890813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56584675-e101-4343-b53f-19acd640ff49 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:57.900750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56584675-e101-4343-b53f-19acd640ff49 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:57.957560 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5e18d-1d30-4d46-aaa1-5ddd45294e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:57.958266 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5e18d-1d30-4d46-aaa1-5ddd45294e37 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:57.958562 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5e18d-1d30-4d46-aaa1-5ddd45294e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:57.958838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5e18d-1d30-4d46-aaa1-5ddd45294e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:57.959566 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5e18d-1d30-4d46-aaa1-5ddd45294e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:57.961176 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5e18d-1d30-4d46-aaa1-5ddd45294e37 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:57.977170 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1312/2634] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:41:57.981617 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ce410-5a0a-4d22-9e8f-b862076a125d admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:57.992463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ce410-5a0a-4d22-9e8f-b862076a125d admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:57.997068 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0adcfb-4304-41a4-a7b8-0e831c9aa81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:57.997943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0adcfb-4304-41a4-a7b8-0e831c9aa81e admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:57.998247 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0adcfb-4304-41a4-a7b8-0e831c9aa81e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:57.998526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0adcfb-4304-41a4-a7b8-0e831c9aa81e admin admin] PATH_INFO: `/v3/projects/aa041d11890847ddb00266e820c48ddf/users/39b3067cd2e04acb8cd604a39b4dff31/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:58.001111 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0adcfb-4304-41a4-a7b8-0e831c9aa81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa041d11890847ddb00266e820c48ddf, user_id=39b3067cd2e04acb8cd604a39b4dff31, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:58.003809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0adcfb-4304-41a4-a7b8-0e831c9aa81e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:58.014118 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1323/2635] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:41:57 2022] PUT /identity/v3/projects/aa041d11890847ddb00266e820c48ddf/users/39b3067cd2e04acb8cd604a39b4dff31/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:58.025031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c595c-00e1-49fb-a0e2-678239eb9864 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:58.025326 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c595c-00e1-49fb-a0e2-678239eb9864 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:58.025609 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c595c-00e1-49fb-a0e2-678239eb9864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:58.052754 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-685c595c-00e1-49fb-a0e2-678239eb9864 None None] MFA Rules not processed for user `39b3067cd2e04acb8cd604a39b4dff31`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:58.053890 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-685c595c-00e1-49fb-a0e2-678239eb9864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:58.121080 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1313/2636] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:58.132330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0adcfb-4304-41a4-a7b8-0e831c9aa81e admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:58.134052 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ee0adcfb-4304-41a4-a7b8-0e831c9aa81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:58.190324 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0adcfb-4304-41a4-a7b8-0e831c9aa81e admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:58.194038 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6ded6-3367-4bb6-8671-42fba7b7763f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:58.194714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6ded6-3367-4bb6-8671-42fba7b7763f service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:58.195001 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6ded6-3367-4bb6-8671-42fba7b7763f service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:58.195278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6ded6-3367-4bb6-8671-42fba7b7763f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:58.204912 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6ded6-3367-4bb6-8671-42fba7b7763f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:58.206405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6ded6-3367-4bb6-8671-42fba7b7763f service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:58.215728 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1324/2637] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:58.312684 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c595c-00e1-49fb-a0e2-678239eb9864 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:58.322399 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c595c-00e1-49fb-a0e2-678239eb9864 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:58.325896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ec75c-54a4-4672-9c8b-87ac294ca97d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:58.326585 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ec75c-54a4-4672-9c8b-87ac294ca97d service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:58.326914 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ec75c-54a4-4672-9c8b-87ac294ca97d service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:58.327351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ec75c-54a4-4672-9c8b-87ac294ca97d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:58.383394 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ec75c-54a4-4672-9c8b-87ac294ca97d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:58.384846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ec75c-54a4-4672-9c8b-87ac294ca97d service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:58.394497 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1314/2638] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:58.570941 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6ded6-3367-4bb6-8671-42fba7b7763f service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:58.572624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6ee6ded6-3367-4bb6-8671-42fba7b7763f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:58.649973 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6ded6-3367-4bb6-8671-42fba7b7763f service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:58.656393 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fab78-8250-41f4-87ee-158f5f26aa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:58.657590 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fab78-8250-41f4-87ee-158f5f26aa1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:58.657884 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fab78-8250-41f4-87ee-158f5f26aa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:58.658167 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fab78-8250-41f4-87ee-158f5f26aa1f admin admin] PATH_INFO: `/v3/users/6548cb2b65594937867512c7346d315c` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:58.659540 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fab78-8250-41f4-87ee-158f5f26aa1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6548cb2b65594937867512c7346d315c)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:58.661641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fab78-8250-41f4-87ee-158f5f26aa1f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:58.712545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-758fab78-8250-41f4-87ee-158f5f26aa1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6548cb2b65594937867512c7346d315c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:58.721066 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-758fab78-8250-41f4-87ee-158f5f26aa1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6548cb2b65594937867512c7346d315c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:58.721752 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-758fab78-8250-41f4-87ee-158f5f26aa1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6548cb2b65594937867512c7346d315c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:58.735470 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-758fab78-8250-41f4-87ee-158f5f26aa1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6548cb2b65594937867512c7346d315c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:58.742101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-758fab78-8250-41f4-87ee-158f5f26aa1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6548cb2b65594937867512c7346d315c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:58.748463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1325/2639] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:58 2022] DELETE /identity/v3/users/6548cb2b65594937867512c7346d315c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:58.753818 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12accc1-ec13-4777-8594-d89874b5db8d None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:58.754136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12accc1-ec13-4777-8594-d89874b5db8d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:58.754497 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12accc1-ec13-4777-8594-d89874b5db8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:58.771933 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-c12accc1-ec13-4777-8594-d89874b5db8d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:58.773121 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c12accc1-ec13-4777-8594-d89874b5db8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:58.831169 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1315/2640] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:58.840444 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fab78-8250-41f4-87ee-158f5f26aa1f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:58.841808 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-758fab78-8250-41f4-87ee-158f5f26aa1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:58.896775 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fab78-8250-41f4-87ee-158f5f26aa1f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:58.900499 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abe3ef-243e-424d-82b9-d8e2117cbc46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:58.901136 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe3ef-243e-424d-82b9-d8e2117cbc46 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:58.901413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe3ef-243e-424d-82b9-d8e2117cbc46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:58.901691 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe3ef-243e-424d-82b9-d8e2117cbc46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:58.911341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abe3ef-243e-424d-82b9-d8e2117cbc46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:58.912760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abe3ef-243e-424d-82b9-d8e2117cbc46 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:58.921963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1326/2641] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:41:59.177736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12accc1-ec13-4777-8594-d89874b5db8d None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:59.179261 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c12accc1-ec13-4777-8594-d89874b5db8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:59.192792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12accc1-ec13-4777-8594-d89874b5db8d None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:59.198144 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d668d-1ebf-47c5-8355-d52c1a4335d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:59.199580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d668d-1ebf-47c5-8355-d52c1a4335d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:59.200244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d668d-1ebf-47c5-8355-d52c1a4335d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:59.200244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d668d-1ebf-47c5-8355-d52c1a4335d0 admin admin] PATH_INFO: `/v3/projects/381eabe5ae2d4123940682eac6a44ece` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:59.201624 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d668d-1ebf-47c5-8355-d52c1a4335d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=381eabe5ae2d4123940682eac6a44ece)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:59.204578 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d668d-1ebf-47c5-8355-d52c1a4335d0 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:59.252548 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-091d668d-1ebf-47c5-8355-d52c1a4335d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381eabe5ae2d4123940682eac6a44ece', 'request_id': 'req-091d668d-1ebf-47c5-8355-d52c1a4335d0'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:59.258660 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-091d668d-1ebf-47c5-8355-d52c1a4335d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381eabe5ae2d4123940682eac6a44ece', 'request_id': 'req-091d668d-1ebf-47c5-8355-d52c1a4335d0'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:59.266652 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-091d668d-1ebf-47c5-8355-d52c1a4335d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381eabe5ae2d4123940682eac6a44ece', 'request_id': 'req-091d668d-1ebf-47c5-8355-d52c1a4335d0'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:59.277080 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-091d668d-1ebf-47c5-8355-d52c1a4335d0 admin admin] The token cache is being invalidate because project 381eabe5ae2d4123940682eac6a44ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:59.277365 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-091d668d-1ebf-47c5-8355-d52c1a4335d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:59.277974 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-091d668d-1ebf-47c5-8355-d52c1a4335d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:59.279536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1316/2642] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:59 2022] DELETE /identity/v3/projects/381eabe5ae2d4123940682eac6a44ece => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:59.283590 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abe3ef-243e-424d-82b9-d8e2117cbc46 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:59.293288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abe3ef-243e-424d-82b9-d8e2117cbc46 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:59.348614 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb652a1-4467-4b65-9072-6c70df09adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:59.349504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb652a1-4467-4b65-9072-6c70df09adc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:59.349787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb652a1-4467-4b65-9072-6c70df09adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:59.350062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb652a1-4467-4b65-9072-6c70df09adc7 admin admin] PATH_INFO: `/v3/users/9110dc613adc49e8affd52cd8c15aa63` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:59.351307 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb652a1-4467-4b65-9072-6c70df09adc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9110dc613adc49e8affd52cd8c15aa63)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:59.353224 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb652a1-4467-4b65-9072-6c70df09adc7 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:59.396174 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2eb652a1-4467-4b65-9072-6c70df09adc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9110dc613adc49e8affd52cd8c15aa63'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:59.403227 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2eb652a1-4467-4b65-9072-6c70df09adc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9110dc613adc49e8affd52cd8c15aa63'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:59.403838 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2eb652a1-4467-4b65-9072-6c70df09adc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9110dc613adc49e8affd52cd8c15aa63'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:59.416018 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2eb652a1-4467-4b65-9072-6c70df09adc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9110dc613adc49e8affd52cd8c15aa63'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:59.422776 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2eb652a1-4467-4b65-9072-6c70df09adc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9110dc613adc49e8affd52cd8c15aa63'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:59.428695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1327/2643] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:41:59 2022] DELETE /identity/v3/users/9110dc613adc49e8affd52cd8c15aa63 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:59.694918 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d668d-1ebf-47c5-8355-d52c1a4335d0 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:41:59.696674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-091d668d-1ebf-47c5-8355-d52c1a4335d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:59.716302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d668d-1ebf-47c5-8355-d52c1a4335d0 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:41:59.785594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4f6e6-18ac-412f-b76c-6f6cb1a44e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:41:59.786507 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4f6e6-18ac-412f-b76c-6f6cb1a44e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:59.786910 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4f6e6-18ac-412f-b76c-6f6cb1a44e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:59.787189 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4f6e6-18ac-412f-b76c-6f6cb1a44e85 admin admin] PATH_INFO: `/v3/projects/178fb111145a4def8ec4f5b64e2e24e1` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:59.788363 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4f6e6-18ac-412f-b76c-6f6cb1a44e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=178fb111145a4def8ec4f5b64e2e24e1)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:41:59.790328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4f6e6-18ac-412f-b76c-6f6cb1a44e85 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:41:59.838348 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-9ba4f6e6-18ac-412f-b76c-6f6cb1a44e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178fb111145a4def8ec4f5b64e2e24e1', 'request_id': 'req-9ba4f6e6-18ac-412f-b76c-6f6cb1a44e85'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:59.844945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-9ba4f6e6-18ac-412f-b76c-6f6cb1a44e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178fb111145a4def8ec4f5b64e2e24e1', 'request_id': 'req-9ba4f6e6-18ac-412f-b76c-6f6cb1a44e85'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:59.852746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-9ba4f6e6-18ac-412f-b76c-6f6cb1a44e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178fb111145a4def8ec4f5b64e2e24e1', 'request_id': 'req-9ba4f6e6-18ac-412f-b76c-6f6cb1a44e85'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:59.862938 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-9ba4f6e6-18ac-412f-b76c-6f6cb1a44e85 admin admin] The token cache is being invalidate because project 178fb111145a4def8ec4f5b64e2e24e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:41:59.863225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-9ba4f6e6-18ac-412f-b76c-6f6cb1a44e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:59.863849 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-9ba4f6e6-18ac-412f-b76c-6f6cb1a44e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:41:59.865488 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1317/2644] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:41:59 2022] DELETE /identity/v3/projects/178fb111145a4def8ec4f5b64e2e24e1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:41:59.870293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8489b-a05a-48eb-8c1d-f0984da68e18 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:59.870585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8489b-a05a-48eb-8c1d-f0984da68e18 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:59.870868 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8489b-a05a-48eb-8c1d-f0984da68e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:59.892015 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-27a8489b-a05a-48eb-8c1d-f0984da68e18 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:59.893289 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-27a8489b-a05a-48eb-8c1d-f0984da68e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:59.955903 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1328/2645] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:59.963769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4bd53-3128-475d-8244-4416e04c7348 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:41:59.964059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4bd53-3128-475d-8244-4416e04c7348 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:41:59.964344 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4bd53-3128-475d-8244-4416e04c7348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:41:59.982482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-adf4bd53-3128-475d-8244-4416e04c7348 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:41:59.983736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-adf4bd53-3128-475d-8244-4416e04c7348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:41:59.991489 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1318/2646] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:41:59.995665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8489b-a05a-48eb-8c1d-f0984da68e18 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:00.006031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8489b-a05a-48eb-8c1d-f0984da68e18 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:00.010656 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745322a4-4131-4f9e-9c48-68b9903eab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:00.011308 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745322a4-4131-4f9e-9c48-68b9903eab83 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:00.011594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745322a4-4131-4f9e-9c48-68b9903eab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:00.011874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745322a4-4131-4f9e-9c48-68b9903eab83 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:00.012599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745322a4-4131-4f9e-9c48-68b9903eab83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:42:00.012916 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745322a4-4131-4f9e-9c48-68b9903eab83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:00.015279 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745322a4-4131-4f9e-9c48-68b9903eab83 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:00.026538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1329/2647] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:42:00.030971 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4bd53-3128-475d-8244-4416e04c7348 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:00.040023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4bd53-3128-475d-8244-4416e04c7348 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:00.044896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed82df-c8db-41eb-8254-c92d1d49383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:00.045587 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed82df-c8db-41eb-8254-c92d1d49383b admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:00.045992 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed82df-c8db-41eb-8254-c92d1d49383b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:00.046227 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed82df-c8db-41eb-8254-c92d1d49383b admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:00.046953 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed82df-c8db-41eb-8254-c92d1d49383b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:00.048844 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed82df-c8db-41eb-8254-c92d1d49383b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:00.074510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1319/2648] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:42:00 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:42:00.078875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745322a4-4131-4f9e-9c48-68b9903eab83 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:00.088796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745322a4-4131-4f9e-9c48-68b9903eab83 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:00.145922 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cff510-53fb-40e6-916e-18a268a2098e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:00.146621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cff510-53fb-40e6-916e-18a268a2098e admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:00.146931 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cff510-53fb-40e6-916e-18a268a2098e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:00.147267 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cff510-53fb-40e6-916e-18a268a2098e admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:00.148019 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cff510-53fb-40e6-916e-18a268a2098e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:00.150042 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cff510-53fb-40e6-916e-18a268a2098e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:00.169491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1330/2649] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:42:00 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:42:00.174349 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed82df-c8db-41eb-8254-c92d1d49383b admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:00.184442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed82df-c8db-41eb-8254-c92d1d49383b admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:00.189912 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f73a6-9402-4d85-a3ac-50f36634439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:00.190558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f73a6-9402-4d85-a3ac-50f36634439d admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:00.190843 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f73a6-9402-4d85-a3ac-50f36634439d admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:00.191120 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f73a6-9402-4d85-a3ac-50f36634439d admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:00.191848 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f73a6-9402-4d85-a3ac-50f36634439d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:00.193474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f73a6-9402-4d85-a3ac-50f36634439d admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:00.205620 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1320/2650] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:42:00.209800 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cff510-53fb-40e6-916e-18a268a2098e admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:00.220487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cff510-53fb-40e6-916e-18a268a2098e admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:00.225160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b0ea6-da43-487b-aeed-9de7dc8ffc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:00.225813 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b0ea6-da43-487b-aeed-9de7dc8ffc50 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:00.226097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b0ea6-da43-487b-aeed-9de7dc8ffc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:00.226404 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b0ea6-da43-487b-aeed-9de7dc8ffc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:00.227132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b0ea6-da43-487b-aeed-9de7dc8ffc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:00.228726 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b0ea6-da43-487b-aeed-9de7dc8ffc50 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:00.238860 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1331/2651] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:42:00.243094 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f73a6-9402-4d85-a3ac-50f36634439d admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:00.253405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f73a6-9402-4d85-a3ac-50f36634439d admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:00.258051 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffb83f-8301-4f3c-925c-82e9f38c2645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:00.258994 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffb83f-8301-4f3c-925c-82e9f38c2645 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:00.259282 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffb83f-8301-4f3c-925c-82e9f38c2645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:00.259560 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffb83f-8301-4f3c-925c-82e9f38c2645 admin admin] PATH_INFO: `/v3/projects/fd506bb390ac4112ac56544daa757ef6/users/e3580522d57b401aa48766396b5c93c9/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:00.275392 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffb83f-8301-4f3c-925c-82e9f38c2645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd506bb390ac4112ac56544daa757ef6, user_id=e3580522d57b401aa48766396b5c93c9, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:00.278089 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffb83f-8301-4f3c-925c-82e9f38c2645 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:00.291342 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1321/2652] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:42:00 2022] PUT /identity/v3/projects/fd506bb390ac4112ac56544daa757ef6/users/e3580522d57b401aa48766396b5c93c9/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:42:00.301751 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee6583-810c-40a5-9894-efb5a02bd87a None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:00.302256 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee6583-810c-40a5-9894-efb5a02bd87a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:00.302374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee6583-810c-40a5-9894-efb5a02bd87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:00.329097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-1aee6583-810c-40a5-9894-efb5a02bd87a None None] MFA Rules not processed for user `e3580522d57b401aa48766396b5c93c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:42:00.330346 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-1aee6583-810c-40a5-9894-efb5a02bd87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:00.393758 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1332/2653] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:42:00.404373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffb83f-8301-4f3c-925c-82e9f38c2645 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:00.406880 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-68ffb83f-8301-4f3c-925c-82e9f38c2645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:00.463249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffb83f-8301-4f3c-925c-82e9f38c2645 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:00.466771 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb69525-8fe9-4b63-ada0-b7df4ac9d625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:00.468096 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb69525-8fe9-4b63-ada0-b7df4ac9d625 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:00.468504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb69525-8fe9-4b63-ada0-b7df4ac9d625 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:00.468787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb69525-8fe9-4b63-ada0-b7df4ac9d625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:00.477141 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb69525-8fe9-4b63-ada0-b7df4ac9d625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:00.478622 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb69525-8fe9-4b63-ada0-b7df4ac9d625 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:00.487451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1322/2654] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:42:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:42:00.973650 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee6583-810c-40a5-9894-efb5a02bd87a None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:00.975072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-1aee6583-810c-40a5-9894-efb5a02bd87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:01.037642 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee6583-810c-40a5-9894-efb5a02bd87a None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:01.042110 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45266a-c19e-4eb3-8692-5388ef123f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:01.043020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45266a-c19e-4eb3-8692-5388ef123f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:01.043300 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45266a-c19e-4eb3-8692-5388ef123f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:01.043678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45266a-c19e-4eb3-8692-5388ef123f13 admin admin] PATH_INFO: `/v3/users/008a9394ff1843c99714f3c81c0a74c7` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:01.044851 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45266a-c19e-4eb3-8692-5388ef123f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=008a9394ff1843c99714f3c81c0a74c7)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:01.047327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45266a-c19e-4eb3-8692-5388ef123f13 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:01.093396 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7e45266a-c19e-4eb3-8692-5388ef123f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008a9394ff1843c99714f3c81c0a74c7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:01.100568 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7e45266a-c19e-4eb3-8692-5388ef123f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008a9394ff1843c99714f3c81c0a74c7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:01.101201 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7e45266a-c19e-4eb3-8692-5388ef123f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008a9394ff1843c99714f3c81c0a74c7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:01.112666 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7e45266a-c19e-4eb3-8692-5388ef123f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008a9394ff1843c99714f3c81c0a74c7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:01.119271 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7e45266a-c19e-4eb3-8692-5388ef123f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008a9394ff1843c99714f3c81c0a74c7'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:01.125135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1333/2655] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:42:00 2022] DELETE /identity/v3/users/008a9394ff1843c99714f3c81c0a74c7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:42:01.129592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7193b8-0c2e-4c23-9a54-162213b34476 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:01.129879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7193b8-0c2e-4c23-9a54-162213b34476 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:01.130155 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7193b8-0c2e-4c23-9a54-162213b34476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:01.147330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-3a7193b8-0c2e-4c23-9a54-162213b34476 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:42:01.148505 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3a7193b8-0c2e-4c23-9a54-162213b34476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:01.207385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1323/2656] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:42:01.216928 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45266a-c19e-4eb3-8692-5388ef123f13 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:01.219039 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7e45266a-c19e-4eb3-8692-5388ef123f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:01.274601 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45266a-c19e-4eb3-8692-5388ef123f13 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:01.278654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416c76c-69ba-42c8-9c67-d3535ebd1228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:01.279330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416c76c-69ba-42c8-9c67-d3535ebd1228 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:01.279608 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416c76c-69ba-42c8-9c67-d3535ebd1228 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:01.280464 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416c76c-69ba-42c8-9c67-d3535ebd1228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:01.289376 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416c76c-69ba-42c8-9c67-d3535ebd1228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:01.290842 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416c76c-69ba-42c8-9c67-d3535ebd1228 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:01.300233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1334/2657] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:42:01.566548 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7193b8-0c2e-4c23-9a54-162213b34476 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:01.567976 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3a7193b8-0c2e-4c23-9a54-162213b34476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:01.580985 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7193b8-0c2e-4c23-9a54-162213b34476 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:01.585792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:01.586774 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:01.587117 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:01.587456 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de admin admin] PATH_INFO: `/v3/projects/35edc2b28a3745468765e97d866f8ac8` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:01.588723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de admin admin] RBAC: Authorizing `identity:delete_project(project_id=35edc2b28a3745468765e97d866f8ac8)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:01.590974 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:01.637850 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35edc2b28a3745468765e97d866f8ac8', 'request_id': 'req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:01.645435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35edc2b28a3745468765e97d866f8ac8', 'request_id': 'req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:01.651926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35edc2b28a3745468765e97d866f8ac8', 'request_id': 'req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:01.662733 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de admin admin] The token cache is being invalidate because project 35edc2b28a3745468765e97d866f8ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:42:01.663025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:01.663656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:01.665200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1324/2658] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:42:01 2022] DELETE /identity/v3/projects/35edc2b28a3745468765e97d866f8ac8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:42:01.669178 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416c76c-69ba-42c8-9c67-d3535ebd1228 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:01.680022 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416c76c-69ba-42c8-9c67-d3535ebd1228 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:01.735885 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c2931-f0e8-400a-a256-7e880a15022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:01.736753 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c2931-f0e8-400a-a256-7e880a15022e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:01.737036 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c2931-f0e8-400a-a256-7e880a15022e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:01.737314 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c2931-f0e8-400a-a256-7e880a15022e admin admin] PATH_INFO: `/v3/users/39b3067cd2e04acb8cd604a39b4dff31` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:01.738582 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c2931-f0e8-400a-a256-7e880a15022e admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b3067cd2e04acb8cd604a39b4dff31)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:01.740535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c2931-f0e8-400a-a256-7e880a15022e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:01.786474 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-678c2931-f0e8-400a-a256-7e880a15022e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b3067cd2e04acb8cd604a39b4dff31'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:01.793748 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-678c2931-f0e8-400a-a256-7e880a15022e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b3067cd2e04acb8cd604a39b4dff31'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:01.794462 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-678c2931-f0e8-400a-a256-7e880a15022e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b3067cd2e04acb8cd604a39b4dff31'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:01.806700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-678c2931-f0e8-400a-a256-7e880a15022e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b3067cd2e04acb8cd604a39b4dff31'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:01.813459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-678c2931-f0e8-400a-a256-7e880a15022e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b3067cd2e04acb8cd604a39b4dff31'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:01.819385 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1335/2659] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:42:01 2022] DELETE /identity/v3/users/39b3067cd2e04acb8cd604a39b4dff31 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:42:02.111355 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:02.113053 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:02.136687 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e46cf3-d677-4dfb-a6e1-5c4ba92110de admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:02.202850 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ac1fd-a744-448a-ad44-9b9ac2edab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:02.203776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ac1fd-a744-448a-ad44-9b9ac2edab93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:02.204054 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ac1fd-a744-448a-ad44-9b9ac2edab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:02.204327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ac1fd-a744-448a-ad44-9b9ac2edab93 admin admin] PATH_INFO: `/v3/projects/aa041d11890847ddb00266e820c48ddf` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:02.205523 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ac1fd-a744-448a-ad44-9b9ac2edab93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa041d11890847ddb00266e820c48ddf)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:02.207503 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ac1fd-a744-448a-ad44-9b9ac2edab93 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:02.257986 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ee6ac1fd-a744-448a-ad44-9b9ac2edab93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa041d11890847ddb00266e820c48ddf', 'request_id': 'req-ee6ac1fd-a744-448a-ad44-9b9ac2edab93'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:02.265327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ee6ac1fd-a744-448a-ad44-9b9ac2edab93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa041d11890847ddb00266e820c48ddf', 'request_id': 'req-ee6ac1fd-a744-448a-ad44-9b9ac2edab93'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:02.272768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ee6ac1fd-a744-448a-ad44-9b9ac2edab93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa041d11890847ddb00266e820c48ddf', 'request_id': 'req-ee6ac1fd-a744-448a-ad44-9b9ac2edab93'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:02.290378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ee6ac1fd-a744-448a-ad44-9b9ac2edab93 admin admin] The token cache is being invalidate because project aa041d11890847ddb00266e820c48ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:42:02.290669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ee6ac1fd-a744-448a-ad44-9b9ac2edab93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:02.291351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ee6ac1fd-a744-448a-ad44-9b9ac2edab93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:02.292907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1325/2660] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:42:02 2022] DELETE /identity/v3/projects/aa041d11890847ddb00266e820c48ddf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:42:02.297950 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8059442-585f-46fd-b664-27593235f0d9 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:02.298261 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8059442-585f-46fd-b664-27593235f0d9 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:02.298542 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8059442-585f-46fd-b664-27593235f0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:02.317327 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-e8059442-585f-46fd-b664-27593235f0d9 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:42:02.318570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e8059442-585f-46fd-b664-27593235f0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:02.379532 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1336/2661] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:42:02.388023 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ec442-b0fa-4ba4-99a4-83c017e58856 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:02.388311 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ec442-b0fa-4ba4-99a4-83c017e58856 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:02.388588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ec442-b0fa-4ba4-99a4-83c017e58856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:02.409328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-538ec442-b0fa-4ba4-99a4-83c017e58856 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:42:02.409937 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-538ec442-b0fa-4ba4-99a4-83c017e58856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:02.418573 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1326/2662] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:42:02.422969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8059442-585f-46fd-b664-27593235f0d9 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:02.434074 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8059442-585f-46fd-b664-27593235f0d9 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:02.439907 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd5bcb-1506-4eeb-813f-77b1e05e73cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:02.440673 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd5bcb-1506-4eeb-813f-77b1e05e73cd admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:02.441048 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd5bcb-1506-4eeb-813f-77b1e05e73cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:02.441399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd5bcb-1506-4eeb-813f-77b1e05e73cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:02.442250 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd5bcb-1506-4eeb-813f-77b1e05e73cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:42:02.442659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd5bcb-1506-4eeb-813f-77b1e05e73cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:02.444368 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd5bcb-1506-4eeb-813f-77b1e05e73cd admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:02.457646 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1337/2663] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:42:02.461975 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ec442-b0fa-4ba4-99a4-83c017e58856 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:02.471188 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ec442-b0fa-4ba4-99a4-83c017e58856 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:02.476264 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f20ce-d5cc-4dd7-950c-fdeae24d2671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:02.476988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f20ce-d5cc-4dd7-950c-fdeae24d2671 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:02.477274 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f20ce-d5cc-4dd7-950c-fdeae24d2671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:02.477585 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f20ce-d5cc-4dd7-950c-fdeae24d2671 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:02.478350 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f20ce-d5cc-4dd7-950c-fdeae24d2671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:02.480266 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f20ce-d5cc-4dd7-950c-fdeae24d2671 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:02.507600 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1327/2664] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:42:02 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:42:02.510497 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd5bcb-1506-4eeb-813f-77b1e05e73cd admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:02.520269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd5bcb-1506-4eeb-813f-77b1e05e73cd admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:02.576431 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce60d4b-7d2d-4398-856f-f6aa95c8cd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:02.577078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce60d4b-7d2d-4398-856f-f6aa95c8cd48 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:02.577447 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce60d4b-7d2d-4398-856f-f6aa95c8cd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:02.577805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce60d4b-7d2d-4398-856f-f6aa95c8cd48 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:02.578528 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce60d4b-7d2d-4398-856f-f6aa95c8cd48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:02.580495 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce60d4b-7d2d-4398-856f-f6aa95c8cd48 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:02.602295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1338/2665] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:42:02 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:42:02.606473 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f20ce-d5cc-4dd7-950c-fdeae24d2671 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:02.617231 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f20ce-d5cc-4dd7-950c-fdeae24d2671 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:02.622277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f7552-1d43-4cd9-953c-9c8ab5bb6dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:02.622995 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f7552-1d43-4cd9-953c-9c8ab5bb6dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:02.623290 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f7552-1d43-4cd9-953c-9c8ab5bb6dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:02.623664 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f7552-1d43-4cd9-953c-9c8ab5bb6dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:02.624882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f7552-1d43-4cd9-953c-9c8ab5bb6dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:02.626632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f7552-1d43-4cd9-953c-9c8ab5bb6dd1 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:02.637890 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1328/2666] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:42:02.642860 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce60d4b-7d2d-4398-856f-f6aa95c8cd48 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:02.653492 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce60d4b-7d2d-4398-856f-f6aa95c8cd48 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:02.658577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbe2fb-cbe7-4912-bd50-a4c1068af47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:02.659267 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbe2fb-cbe7-4912-bd50-a4c1068af47c admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:02.659588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbe2fb-cbe7-4912-bd50-a4c1068af47c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:02.659862 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbe2fb-cbe7-4912-bd50-a4c1068af47c admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:02.660617 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbe2fb-cbe7-4912-bd50-a4c1068af47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:02.662433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbe2fb-cbe7-4912-bd50-a4c1068af47c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:02.673668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1339/2667] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:42:02.678245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f7552-1d43-4cd9-953c-9c8ab5bb6dd1 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:02.689379 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f7552-1d43-4cd9-953c-9c8ab5bb6dd1 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:02.693975 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f417ee-66b9-4620-988f-cb395ad4541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:02.694891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f417ee-66b9-4620-988f-cb395ad4541a admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:02.695171 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f417ee-66b9-4620-988f-cb395ad4541a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:02.695443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f417ee-66b9-4620-988f-cb395ad4541a admin admin] PATH_INFO: `/v3/projects/189edb6d176b499489fe58e20133a298/users/dd62bef03bd44dec9ae7c68d17cfc699/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:02.711556 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f417ee-66b9-4620-988f-cb395ad4541a admin admin] RBAC: Authorizing `identity:create_grant(project_id=189edb6d176b499489fe58e20133a298, user_id=dd62bef03bd44dec9ae7c68d17cfc699, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:02.714307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f417ee-66b9-4620-988f-cb395ad4541a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:02.726987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1329/2668] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:42:02 2022] PUT /identity/v3/projects/189edb6d176b499489fe58e20133a298/users/dd62bef03bd44dec9ae7c68d17cfc699/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:42:02.737965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e240b-64ca-4587-a55b-0da054cd4f15 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:02.738298 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e240b-64ca-4587-a55b-0da054cd4f15 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:02.738586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e240b-64ca-4587-a55b-0da054cd4f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:02.766794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-7d6e240b-64ca-4587-a55b-0da054cd4f15 None None] MFA Rules not processed for user `dd62bef03bd44dec9ae7c68d17cfc699`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:42:02.768034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7d6e240b-64ca-4587-a55b-0da054cd4f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:02.830334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1340/2669] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:42:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:42:02.841433 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f417ee-66b9-4620-988f-cb395ad4541a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:02.843667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d8f417ee-66b9-4620-988f-cb395ad4541a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:02.898681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f417ee-66b9-4620-988f-cb395ad4541a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:02.902321 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e475b8-8cb2-44ed-b4d9-e86ca455352f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34ff47d8c4f4d99955340ddbdc3d475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:02.903050 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e475b8-8cb2-44ed-b4d9-e86ca455352f service glance] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:02.903333 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e475b8-8cb2-44ed-b4d9-e86ca455352f service glance] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:02.903610 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e475b8-8cb2-44ed-b4d9-e86ca455352f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:02.912766 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e475b8-8cb2-44ed-b4d9-e86ca455352f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:02.914265 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e475b8-8cb2-44ed-b4d9-e86ca455352f service glance] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:02.923406 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1330/2670] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:42:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:42:03.482164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e240b-64ca-4587-a55b-0da054cd4f15 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:03.483665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-7d6e240b-64ca-4587-a55b-0da054cd4f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:03.550528 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e240b-64ca-4587-a55b-0da054cd4f15 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:03.555648 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b205f5-676f-4eb2-b8d8-e4dc9358b482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:03.556526 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b205f5-676f-4eb2-b8d8-e4dc9358b482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:03.556823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b205f5-676f-4eb2-b8d8-e4dc9358b482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:03.557164 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b205f5-676f-4eb2-b8d8-e4dc9358b482 admin admin] PATH_INFO: `/v3/users/e3580522d57b401aa48766396b5c93c9` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:03.558357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b205f5-676f-4eb2-b8d8-e4dc9358b482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3580522d57b401aa48766396b5c93c9)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:03.560325 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b205f5-676f-4eb2-b8d8-e4dc9358b482 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:03.607451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-27b205f5-676f-4eb2-b8d8-e4dc9358b482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3580522d57b401aa48766396b5c93c9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:03.614648 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-27b205f5-676f-4eb2-b8d8-e4dc9358b482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3580522d57b401aa48766396b5c93c9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:03.615269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-27b205f5-676f-4eb2-b8d8-e4dc9358b482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3580522d57b401aa48766396b5c93c9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:03.627510 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-27b205f5-676f-4eb2-b8d8-e4dc9358b482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3580522d57b401aa48766396b5c93c9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:03.634032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-27b205f5-676f-4eb2-b8d8-e4dc9358b482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3580522d57b401aa48766396b5c93c9'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:03.641257 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1341/2671] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:42:03 2022] DELETE /identity/v3/users/e3580522d57b401aa48766396b5c93c9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:42:03.646345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb974432-d0d8-43e1-a42a-b3fcfecee46c None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:03.646813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb974432-d0d8-43e1-a42a-b3fcfecee46c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:03.646919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb974432-d0d8-43e1-a42a-b3fcfecee46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:03.664845 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-bb974432-d0d8-43e1-a42a-b3fcfecee46c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:42:03.666381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bb974432-d0d8-43e1-a42a-b3fcfecee46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:03.731673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1331/2672] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:42:03.742065 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b205f5-676f-4eb2-b8d8-e4dc9358b482 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:03.743529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-27b205f5-676f-4eb2-b8d8-e4dc9358b482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:03.801415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b205f5-676f-4eb2-b8d8-e4dc9358b482 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:03.805156 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba75e66-9c04-4311-9ab6-efc70d7809b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:03.805795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba75e66-9c04-4311-9ab6-efc70d7809b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:03.806074 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba75e66-9c04-4311-9ab6-efc70d7809b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:03.806382 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba75e66-9c04-4311-9ab6-efc70d7809b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:03.815685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba75e66-9c04-4311-9ab6-efc70d7809b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:03.817096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba75e66-9c04-4311-9ab6-efc70d7809b6 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:03.826566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1342/2673] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:42:04.093621 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb974432-d0d8-43e1-a42a-b3fcfecee46c None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:04.095433 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bb974432-d0d8-43e1-a42a-b3fcfecee46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:04.109277 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb974432-d0d8-43e1-a42a-b3fcfecee46c None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:04.113978 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f40a75-6fd7-4175-ac73-28b6e01cd605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:04.114883 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f40a75-6fd7-4175-ac73-28b6e01cd605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:04.115160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f40a75-6fd7-4175-ac73-28b6e01cd605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:04.115429 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f40a75-6fd7-4175-ac73-28b6e01cd605 admin admin] PATH_INFO: `/v3/projects/fd506bb390ac4112ac56544daa757ef6` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:04.116644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f40a75-6fd7-4175-ac73-28b6e01cd605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd506bb390ac4112ac56544daa757ef6)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:04.118924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f40a75-6fd7-4175-ac73-28b6e01cd605 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:04.168158 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-39f40a75-6fd7-4175-ac73-28b6e01cd605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd506bb390ac4112ac56544daa757ef6', 'request_id': 'req-39f40a75-6fd7-4175-ac73-28b6e01cd605'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:04.174977 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-39f40a75-6fd7-4175-ac73-28b6e01cd605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd506bb390ac4112ac56544daa757ef6', 'request_id': 'req-39f40a75-6fd7-4175-ac73-28b6e01cd605'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:04.182508 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-39f40a75-6fd7-4175-ac73-28b6e01cd605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd506bb390ac4112ac56544daa757ef6', 'request_id': 'req-39f40a75-6fd7-4175-ac73-28b6e01cd605'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:04.195689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-39f40a75-6fd7-4175-ac73-28b6e01cd605 admin admin] The token cache is being invalidate because project fd506bb390ac4112ac56544daa757ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:42:04.195977 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-39f40a75-6fd7-4175-ac73-28b6e01cd605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:04.196868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-39f40a75-6fd7-4175-ac73-28b6e01cd605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:04.198444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1332/2674] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:42:04 2022] DELETE /identity/v3/projects/fd506bb390ac4112ac56544daa757ef6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:42:04.204484 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae0658-3dff-4934-a434-4debfc9f44f6 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:04.204768 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae0658-3dff-4934-a434-4debfc9f44f6 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:04.205046 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae0658-3dff-4934-a434-4debfc9f44f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:04.223012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-15ae0658-3dff-4934-a434-4debfc9f44f6 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:42:04.224209 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-15ae0658-3dff-4934-a434-4debfc9f44f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:04.283044 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1343/2675] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:42:04.291840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332004e2-f8bd-4163-9541-d1fd1d9624b2 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:04.292130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332004e2-f8bd-4163-9541-d1fd1d9624b2 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:04.292410 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332004e2-f8bd-4163-9541-d1fd1d9624b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:04.312360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-332004e2-f8bd-4163-9541-d1fd1d9624b2 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:42:04.313840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-332004e2-f8bd-4163-9541-d1fd1d9624b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:04.322044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1333/2676] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:42:04.326271 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae0658-3dff-4934-a434-4debfc9f44f6 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:04.335892 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae0658-3dff-4934-a434-4debfc9f44f6 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:04.340859 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ed80b-76bd-4704-98ab-585ff7c9198f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:04.342486 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ed80b-76bd-4704-98ab-585ff7c9198f admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:04.343169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ed80b-76bd-4704-98ab-585ff7c9198f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:04.343443 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ed80b-76bd-4704-98ab-585ff7c9198f admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:04.344137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ed80b-76bd-4704-98ab-585ff7c9198f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:42:04.344440 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ed80b-76bd-4704-98ab-585ff7c9198f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:04.346054 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ed80b-76bd-4704-98ab-585ff7c9198f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:04.358129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1344/2677] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:42:04.362901 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332004e2-f8bd-4163-9541-d1fd1d9624b2 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:04.372808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332004e2-f8bd-4163-9541-d1fd1d9624b2 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:04.377869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3bab4-4c6f-456e-80d3-89b8c0e490a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:04.378580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3bab4-4c6f-456e-80d3-89b8c0e490a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:04.378869 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3bab4-4c6f-456e-80d3-89b8c0e490a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:04.379154 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3bab4-4c6f-456e-80d3-89b8c0e490a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:04.379866 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3bab4-4c6f-456e-80d3-89b8c0e490a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:04.390013 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3bab4-4c6f-456e-80d3-89b8c0e490a5 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:04.411624 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1334/2678] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:42:04 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:42:04.415736 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ed80b-76bd-4704-98ab-585ff7c9198f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:04.427083 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ed80b-76bd-4704-98ab-585ff7c9198f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:04.485688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053772b-7b50-4c57-b32c-dc7ae019cdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:04.486390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053772b-7b50-4c57-b32c-dc7ae019cdac admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:04.486678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053772b-7b50-4c57-b32c-dc7ae019cdac admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:04.486957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053772b-7b50-4c57-b32c-dc7ae019cdac admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:04.487653 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053772b-7b50-4c57-b32c-dc7ae019cdac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:04.489582 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053772b-7b50-4c57-b32c-dc7ae019cdac admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:04.508758 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1345/2679] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:42:04 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:42:04.513220 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3bab4-4c6f-456e-80d3-89b8c0e490a5 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:04.523741 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3bab4-4c6f-456e-80d3-89b8c0e490a5 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:04.529332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667965e-a2c8-42de-a768-7e9a77e19dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:04.530617 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667965e-a2c8-42de-a768-7e9a77e19dcd admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:04.531094 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667965e-a2c8-42de-a768-7e9a77e19dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:04.531427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667965e-a2c8-42de-a768-7e9a77e19dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:04.532219 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667965e-a2c8-42de-a768-7e9a77e19dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:04.534055 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667965e-a2c8-42de-a768-7e9a77e19dcd admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:04.545225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1335/2680] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:42:04.549871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053772b-7b50-4c57-b32c-dc7ae019cdac admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:04.560080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053772b-7b50-4c57-b32c-dc7ae019cdac admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:04.565417 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b690b8c-3f56-4a1d-8b98-b05a0aa2c234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:04.566072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690b8c-3f56-4a1d-8b98-b05a0aa2c234 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:04.566390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690b8c-3f56-4a1d-8b98-b05a0aa2c234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:04.566701 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690b8c-3f56-4a1d-8b98-b05a0aa2c234 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:04.567429 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b690b8c-3f56-4a1d-8b98-b05a0aa2c234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:04.569089 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b690b8c-3f56-4a1d-8b98-b05a0aa2c234 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:04.580660 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1346/2681] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:42:04.584593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667965e-a2c8-42de-a768-7e9a77e19dcd admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:04.597152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667965e-a2c8-42de-a768-7e9a77e19dcd admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:04.602463 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba2971-bf9d-4849-a4f9-47b3c02937e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:04.603337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba2971-bf9d-4849-a4f9-47b3c02937e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:04.603615 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba2971-bf9d-4849-a4f9-47b3c02937e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:04.603884 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba2971-bf9d-4849-a4f9-47b3c02937e6 admin admin] PATH_INFO: `/v3/projects/e7e35a3220954105811b0beb6974fcca/users/b9309d543dd34cdd9f22779268ca3504/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:04.619132 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba2971-bf9d-4849-a4f9-47b3c02937e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e35a3220954105811b0beb6974fcca, user_id=b9309d543dd34cdd9f22779268ca3504, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:04.622581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba2971-bf9d-4849-a4f9-47b3c02937e6 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:04.636338 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1336/2682] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:42:04 2022] PUT /identity/v3/projects/e7e35a3220954105811b0beb6974fcca/users/b9309d543dd34cdd9f22779268ca3504/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:42:04.702475 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464ac8d-3220-4201-b8ed-959f5769206d None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:04.702771 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464ac8d-3220-4201-b8ed-959f5769206d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:04.703011 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464ac8d-3220-4201-b8ed-959f5769206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:04.730858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-8464ac8d-3220-4201-b8ed-959f5769206d None None] MFA Rules not processed for user `b9309d543dd34cdd9f22779268ca3504`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:42:04.732076 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-8464ac8d-3220-4201-b8ed-959f5769206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:04.797269 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1347/2683] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:42:04.809136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba2971-bf9d-4849-a4f9-47b3c02937e6 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:04.810902 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-cbba2971-bf9d-4849-a4f9-47b3c02937e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:04.869220 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba2971-bf9d-4849-a4f9-47b3c02937e6 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:04.872963 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c8849-d493-45d3-92ba-a6d1c98e9149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:04.873607 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c8849-d493-45d3-92ba-a6d1c98e9149 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:04.873956 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c8849-d493-45d3-92ba-a6d1c98e9149 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:04.874320 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c8849-d493-45d3-92ba-a6d1c98e9149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:04.883477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c8849-d493-45d3-92ba-a6d1c98e9149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:04.885060 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c8849-d493-45d3-92ba-a6d1c98e9149 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:04.895374 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1337/2684] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:42:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:42:19.593102 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464ac8d-3220-4201-b8ed-959f5769206d None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:19.603831 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464ac8d-3220-4201-b8ed-959f5769206d None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:19.607839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57e2fc-46e4-4c04-9afd-697ccb1498ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:19.608483 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57e2fc-46e4-4c04-9afd-697ccb1498ea service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:19.608768 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57e2fc-46e4-4c04-9afd-697ccb1498ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:19.609045 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57e2fc-46e4-4c04-9afd-697ccb1498ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:19.611451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-8e57e2fc-46e4-4c04-9afd-697ccb1498ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:19.700627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57e2fc-46e4-4c04-9afd-697ccb1498ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:19.702584 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57e2fc-46e4-4c04-9afd-697ccb1498ea service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:19.716796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1348/2685] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:42:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:42:28.650072 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c8849-d493-45d3-92ba-a6d1c98e9149 service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:28.651474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6b7c8849-d493-45d3-92ba-a6d1c98e9149 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:28.663379 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c8849-d493-45d3-92ba-a6d1c98e9149 service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:28.667056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7886b7-4d0b-425f-9ddc-ccc0fb9f719b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:28.667687 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7886b7-4d0b-425f-9ddc-ccc0fb9f719b service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:28.667975 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7886b7-4d0b-425f-9ddc-ccc0fb9f719b service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:28.668250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7886b7-4d0b-425f-9ddc-ccc0fb9f719b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:28.669987 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bf7886b7-4d0b-425f-9ddc-ccc0fb9f719b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:28.683545 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7886b7-4d0b-425f-9ddc-ccc0fb9f719b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:28.684967 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7886b7-4d0b-425f-9ddc-ccc0fb9f719b service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:28.696700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1338/2686] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:42:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:42:30.915560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57e2fc-46e4-4c04-9afd-697ccb1498ea service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:30.917004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-8e57e2fc-46e4-4c04-9afd-697ccb1498ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:30.981330 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57e2fc-46e4-4c04-9afd-697ccb1498ea service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:30.985844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37d57e-efe8-46b6-8349-164cf747adea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:30.986737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37d57e-efe8-46b6-8349-164cf747adea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:30.987020 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37d57e-efe8-46b6-8349-164cf747adea admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:30.987295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37d57e-efe8-46b6-8349-164cf747adea admin admin] PATH_INFO: `/v3/users/dd62bef03bd44dec9ae7c68d17cfc699` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:30.988461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37d57e-efe8-46b6-8349-164cf747adea admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd62bef03bd44dec9ae7c68d17cfc699)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:30.991030 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37d57e-efe8-46b6-8349-164cf747adea admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:31.036566 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6e37d57e-efe8-46b6-8349-164cf747adea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd62bef03bd44dec9ae7c68d17cfc699'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:31.043508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6e37d57e-efe8-46b6-8349-164cf747adea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd62bef03bd44dec9ae7c68d17cfc699'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:31.044116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6e37d57e-efe8-46b6-8349-164cf747adea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd62bef03bd44dec9ae7c68d17cfc699'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:31.055903 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6e37d57e-efe8-46b6-8349-164cf747adea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd62bef03bd44dec9ae7c68d17cfc699'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:31.062915 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6e37d57e-efe8-46b6-8349-164cf747adea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd62bef03bd44dec9ae7c68d17cfc699'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:31.068944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1349/2687] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:42:30 2022] DELETE /identity/v3/users/dd62bef03bd44dec9ae7c68d17cfc699 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:42:31.073787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9693f-9681-4080-9faa-1bee90fd5e24 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:31.074303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9693f-9681-4080-9faa-1bee90fd5e24 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:31.074433 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9693f-9681-4080-9faa-1bee90fd5e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:31.090965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-d4e9693f-9681-4080-9faa-1bee90fd5e24 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:42:31.092136 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d4e9693f-9681-4080-9faa-1bee90fd5e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:31.151194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1339/2688] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:42:31.161416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37d57e-efe8-46b6-8349-164cf747adea admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:31.162833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6e37d57e-efe8-46b6-8349-164cf747adea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:31.224071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37d57e-efe8-46b6-8349-164cf747adea admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:31.227893 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f8ec4-39c4-4607-a5b6-4f2e1b52573f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:31.228554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f8ec4-39c4-4607-a5b6-4f2e1b52573f service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:31.228832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f8ec4-39c4-4607-a5b6-4f2e1b52573f service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:31.229107 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f8ec4-39c4-4607-a5b6-4f2e1b52573f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:31.238942 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f8ec4-39c4-4607-a5b6-4f2e1b52573f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:31.240658 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f8ec4-39c4-4607-a5b6-4f2e1b52573f service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:31.250169 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1350/2689] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:42:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:42:31.606598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9693f-9681-4080-9faa-1bee90fd5e24 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:31.607999 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d4e9693f-9681-4080-9faa-1bee90fd5e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:31.623518 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9693f-9681-4080-9faa-1bee90fd5e24 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:31.632271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a65f29-ed51-48b0-b8c0-52c381c8e8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:31.633164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a65f29-ed51-48b0-b8c0-52c381c8e8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:31.633451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a65f29-ed51-48b0-b8c0-52c381c8e8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:31.633731 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a65f29-ed51-48b0-b8c0-52c381c8e8ec admin admin] PATH_INFO: `/v3/projects/189edb6d176b499489fe58e20133a298` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:31.634944 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a65f29-ed51-48b0-b8c0-52c381c8e8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=189edb6d176b499489fe58e20133a298)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:31.636871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a65f29-ed51-48b0-b8c0-52c381c8e8ec admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:31.683760 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-48a65f29-ed51-48b0-b8c0-52c381c8e8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '189edb6d176b499489fe58e20133a298', 'request_id': 'req-48a65f29-ed51-48b0-b8c0-52c381c8e8ec'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:31.689877 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-48a65f29-ed51-48b0-b8c0-52c381c8e8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '189edb6d176b499489fe58e20133a298', 'request_id': 'req-48a65f29-ed51-48b0-b8c0-52c381c8e8ec'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:31.698191 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-48a65f29-ed51-48b0-b8c0-52c381c8e8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '189edb6d176b499489fe58e20133a298', 'request_id': 'req-48a65f29-ed51-48b0-b8c0-52c381c8e8ec'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:31.709043 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-48a65f29-ed51-48b0-b8c0-52c381c8e8ec admin admin] The token cache is being invalidate because project 189edb6d176b499489fe58e20133a298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:42:31.709327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-48a65f29-ed51-48b0-b8c0-52c381c8e8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:31.709989 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-48a65f29-ed51-48b0-b8c0-52c381c8e8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:31.711571 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1340/2690] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:42:31 2022] DELETE /identity/v3/projects/189edb6d176b499489fe58e20133a298 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:42:31.716442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d466dd-b9c2-4dcb-a312-8b043a1c90e0 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:31.716676 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d466dd-b9c2-4dcb-a312-8b043a1c90e0 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:31.716952 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d466dd-b9c2-4dcb-a312-8b043a1c90e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:31.734934 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-e5d466dd-b9c2-4dcb-a312-8b043a1c90e0 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:42:31.736157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e5d466dd-b9c2-4dcb-a312-8b043a1c90e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:31.795578 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1351/2691] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:42:31.804405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32b177-815b-499f-bb8c-b566c9bdac0d None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:31.804680 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32b177-815b-499f-bb8c-b566c9bdac0d None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:31.804955 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32b177-815b-499f-bb8c-b566c9bdac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:31.823850 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-4e32b177-815b-499f-bb8c-b566c9bdac0d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:42:31.825026 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-4e32b177-815b-499f-bb8c-b566c9bdac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:31.833908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1341/2692] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:42:31.837964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d466dd-b9c2-4dcb-a312-8b043a1c90e0 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:31.847485 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d466dd-b9c2-4dcb-a312-8b043a1c90e0 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:31.852399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c88ba-7a94-4f4a-b72e-5e129bab4a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:31.853043 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c88ba-7a94-4f4a-b72e-5e129bab4a85 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:31.853320 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c88ba-7a94-4f4a-b72e-5e129bab4a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:31.853586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c88ba-7a94-4f4a-b72e-5e129bab4a85 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:31.854352 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c88ba-7a94-4f4a-b72e-5e129bab4a85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:42:31.854642 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c88ba-7a94-4f4a-b72e-5e129bab4a85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:31.856235 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c88ba-7a94-4f4a-b72e-5e129bab4a85 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:31.867938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1352/2693] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:42:31.872082 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32b177-815b-499f-bb8c-b566c9bdac0d None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:31.882163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32b177-815b-499f-bb8c-b566c9bdac0d None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:31.887723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425533a-961b-4609-a85d-650e56a361c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:31.888542 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425533a-961b-4609-a85d-650e56a361c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:31.888938 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425533a-961b-4609-a85d-650e56a361c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:31.889295 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425533a-961b-4609-a85d-650e56a361c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:31.890017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425533a-961b-4609-a85d-650e56a361c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:31.891978 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425533a-961b-4609-a85d-650e56a361c7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:31.922452 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1342/2694] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:42:31 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:42:31.923917 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c88ba-7a94-4f4a-b72e-5e129bab4a85 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:31.935395 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c88ba-7a94-4f4a-b72e-5e129bab4a85 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:31.991244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6f24f-3149-429e-b58f-a64506c0c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:31.991852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6f24f-3149-429e-b58f-a64506c0c3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:31.992138 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6f24f-3149-429e-b58f-a64506c0c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:31.992412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6f24f-3149-429e-b58f-a64506c0c3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:31.993116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6f24f-3149-429e-b58f-a64506c0c3d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:31.995096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6f24f-3149-429e-b58f-a64506c0c3d3 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:32.016244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1353/2695] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:42:31 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:42:32.018986 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425533a-961b-4609-a85d-650e56a361c7 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:32.028996 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425533a-961b-4609-a85d-650e56a361c7 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:32.033505 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b7f66-096e-49de-8c9d-120fd6617a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:32.034155 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b7f66-096e-49de-8c9d-120fd6617a30 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:32.034464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b7f66-096e-49de-8c9d-120fd6617a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:32.034740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b7f66-096e-49de-8c9d-120fd6617a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:32.035462 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b7f66-096e-49de-8c9d-120fd6617a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:32.037269 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b7f66-096e-49de-8c9d-120fd6617a30 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:32.048252 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1343/2696] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:42:32.052763 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6f24f-3149-429e-b58f-a64506c0c3d3 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:32.062722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6f24f-3149-429e-b58f-a64506c0c3d3 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:32.067880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0849df-7673-4755-be98-b4aa48d06784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:32.068521 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0849df-7673-4755-be98-b4aa48d06784 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:32.068801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0849df-7673-4755-be98-b4aa48d06784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:32.069072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0849df-7673-4755-be98-b4aa48d06784 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:32.069784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0849df-7673-4755-be98-b4aa48d06784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:32.071665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0849df-7673-4755-be98-b4aa48d06784 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:32.081177 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1354/2697] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:42:32.085569 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b7f66-096e-49de-8c9d-120fd6617a30 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:32.095551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b7f66-096e-49de-8c9d-120fd6617a30 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:32.100493 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a4fe3-8d06-4320-acdd-1bd50f08f385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:32.101682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a4fe3-8d06-4320-acdd-1bd50f08f385 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:32.101965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a4fe3-8d06-4320-acdd-1bd50f08f385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:32.102274 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a4fe3-8d06-4320-acdd-1bd50f08f385 admin admin] PATH_INFO: `/v3/projects/a3f258734b244210bcb3369d1150aca0/users/a2257fa9fbda4fe8a4558ac6a5128712/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:32.117771 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a4fe3-8d06-4320-acdd-1bd50f08f385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f258734b244210bcb3369d1150aca0, user_id=a2257fa9fbda4fe8a4558ac6a5128712, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:32.120479 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a4fe3-8d06-4320-acdd-1bd50f08f385 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:32.133187 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1344/2698] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:42:32 2022] PUT /identity/v3/projects/a3f258734b244210bcb3369d1150aca0/users/a2257fa9fbda4fe8a4558ac6a5128712/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:42:32.143433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee514574-1840-4ba2-9cd8-3f94f42e4e55 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:32.143723 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee514574-1840-4ba2-9cd8-3f94f42e4e55 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:32.144005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee514574-1840-4ba2-9cd8-3f94f42e4e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:32.170761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-ee514574-1840-4ba2-9cd8-3f94f42e4e55 None None] MFA Rules not processed for user `a2257fa9fbda4fe8a4558ac6a5128712`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:42:32.171957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ee514574-1840-4ba2-9cd8-3f94f42e4e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:32.236308 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1355/2699] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:42:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:42:32.247561 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a4fe3-8d06-4320-acdd-1bd50f08f385 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:32.249272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d06a4fe3-8d06-4320-acdd-1bd50f08f385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:32.307297 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a4fe3-8d06-4320-acdd-1bd50f08f385 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:32.310990 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89742ef-71e7-4f8d-b8b2-70536250e8db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:32.311639 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89742ef-71e7-4f8d-b8b2-70536250e8db service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:32.311927 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89742ef-71e7-4f8d-b8b2-70536250e8db service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:32.312207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89742ef-71e7-4f8d-b8b2-70536250e8db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:32.322286 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89742ef-71e7-4f8d-b8b2-70536250e8db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:32.323769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89742ef-71e7-4f8d-b8b2-70536250e8db service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:32.333366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1345/2700] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:42:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:42:33.308293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee514574-1840-4ba2-9cd8-3f94f42e4e55 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:33.309682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ee514574-1840-4ba2-9cd8-3f94f42e4e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:33.390291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee514574-1840-4ba2-9cd8-3f94f42e4e55 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:33.396906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27cd30-9bcf-4d03-b791-e62433361338 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:33.397575 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27cd30-9bcf-4d03-b791-e62433361338 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:33.397868 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27cd30-9bcf-4d03-b791-e62433361338 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:33.398152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27cd30-9bcf-4d03-b791-e62433361338 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:33.400024 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6d27cd30-9bcf-4d03-b791-e62433361338 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:33.416657 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27cd30-9bcf-4d03-b791-e62433361338 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:33.418367 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27cd30-9bcf-4d03-b791-e62433361338 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:33.432598 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1356/2701] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:42:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:42:37.732077 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89742ef-71e7-4f8d-b8b2-70536250e8db service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:37.740934 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89742ef-71e7-4f8d-b8b2-70536250e8db service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:37.744626 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38d7e6-a0cd-4e96-8599-c5d627de2a01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:37.745243 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38d7e6-a0cd-4e96-8599-c5d627de2a01 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:37.745535 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38d7e6-a0cd-4e96-8599-c5d627de2a01 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:37.745817 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38d7e6-a0cd-4e96-8599-c5d627de2a01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:37.747650 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0f38d7e6-a0cd-4e96-8599-c5d627de2a01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:37.828109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38d7e6-a0cd-4e96-8599-c5d627de2a01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:37.829558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38d7e6-a0cd-4e96-8599-c5d627de2a01 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:37.848245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1346/2702] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:42:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:42:56.166711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27cd30-9bcf-4d03-b791-e62433361338 service nova] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:56.168212 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6d27cd30-9bcf-4d03-b791-e62433361338 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:56.226737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27cd30-9bcf-4d03-b791-e62433361338 service nova] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:56.230518 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234ca12-1259-42cb-a0f9-39796b80905e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:56.231237 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234ca12-1259-42cb-a0f9-39796b80905e service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:56.231524 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234ca12-1259-42cb-a0f9-39796b80905e service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:56.231798 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234ca12-1259-42cb-a0f9-39796b80905e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:56.233649 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f234ca12-1259-42cb-a0f9-39796b80905e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:56.299731 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234ca12-1259-42cb-a0f9-39796b80905e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:56.301122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234ca12-1259-42cb-a0f9-39796b80905e service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:56.311135 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1357/2703] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:42:59.472500 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38d7e6-a0cd-4e96-8599-c5d627de2a01 service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:59.474599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0f38d7e6-a0cd-4e96-8599-c5d627de2a01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:42:59.493773 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38d7e6-a0cd-4e96-8599-c5d627de2a01 service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:59.498400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e472f6-8fe2-4756-b25d-7eb724c77878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:59.499274 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e472f6-8fe2-4756-b25d-7eb724c77878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:59.499680 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e472f6-8fe2-4756-b25d-7eb724c77878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:59.499962 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e472f6-8fe2-4756-b25d-7eb724c77878 admin admin] PATH_INFO: `/v3/users/5998f94809ee4001b031b901a8fc39c2` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:59.501147 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e472f6-8fe2-4756-b25d-7eb724c77878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5998f94809ee4001b031b901a8fc39c2)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:59.503194 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e472f6-8fe2-4756-b25d-7eb724c77878 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:59.551157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-40e472f6-8fe2-4756-b25d-7eb724c77878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5998f94809ee4001b031b901a8fc39c2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:59.558352 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-40e472f6-8fe2-4756-b25d-7eb724c77878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5998f94809ee4001b031b901a8fc39c2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:59.559076 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-40e472f6-8fe2-4756-b25d-7eb724c77878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5998f94809ee4001b031b901a8fc39c2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:59.571931 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-40e472f6-8fe2-4756-b25d-7eb724c77878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5998f94809ee4001b031b901a8fc39c2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:59.580437 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-40e472f6-8fe2-4756-b25d-7eb724c77878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5998f94809ee4001b031b901a8fc39c2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:59.587524 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1347/2704] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:42:59 2022] DELETE /identity/v3/users/5998f94809ee4001b031b901a8fc39c2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:42:59.762937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234ca12-1259-42cb-a0f9-39796b80905e service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:42:59.774473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234ca12-1259-42cb-a0f9-39796b80905e service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:42:59.845870 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2124ac8-4ec7-46d0-a0d2-da32d7a41e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:42:59.846923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2124ac8-4ec7-46d0-a0d2-da32d7a41e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:59.847244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2124ac8-4ec7-46d0-a0d2-da32d7a41e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:59.847577 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2124ac8-4ec7-46d0-a0d2-da32d7a41e82 admin admin] PATH_INFO: `/v3/projects/bac3eb4351a74cebb3814d3cbb754f56` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:59.848758 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2124ac8-4ec7-46d0-a0d2-da32d7a41e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bac3eb4351a74cebb3814d3cbb754f56)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:42:59.850924 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2124ac8-4ec7-46d0-a0d2-da32d7a41e82 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:42:59.901298 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d2124ac8-4ec7-46d0-a0d2-da32d7a41e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bac3eb4351a74cebb3814d3cbb754f56', 'request_id': 'req-d2124ac8-4ec7-46d0-a0d2-da32d7a41e82'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:59.907208 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d2124ac8-4ec7-46d0-a0d2-da32d7a41e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bac3eb4351a74cebb3814d3cbb754f56', 'request_id': 'req-d2124ac8-4ec7-46d0-a0d2-da32d7a41e82'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:59.914442 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d2124ac8-4ec7-46d0-a0d2-da32d7a41e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bac3eb4351a74cebb3814d3cbb754f56', 'request_id': 'req-d2124ac8-4ec7-46d0-a0d2-da32d7a41e82'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:59.924374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d2124ac8-4ec7-46d0-a0d2-da32d7a41e82 admin admin] The token cache is being invalidate because project bac3eb4351a74cebb3814d3cbb754f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:42:59.924652 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d2124ac8-4ec7-46d0-a0d2-da32d7a41e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:59.925265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-d2124ac8-4ec7-46d0-a0d2-da32d7a41e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:42:59.926837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1358/2705] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:42:59 2022] DELETE /identity/v3/projects/bac3eb4351a74cebb3814d3cbb754f56 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:42:59.932653 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8a5f0-6790-45fc-be56-aa308bcc7160 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:42:59.932938 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8a5f0-6790-45fc-be56-aa308bcc7160 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:42:59.933209 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8a5f0-6790-45fc-be56-aa308bcc7160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:42:59.952222 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-0aa8a5f0-6790-45fc-be56-aa308bcc7160 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:42:59.953392 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-0aa8a5f0-6790-45fc-be56-aa308bcc7160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:00.010295 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1348/2706] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:00.018089 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8b661-19fc-44e3-9203-16ab1c26bbf6 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.018439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8b661-19fc-44e3-9203-16ab1c26bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.018720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8b661-19fc-44e3-9203-16ab1c26bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.037815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-a3a8b661-19fc-44e3-9203-16ab1c26bbf6 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:00.039100 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a3a8b661-19fc-44e3-9203-16ab1c26bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:00.047065 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1359/2707] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:00.051241 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8a5f0-6790-45fc-be56-aa308bcc7160 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:00.062127 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8a5f0-6790-45fc-be56-aa308bcc7160 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:00.068424 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0085f-d4eb-4656-8457-a0ebdb6b51a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:00.069464 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0085f-d4eb-4656-8457-a0ebdb6b51a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.069800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0085f-d4eb-4656-8457-a0ebdb6b51a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.070088 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0085f-d4eb-4656-8457-a0ebdb6b51a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.070868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0085f-d4eb-4656-8457-a0ebdb6b51a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:43:00.071180 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0085f-d4eb-4656-8457-a0ebdb6b51a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:00.073044 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0085f-d4eb-4656-8457-a0ebdb6b51a4 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:00.085027 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1349/2708] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:43:00.089803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8b661-19fc-44e3-9203-16ab1c26bbf6 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:00.100542 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8b661-19fc-44e3-9203-16ab1c26bbf6 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:00.105236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5d1f7-a653-4e09-b912-fa9dc6ac3c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:00.105882 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5d1f7-a653-4e09-b912-fa9dc6ac3c1c admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.106166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5d1f7-a653-4e09-b912-fa9dc6ac3c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.106485 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5d1f7-a653-4e09-b912-fa9dc6ac3c1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.107175 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5d1f7-a653-4e09-b912-fa9dc6ac3c1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:00.109235 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5d1f7-a653-4e09-b912-fa9dc6ac3c1c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:00.136737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1360/2709] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:43:00 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:43:00.140878 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0085f-d4eb-4656-8457-a0ebdb6b51a4 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:00.151625 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0085f-d4eb-4656-8457-a0ebdb6b51a4 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:00.206975 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b6dba-3f0b-4720-9109-73e234be26da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:00.207681 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b6dba-3f0b-4720-9109-73e234be26da admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.207963 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b6dba-3f0b-4720-9109-73e234be26da admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.208236 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b6dba-3f0b-4720-9109-73e234be26da admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.209529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b6dba-3f0b-4720-9109-73e234be26da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:00.212211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b6dba-3f0b-4720-9109-73e234be26da admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:00.231696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1350/2710] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:43:00 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:43:00.235824 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5d1f7-a653-4e09-b912-fa9dc6ac3c1c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:00.246448 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5d1f7-a653-4e09-b912-fa9dc6ac3c1c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:00.251236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e210c6-528f-45b1-8831-23b0824d56d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:00.251938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e210c6-528f-45b1-8831-23b0824d56d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.252221 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e210c6-528f-45b1-8831-23b0824d56d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.252495 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e210c6-528f-45b1-8831-23b0824d56d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.253224 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e210c6-528f-45b1-8831-23b0824d56d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:00.254904 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e210c6-528f-45b1-8831-23b0824d56d5 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:00.266304 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1361/2711] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:43:00.270151 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b6dba-3f0b-4720-9109-73e234be26da admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:00.280711 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b6dba-3f0b-4720-9109-73e234be26da admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:00.285386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e0b26-9777-4221-ba5f-66d1d845e37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:00.286036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e0b26-9777-4221-ba5f-66d1d845e37b admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.286374 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e0b26-9777-4221-ba5f-66d1d845e37b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.286709 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e0b26-9777-4221-ba5f-66d1d845e37b admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.287941 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e0b26-9777-4221-ba5f-66d1d845e37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:00.289534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e0b26-9777-4221-ba5f-66d1d845e37b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:00.300950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1351/2712] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:43:00.304900 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e210c6-528f-45b1-8831-23b0824d56d5 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:00.314787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e210c6-528f-45b1-8831-23b0824d56d5 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:00.320586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b89807-5c2a-4756-90f4-682f49d93477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:00.321461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b89807-5c2a-4756-90f4-682f49d93477 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.321993 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b89807-5c2a-4756-90f4-682f49d93477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.322325 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b89807-5c2a-4756-90f4-682f49d93477 admin admin] PATH_INFO: `/v3/projects/693389792fa74716ab6eff4d632bbff3/users/14145763e0354352ab65f1f2cd392324/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.338310 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b89807-5c2a-4756-90f4-682f49d93477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=693389792fa74716ab6eff4d632bbff3, user_id=14145763e0354352ab65f1f2cd392324, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:00.340959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b89807-5c2a-4756-90f4-682f49d93477 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:00.353073 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1362/2713] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:43:00 2022] PUT /identity/v3/projects/693389792fa74716ab6eff4d632bbff3/users/14145763e0354352ab65f1f2cd392324/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:00.362919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3ca2a-aebe-4564-a158-3f7f45fac662 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.363212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3ca2a-aebe-4564-a158-3f7f45fac662 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.363485 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3ca2a-aebe-4564-a158-3f7f45fac662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.390361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-bde3ca2a-aebe-4564-a158-3f7f45fac662 None None] MFA Rules not processed for user `14145763e0354352ab65f1f2cd392324`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:00.391578 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bde3ca2a-aebe-4564-a158-3f7f45fac662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:00.454239 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1352/2714] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:00.458705 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b89807-5c2a-4756-90f4-682f49d93477 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:00.517911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b89807-5c2a-4756-90f4-682f49d93477 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:00.522704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc2d35-b9ea-4462-9018-3552b65dd405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:00.523354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc2d35-b9ea-4462-9018-3552b65dd405 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.523636 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc2d35-b9ea-4462-9018-3552b65dd405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.523911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc2d35-b9ea-4462-9018-3552b65dd405 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.524598 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc2d35-b9ea-4462-9018-3552b65dd405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:00.526527 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc2d35-b9ea-4462-9018-3552b65dd405 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:00.550757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1363/2715] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:43:00 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:43:00.555496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3ca2a-aebe-4564-a158-3f7f45fac662 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:00.565938 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3ca2a-aebe-4564-a158-3f7f45fac662 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:00.621336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02231ea-13aa-4955-b008-32b07ebe6f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:00.622021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02231ea-13aa-4955-b008-32b07ebe6f3a admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.622345 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02231ea-13aa-4955-b008-32b07ebe6f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.622628 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02231ea-13aa-4955-b008-32b07ebe6f3a admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.623339 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02231ea-13aa-4955-b008-32b07ebe6f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:00.625271 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02231ea-13aa-4955-b008-32b07ebe6f3a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:00.649250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1353/2716] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:43:00 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:43:00.650871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc2d35-b9ea-4462-9018-3552b65dd405 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:00.661742 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc2d35-b9ea-4462-9018-3552b65dd405 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:00.666803 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2143a13-388e-4f6a-acce-a7b52c0fc1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:00.667476 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2143a13-388e-4f6a-acce-a7b52c0fc1ed admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.667763 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2143a13-388e-4f6a-acce-a7b52c0fc1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.668160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2143a13-388e-4f6a-acce-a7b52c0fc1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.668923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2143a13-388e-4f6a-acce-a7b52c0fc1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:00.670587 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2143a13-388e-4f6a-acce-a7b52c0fc1ed admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:00.682655 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1364/2717] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:43:00.686648 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02231ea-13aa-4955-b008-32b07ebe6f3a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:00.699673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02231ea-13aa-4955-b008-32b07ebe6f3a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:00.705410 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7564c-8164-4d93-8329-dc8cbb88eb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:00.706385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7564c-8164-4d93-8329-dc8cbb88eb54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.706667 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7564c-8164-4d93-8329-dc8cbb88eb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.706939 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7564c-8164-4d93-8329-dc8cbb88eb54 admin admin] PATH_INFO: `/v3/projects/8b24db22bf554e45ad84e814852c4407/users/b6e7b170e477485285c1f68dc79c543d/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.722521 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7564c-8164-4d93-8329-dc8cbb88eb54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b24db22bf554e45ad84e814852c4407, user_id=b6e7b170e477485285c1f68dc79c543d, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:00.725289 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7564c-8164-4d93-8329-dc8cbb88eb54 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:00.737896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1354/2718] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:43:00 2022] PUT /identity/v3/projects/8b24db22bf554e45ad84e814852c4407/users/b6e7b170e477485285c1f68dc79c543d/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:00.742559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2143a13-388e-4f6a-acce-a7b52c0fc1ed admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:00.752522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2143a13-388e-4f6a-acce-a7b52c0fc1ed admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:00.811050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ebe04-96c2-409e-808a-41df22e2f630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:00.811723 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ebe04-96c2-409e-808a-41df22e2f630 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.812004 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ebe04-96c2-409e-808a-41df22e2f630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.812274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ebe04-96c2-409e-808a-41df22e2f630 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.812992 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ebe04-96c2-409e-808a-41df22e2f630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:00.814640 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ebe04-96c2-409e-808a-41df22e2f630 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:00.824709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1365/2719] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:43:00.828840 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7564c-8164-4d93-8329-dc8cbb88eb54 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:00.838938 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7564c-8164-4d93-8329-dc8cbb88eb54 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:00.843563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef094ea-0891-459b-bb79-07618ffe7120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:00.844435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef094ea-0891-459b-bb79-07618ffe7120 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.844717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef094ea-0891-459b-bb79-07618ffe7120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.844993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef094ea-0891-459b-bb79-07618ffe7120 admin admin] PATH_INFO: `/v3/projects/8b24db22bf554e45ad84e814852c4407/users/b6e7b170e477485285c1f68dc79c543d/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.846982 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef094ea-0891-459b-bb79-07618ffe7120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b24db22bf554e45ad84e814852c4407, user_id=b6e7b170e477485285c1f68dc79c543d, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:00.850302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef094ea-0891-459b-bb79-07618ffe7120 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:00.860322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1355/2720] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:43:00 2022] PUT /identity/v3/projects/8b24db22bf554e45ad84e814852c4407/users/b6e7b170e477485285c1f68dc79c543d/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:00.872387 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8cc68-bfa8-44e1-bcdf-1b06a660a691 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.872674 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8cc68-bfa8-44e1-bcdf-1b06a660a691 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.872981 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8cc68-bfa8-44e1-bcdf-1b06a660a691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.901322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef094ea-0891-459b-bb79-07618ffe7120 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:00.902995 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-9ce8cc68-bfa8-44e1-bcdf-1b06a660a691 None None] MFA Rules not processed for user `b6e7b170e477485285c1f68dc79c543d`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:00.903168 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-9ef094ea-0891-459b-bb79-07618ffe7120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:00.904185 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-9ce8cc68-bfa8-44e1-bcdf-1b06a660a691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:00.969488 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef094ea-0891-459b-bb79-07618ffe7120 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:00.974552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a773339-512c-4a1e-bef7-39f9b07beb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:00.975441 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a773339-512c-4a1e-bef7-39f9b07beb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:00.975775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a773339-512c-4a1e-bef7-39f9b07beb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:00.976189 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a773339-512c-4a1e-bef7-39f9b07beb51 admin admin] PATH_INFO: `/v3/users/a2257fa9fbda4fe8a4558ac6a5128712` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:00.977425 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a773339-512c-4a1e-bef7-39f9b07beb51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2257fa9fbda4fe8a4558ac6a5128712)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:00.978606 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1366/2721] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:00.979443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a773339-512c-4a1e-bef7-39f9b07beb51 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:00.989810 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8cc68-bfa8-44e1-bcdf-1b06a660a691 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:00.991236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-9ce8cc68-bfa8-44e1-bcdf-1b06a660a691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:01.028332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4a773339-512c-4a1e-bef7-39f9b07beb51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2257fa9fbda4fe8a4558ac6a5128712'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:01.034855 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4a773339-512c-4a1e-bef7-39f9b07beb51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2257fa9fbda4fe8a4558ac6a5128712'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:01.035538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4a773339-512c-4a1e-bef7-39f9b07beb51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2257fa9fbda4fe8a4558ac6a5128712'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:01.047226 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4a773339-512c-4a1e-bef7-39f9b07beb51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2257fa9fbda4fe8a4558ac6a5128712'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:01.051087 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8cc68-bfa8-44e1-bcdf-1b06a660a691 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:01.055028 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-4a773339-512c-4a1e-bef7-39f9b07beb51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2257fa9fbda4fe8a4558ac6a5128712'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:01.055448 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc86d8-a983-454a-ad52-22b62ae3c9e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:01.056099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc86d8-a983-454a-ad52-22b62ae3c9e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:01.056385 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc86d8-a983-454a-ad52-22b62ae3c9e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:01.056691 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc86d8-a983-454a-ad52-22b62ae3c9e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:01.058730 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-cdbc86d8-a983-454a-ad52-22b62ae3c9e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:01.061313 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1356/2722] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:43:00 2022] DELETE /identity/v3/users/a2257fa9fbda4fe8a4558ac6a5128712 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:43:01.065863 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df26f96-6942-4c8c-a81e-768f9819ffb9 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:01.066273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df26f96-6942-4c8c-a81e-768f9819ffb9 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:01.066558 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df26f96-6942-4c8c-a81e-768f9819ffb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:01.072224 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc86d8-a983-454a-ad52-22b62ae3c9e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:01.073672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc86d8-a983-454a-ad52-22b62ae3c9e2 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:01.083292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1367/2723] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:43:01.084766 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-5df26f96-6942-4c8c-a81e-768f9819ffb9 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:01.086042 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5df26f96-6942-4c8c-a81e-768f9819ffb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:01.146900 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1357/2724] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:43:01.156412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc86d8-a983-454a-ad52-22b62ae3c9e2 service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:01.157792 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-cdbc86d8-a983-454a-ad52-22b62ae3c9e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:01.218129 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc86d8-a983-454a-ad52-22b62ae3c9e2 service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:01.270562 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876b018-52d4-42cb-a2ed-403e61aa29e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:01.272027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876b018-52d4-42cb-a2ed-403e61aa29e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:01.272392 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876b018-52d4-42cb-a2ed-403e61aa29e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:01.272707 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876b018-52d4-42cb-a2ed-403e61aa29e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:01.282824 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876b018-52d4-42cb-a2ed-403e61aa29e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:01.284265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876b018-52d4-42cb-a2ed-403e61aa29e2 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:01.294826 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1368/2725] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:43:01.510340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df26f96-6942-4c8c-a81e-768f9819ffb9 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:01.512211 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5df26f96-6942-4c8c-a81e-768f9819ffb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:01.524620 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df26f96-6942-4c8c-a81e-768f9819ffb9 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:01.529303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bccba6-9d6a-41b3-b5e2-bd688a5c9a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:01.530198 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bccba6-9d6a-41b3-b5e2-bd688a5c9a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:01.530497 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bccba6-9d6a-41b3-b5e2-bd688a5c9a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:01.530775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bccba6-9d6a-41b3-b5e2-bd688a5c9a76 admin admin] PATH_INFO: `/v3/users/14145763e0354352ab65f1f2cd392324` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:01.531985 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bccba6-9d6a-41b3-b5e2-bd688a5c9a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14145763e0354352ab65f1f2cd392324)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:01.533925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bccba6-9d6a-41b3-b5e2-bd688a5c9a76 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:01.574987 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876b018-52d4-42cb-a2ed-403e61aa29e2 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:01.576386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5876b018-52d4-42cb-a2ed-403e61aa29e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:01.582146 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d8bccba6-9d6a-41b3-b5e2-bd688a5c9a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14145763e0354352ab65f1f2cd392324'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:01.589463 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d8bccba6-9d6a-41b3-b5e2-bd688a5c9a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14145763e0354352ab65f1f2cd392324'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:01.590456 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d8bccba6-9d6a-41b3-b5e2-bd688a5c9a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14145763e0354352ab65f1f2cd392324'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:01.591096 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876b018-52d4-42cb-a2ed-403e61aa29e2 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:01.595780 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb5dde-547b-45db-8f0f-859cec939a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:01.596711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb5dde-547b-45db-8f0f-859cec939a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:01.597461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb5dde-547b-45db-8f0f-859cec939a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:01.597461 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb5dde-547b-45db-8f0f-859cec939a9a admin admin] PATH_INFO: `/v3/projects/a3f258734b244210bcb3369d1150aca0` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:01.598659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb5dde-547b-45db-8f0f-859cec939a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f258734b244210bcb3369d1150aca0)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:01.601336 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb5dde-547b-45db-8f0f-859cec939a9a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:01.603785 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d8bccba6-9d6a-41b3-b5e2-bd688a5c9a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14145763e0354352ab65f1f2cd392324'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:01.613734 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-d8bccba6-9d6a-41b3-b5e2-bd688a5c9a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14145763e0354352ab65f1f2cd392324'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:01.623106 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1358/2726] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:43:01 2022] DELETE /identity/v3/users/14145763e0354352ab65f1f2cd392324 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:01.627700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6580c88-6925-4eda-ba17-bfac6caf1db4 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:01.627700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6580c88-6925-4eda-ba17-bfac6caf1db4 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:01.627995 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6580c88-6925-4eda-ba17-bfac6caf1db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:01.646493 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-e6580c88-6925-4eda-ba17-bfac6caf1db4 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:01.647754 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e6580c88-6925-4eda-ba17-bfac6caf1db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:01.654751 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-1bbb5dde-547b-45db-8f0f-859cec939a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f258734b244210bcb3369d1150aca0', 'request_id': 'req-1bbb5dde-547b-45db-8f0f-859cec939a9a'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:01.660849 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-1bbb5dde-547b-45db-8f0f-859cec939a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f258734b244210bcb3369d1150aca0', 'request_id': 'req-1bbb5dde-547b-45db-8f0f-859cec939a9a'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:01.668815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-1bbb5dde-547b-45db-8f0f-859cec939a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f258734b244210bcb3369d1150aca0', 'request_id': 'req-1bbb5dde-547b-45db-8f0f-859cec939a9a'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:01.679262 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-1bbb5dde-547b-45db-8f0f-859cec939a9a admin admin] The token cache is being invalidate because project a3f258734b244210bcb3369d1150aca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:43:01.679558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-1bbb5dde-547b-45db-8f0f-859cec939a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:01.680222 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-1bbb5dde-547b-45db-8f0f-859cec939a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:01.681881 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1369/2727] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:43:01 2022] DELETE /identity/v3/projects/a3f258734b244210bcb3369d1150aca0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:43:01.687536 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46318ba6-30af-454d-bf4f-b5d958d048d0 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:01.687852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46318ba6-30af-454d-bf4f-b5d958d048d0 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:01.688132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46318ba6-30af-454d-bf4f-b5d958d048d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:01.706709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-46318ba6-30af-454d-bf4f-b5d958d048d0 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:01.707921 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-46318ba6-30af-454d-bf4f-b5d958d048d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:01.710868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1359/2728] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:43:01.720480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6580c88-6925-4eda-ba17-bfac6caf1db4 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:01.721150 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1370/2729] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:43:01.727760 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e6580c88-6925-4eda-ba17-bfac6caf1db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:01.729120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5db3a-e6b8-4aac-aa50-35f9c70eb45a None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:01.729423 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5db3a-e6b8-4aac-aa50-35f9c70eb45a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:01.729784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5db3a-e6b8-4aac-aa50-35f9c70eb45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:01.754305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-4bb5db3a-e6b8-4aac-aa50-35f9c70eb45a None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:01.754305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-4bb5db3a-e6b8-4aac-aa50-35f9c70eb45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:01.763014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1371/2730] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:43:01.766968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5db3a-e6b8-4aac-aa50-35f9c70eb45a None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:01.776682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5db3a-e6b8-4aac-aa50-35f9c70eb45a None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:01.781864 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464be737-d9a7-4495-bd75-d14c77203615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:01.782522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464be737-d9a7-4495-bd75-d14c77203615 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:01.782812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464be737-d9a7-4495-bd75-d14c77203615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:01.783097 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464be737-d9a7-4495-bd75-d14c77203615 admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:01.783829 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464be737-d9a7-4495-bd75-d14c77203615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:43:01.784142 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464be737-d9a7-4495-bd75-d14c77203615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:01.785757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464be737-d9a7-4495-bd75-d14c77203615 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:01.791589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6580c88-6925-4eda-ba17-bfac6caf1db4 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:01.796779 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179f67e-865b-485e-b7fb-90ff9203d64c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:01.797450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179f67e-865b-485e-b7fb-90ff9203d64c service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:01.797736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179f67e-865b-485e-b7fb-90ff9203d64c service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:01.798018 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179f67e-865b-485e-b7fb-90ff9203d64c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:01.802997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1372/2731] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 14:43:01.807414 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464be737-d9a7-4495-bd75-d14c77203615 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:01.810262 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179f67e-865b-485e-b7fb-90ff9203d64c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:01.811794 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179f67e-865b-485e-b7fb-90ff9203d64c service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:01.822322 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464be737-d9a7-4495-bd75-d14c77203615 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:01.823526 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1360/2732] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:43:01.829116 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1dbbe-b070-4bed-87e4-b70c20befb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:01.829783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1dbbe-b070-4bed-87e4-b70c20befb09 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:01.830066 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1dbbe-b070-4bed-87e4-b70c20befb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:01.830383 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1dbbe-b070-4bed-87e4-b70c20befb09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:01.831071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1dbbe-b070-4bed-87e4-b70c20befb09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:01.833002 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1dbbe-b070-4bed-87e4-b70c20befb09 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:01.871622 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1373/2733] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:43:01 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:43:01.873056 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179f67e-865b-485e-b7fb-90ff9203d64c service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:01.883139 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179f67e-865b-485e-b7fb-90ff9203d64c service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:01.944150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dada9e4-3110-41fa-aa23-84a11f6637d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:01.944843 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dada9e4-3110-41fa-aa23-84a11f6637d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:01.945127 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dada9e4-3110-41fa-aa23-84a11f6637d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:01.945403 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dada9e4-3110-41fa-aa23-84a11f6637d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:01.946097 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dada9e4-3110-41fa-aa23-84a11f6637d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:01.948312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dada9e4-3110-41fa-aa23-84a11f6637d5 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:01.969710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1361/2734] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:43:01 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:43:01.973989 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1dbbe-b070-4bed-87e4-b70c20befb09 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:01.984977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1dbbe-b070-4bed-87e4-b70c20befb09 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:01.990979 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a879fe3-903c-499a-8e67-29c159e77707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:01.991788 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a879fe3-903c-499a-8e67-29c159e77707 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:01.992087 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a879fe3-903c-499a-8e67-29c159e77707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:01.992498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a879fe3-903c-499a-8e67-29c159e77707 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:01.993094 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a879fe3-903c-499a-8e67-29c159e77707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:01.994870 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a879fe3-903c-499a-8e67-29c159e77707 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:02.006842 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1374/2735] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:43:02.011152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dada9e4-3110-41fa-aa23-84a11f6637d5 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:02.022205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dada9e4-3110-41fa-aa23-84a11f6637d5 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:02.028119 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef0649-7f78-45f2-ae81-e564c6c0189a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:02.028119 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef0649-7f78-45f2-ae81-e564c6c0189a admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:02.028119 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef0649-7f78-45f2-ae81-e564c6c0189a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:02.028119 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef0649-7f78-45f2-ae81-e564c6c0189a admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:02.028857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef0649-7f78-45f2-ae81-e564c6c0189a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:02.030550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef0649-7f78-45f2-ae81-e564c6c0189a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:02.043964 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1362/2736] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:43:02.045123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a879fe3-903c-499a-8e67-29c159e77707 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:02.056575 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a879fe3-903c-499a-8e67-29c159e77707 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:02.061820 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8d703-66c4-49c7-b1aa-661e6c5da7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:02.062890 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8d703-66c4-49c7-b1aa-661e6c5da7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:02.063245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8d703-66c4-49c7-b1aa-661e6c5da7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:02.063592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8d703-66c4-49c7-b1aa-661e6c5da7d8 admin admin] PATH_INFO: `/v3/projects/dd03377c46e04496adbf06ead6bdf801/users/f0c4bc87acf84ad181e20fe4ea9d5d45/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:02.079590 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8d703-66c4-49c7-b1aa-661e6c5da7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd03377c46e04496adbf06ead6bdf801, user_id=f0c4bc87acf84ad181e20fe4ea9d5d45, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:02.082316 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8d703-66c4-49c7-b1aa-661e6c5da7d8 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:02.104288 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1375/2737] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:43:02 2022] PUT /identity/v3/projects/dd03377c46e04496adbf06ead6bdf801/users/f0c4bc87acf84ad181e20fe4ea9d5d45/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:43:02.109676 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12791d6-6d60-4b92-83ce-a37cfdd65e85 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:02.109974 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12791d6-6d60-4b92-83ce-a37cfdd65e85 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:02.110297 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12791d6-6d60-4b92-83ce-a37cfdd65e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:02.116473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8d703-66c4-49c7-b1aa-661e6c5da7d8 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:02.118151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-45d8d703-66c4-49c7-b1aa-661e6c5da7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:02.143076 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-c12791d6-6d60-4b92-83ce-a37cfdd65e85 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:02.144199 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c12791d6-6d60-4b92-83ce-a37cfdd65e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:02.186386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8d703-66c4-49c7-b1aa-661e6c5da7d8 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:02.191072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc00c56-55a5-4b36-b041-6711086f0638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:02.191920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc00c56-55a5-4b36-b041-6711086f0638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:02.192206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc00c56-55a5-4b36-b041-6711086f0638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:02.192513 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc00c56-55a5-4b36-b041-6711086f0638 admin admin] PATH_INFO: `/v3/projects/693389792fa74716ab6eff4d632bbff3` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:02.197597 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc00c56-55a5-4b36-b041-6711086f0638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=693389792fa74716ab6eff4d632bbff3)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:02.197597 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc00c56-55a5-4b36-b041-6711086f0638 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:02.207088 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1363/2738] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:02.217487 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12791d6-6d60-4b92-83ce-a37cfdd65e85 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:02.218886 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c12791d6-6d60-4b92-83ce-a37cfdd65e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:02.245315 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2bc00c56-55a5-4b36-b041-6711086f0638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '693389792fa74716ab6eff4d632bbff3', 'request_id': 'req-2bc00c56-55a5-4b36-b041-6711086f0638'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.251877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2bc00c56-55a5-4b36-b041-6711086f0638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '693389792fa74716ab6eff4d632bbff3', 'request_id': 'req-2bc00c56-55a5-4b36-b041-6711086f0638'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.260594 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2bc00c56-55a5-4b36-b041-6711086f0638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '693389792fa74716ab6eff4d632bbff3', 'request_id': 'req-2bc00c56-55a5-4b36-b041-6711086f0638'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.273092 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2bc00c56-55a5-4b36-b041-6711086f0638 admin admin] The token cache is being invalidate because project 693389792fa74716ab6eff4d632bbff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:43:02.273380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2bc00c56-55a5-4b36-b041-6711086f0638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.274028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2bc00c56-55a5-4b36-b041-6711086f0638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.275715 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1376/2739] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:43:02 2022] DELETE /identity/v3/projects/693389792fa74716ab6eff4d632bbff3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:43:02.279617 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc00c56-55a5-4b36-b041-6711086f0638 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:02.281153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2bc00c56-55a5-4b36-b041-6711086f0638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:02.287954 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12791d6-6d60-4b92-83ce-a37cfdd65e85 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:02.336832 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b41ac-5564-42a1-bb89-9d104bcb2e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:02.337492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b41ac-5564-42a1-bb89-9d104bcb2e6a service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:02.337779 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b41ac-5564-42a1-bb89-9d104bcb2e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:02.338064 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b41ac-5564-42a1-bb89-9d104bcb2e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:02.339916 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-733b41ac-5564-42a1-bb89-9d104bcb2e6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:02.345730 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc00c56-55a5-4b36-b041-6711086f0638 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:02.350569 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33547e3b-ee17-42c6-9e8c-b3d1c5ef30f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:02.351571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33547e3b-ee17-42c6-9e8c-b3d1c5ef30f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:02.351710 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b41ac-5564-42a1-bb89-9d104bcb2e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:02.351850 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33547e3b-ee17-42c6-9e8c-b3d1c5ef30f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:02.352119 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33547e3b-ee17-42c6-9e8c-b3d1c5ef30f5 admin admin] PATH_INFO: `/v3/users/b6e7b170e477485285c1f68dc79c543d` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:02.353085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b41ac-5564-42a1-bb89-9d104bcb2e6a service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:02.353312 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33547e3b-ee17-42c6-9e8c-b3d1c5ef30f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6e7b170e477485285c1f68dc79c543d)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:02.355271 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33547e3b-ee17-42c6-9e8c-b3d1c5ef30f5 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:02.362517 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1364/2740] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 14:43:02.402953 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-33547e3b-ee17-42c6-9e8c-b3d1c5ef30f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6e7b170e477485285c1f68dc79c543d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.410572 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-33547e3b-ee17-42c6-9e8c-b3d1c5ef30f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6e7b170e477485285c1f68dc79c543d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.411210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-33547e3b-ee17-42c6-9e8c-b3d1c5ef30f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6e7b170e477485285c1f68dc79c543d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.423822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-33547e3b-ee17-42c6-9e8c-b3d1c5ef30f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6e7b170e477485285c1f68dc79c543d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.430834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-33547e3b-ee17-42c6-9e8c-b3d1c5ef30f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6e7b170e477485285c1f68dc79c543d'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.437176 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1377/2741] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:43:02 2022] DELETE /identity/v3/users/b6e7b170e477485285c1f68dc79c543d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:43:02.791874 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b41ac-5564-42a1-bb89-9d104bcb2e6a service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:02.802742 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b41ac-5564-42a1-bb89-9d104bcb2e6a service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:02.862103 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7005e-fd6a-4514-8471-5a1cf3da59e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:02.864373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7005e-fd6a-4514-8471-5a1cf3da59e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:02.864373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7005e-fd6a-4514-8471-5a1cf3da59e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:02.864373 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7005e-fd6a-4514-8471-5a1cf3da59e4 admin admin] PATH_INFO: `/v3/projects/8b24db22bf554e45ad84e814852c4407` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:02.866511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7005e-fd6a-4514-8471-5a1cf3da59e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b24db22bf554e45ad84e814852c4407)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:02.868492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7005e-fd6a-4514-8471-5a1cf3da59e4 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:02.888438 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33547e3b-ee17-42c6-9e8c-b3d1c5ef30f5 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:02.889919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-33547e3b-ee17-42c6-9e8c-b3d1c5ef30f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:02.903946 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33547e3b-ee17-42c6-9e8c-b3d1c5ef30f5 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:02.917475 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15243d0c-277a-4fde-a891-80b358749da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:02.918463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15243d0c-277a-4fde-a891-80b358749da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:02.918833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15243d0c-277a-4fde-a891-80b358749da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:02.919122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15243d0c-277a-4fde-a891-80b358749da7 admin admin] PATH_INFO: `/v3/users/b9309d543dd34cdd9f22779268ca3504` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:02.920398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15243d0c-277a-4fde-a891-80b358749da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9309d543dd34cdd9f22779268ca3504)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:02.922150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-43f7005e-fd6a-4514-8471-5a1cf3da59e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b24db22bf554e45ad84e814852c4407', 'request_id': 'req-43f7005e-fd6a-4514-8471-5a1cf3da59e4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.922528 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15243d0c-277a-4fde-a891-80b358749da7 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:02.929196 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-43f7005e-fd6a-4514-8471-5a1cf3da59e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b24db22bf554e45ad84e814852c4407', 'request_id': 'req-43f7005e-fd6a-4514-8471-5a1cf3da59e4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.937592 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-43f7005e-fd6a-4514-8471-5a1cf3da59e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b24db22bf554e45ad84e814852c4407', 'request_id': 'req-43f7005e-fd6a-4514-8471-5a1cf3da59e4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.949437 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-43f7005e-fd6a-4514-8471-5a1cf3da59e4 admin admin] The token cache is being invalidate because project 8b24db22bf554e45ad84e814852c4407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:43:02.949904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-43f7005e-fd6a-4514-8471-5a1cf3da59e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.950685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-43f7005e-fd6a-4514-8471-5a1cf3da59e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.954245 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1365/2742] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:43:02 2022] DELETE /identity/v3/projects/8b24db22bf554e45ad84e814852c4407 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:02.959279 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed52e6-f173-4ac8-b35f-64f7a813aa3f None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:02.959635 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed52e6-f173-4ac8-b35f-64f7a813aa3f None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:02.959919 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed52e6-f173-4ac8-b35f-64f7a813aa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:02.978127 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-15243d0c-277a-4fde-a891-80b358749da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9309d543dd34cdd9f22779268ca3504'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.980701 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-27ed52e6-f173-4ac8-b35f-64f7a813aa3f None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:02.981926 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-27ed52e6-f173-4ac8-b35f-64f7a813aa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:02.986931 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-15243d0c-277a-4fde-a891-80b358749da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9309d543dd34cdd9f22779268ca3504'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:02.987564 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-15243d0c-277a-4fde-a891-80b358749da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9309d543dd34cdd9f22779268ca3504'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:03.002061 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-15243d0c-277a-4fde-a891-80b358749da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9309d543dd34cdd9f22779268ca3504'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:03.010017 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-15243d0c-277a-4fde-a891-80b358749da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9309d543dd34cdd9f22779268ca3504'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:03.020650 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1378/2743] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:43:02 2022] DELETE /identity/v3/users/b9309d543dd34cdd9f22779268ca3504 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:43:03.023201 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a95152-06d7-431e-aa79-4861dd114d5e None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:03.023500 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a95152-06d7-431e-aa79-4861dd114d5e None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:03.023786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a95152-06d7-431e-aa79-4861dd114d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:03.050812 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-e7a95152-06d7-431e-aa79-4861dd114d5e None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:03.052343 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e7a95152-06d7-431e-aa79-4861dd114d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:03.071777 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1366/2744] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:03.073375 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0074dec-4dd3-4703-af46-11527c6f7e5c None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:03.073829 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0074dec-4dd3-4703-af46-11527c6f7e5c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:03.074132 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0074dec-4dd3-4703-af46-11527c6f7e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:03.096059 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-e0074dec-4dd3-4703-af46-11527c6f7e5c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:03.096911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e0074dec-4dd3-4703-af46-11527c6f7e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:03.128977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1379/2745] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:03.138964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a95152-06d7-431e-aa79-4861dd114d5e None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:03.141817 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-e7a95152-06d7-431e-aa79-4861dd114d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:03.187161 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1367/2746] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:43:03.190915 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0074dec-4dd3-4703-af46-11527c6f7e5c None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:03.204089 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0074dec-4dd3-4703-af46-11527c6f7e5c None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:03.211038 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eaf6d-92c9-43d3-bfd4-3c3e087788c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:03.212395 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eaf6d-92c9-43d3-bfd4-3c3e087788c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:03.212899 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eaf6d-92c9-43d3-bfd4-3c3e087788c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:03.213391 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eaf6d-92c9-43d3-bfd4-3c3e087788c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:03.214439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eaf6d-92c9-43d3-bfd4-3c3e087788c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:43:03.215109 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eaf6d-92c9-43d3-bfd4-3c3e087788c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:03.215957 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a95152-06d7-431e-aa79-4861dd114d5e None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:03.217591 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eaf6d-92c9-43d3-bfd4-3c3e087788c3 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:03.220328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6797a-b9c1-4e1f-827a-69e02a829518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:03.221185 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6797a-b9c1-4e1f-827a-69e02a829518 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:03.221473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6797a-b9c1-4e1f-827a-69e02a829518 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:03.221827 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6797a-b9c1-4e1f-827a-69e02a829518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:03.232727 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6797a-b9c1-4e1f-827a-69e02a829518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:03.234635 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1368/2747] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:43:03.238444 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6797a-b9c1-4e1f-827a-69e02a829518 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:03.239716 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eaf6d-92c9-43d3-bfd4-3c3e087788c3 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:03.253200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1380/2748] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:43:03.257370 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eaf6d-92c9-43d3-bfd4-3c3e087788c3 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:03.263543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380bd0d-8b8c-45d3-b75b-bb834a3f785f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:03.264215 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380bd0d-8b8c-45d3-b75b-bb834a3f785f admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:03.264501 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380bd0d-8b8c-45d3-b75b-bb834a3f785f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:03.264779 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380bd0d-8b8c-45d3-b75b-bb834a3f785f admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:03.265481 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380bd0d-8b8c-45d3-b75b-bb834a3f785f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:03.267478 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380bd0d-8b8c-45d3-b75b-bb834a3f785f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:03.304225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1369/2749] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:43:03 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:43:03.307999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6797a-b9c1-4e1f-827a-69e02a829518 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:03.318825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6797a-b9c1-4e1f-827a-69e02a829518 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:03.398316 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385900bc-367d-4a4f-975d-583af30f3a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:03.399002 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385900bc-367d-4a4f-975d-583af30f3a76 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:03.399343 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385900bc-367d-4a4f-975d-583af30f3a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:03.399682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385900bc-367d-4a4f-975d-583af30f3a76 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:03.400396 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385900bc-367d-4a4f-975d-583af30f3a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:03.402591 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385900bc-367d-4a4f-975d-583af30f3a76 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:03.439732 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1381/2750] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:43:03 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:43:03.441185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380bd0d-8b8c-45d3-b75b-bb834a3f785f admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:03.456581 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380bd0d-8b8c-45d3-b75b-bb834a3f785f admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:03.463588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07c203-68f9-4229-b366-26dcc4258927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:03.465128 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07c203-68f9-4229-b366-26dcc4258927 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:03.465630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07c203-68f9-4229-b366-26dcc4258927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:03.466118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07c203-68f9-4229-b366-26dcc4258927 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:03.467735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07c203-68f9-4229-b366-26dcc4258927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:03.469849 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07c203-68f9-4229-b366-26dcc4258927 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:03.481617 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1370/2751] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:43:03.485263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385900bc-367d-4a4f-975d-583af30f3a76 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:03.501244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385900bc-367d-4a4f-975d-583af30f3a76 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:03.510291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c0cbb-7c13-4b62-b09e-fc4b80082a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:03.511245 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c0cbb-7c13-4b62-b09e-fc4b80082a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:03.511739 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c0cbb-7c13-4b62-b09e-fc4b80082a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:03.512160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c0cbb-7c13-4b62-b09e-fc4b80082a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:03.514364 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c0cbb-7c13-4b62-b09e-fc4b80082a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:03.516329 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c0cbb-7c13-4b62-b09e-fc4b80082a42 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:03.541164 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07c203-68f9-4229-b366-26dcc4258927 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:03.547098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1382/2752] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:43:03.554747 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07c203-68f9-4229-b366-26dcc4258927 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:03.561427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f66d9-c269-461c-a5bc-289498fa6bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:03.562378 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f66d9-c269-461c-a5bc-289498fa6bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:03.563957 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f66d9-c269-461c-a5bc-289498fa6bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:03.564122 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f66d9-c269-461c-a5bc-289498fa6bdb admin admin] PATH_INFO: `/v3/projects/0733e79f0aa5460191a7d3f586c12a9f/users/db58b5e04c204b2ebf6d896bb49afaa2/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:03.597244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f66d9-c269-461c-a5bc-289498fa6bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0733e79f0aa5460191a7d3f586c12a9f, user_id=db58b5e04c204b2ebf6d896bb49afaa2, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:03.601814 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f66d9-c269-461c-a5bc-289498fa6bdb admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:03.621798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1371/2753] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:43:03 2022] PUT /identity/v3/projects/0733e79f0aa5460191a7d3f586c12a9f/users/db58b5e04c204b2ebf6d896bb49afaa2/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:03.632452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c0cbb-7c13-4b62-b09e-fc4b80082a42 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:03.633936 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c37c0cbb-7c13-4b62-b09e-fc4b80082a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:03.644190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81fb58-2a2b-4b56-aa48-5aa0da58690a None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:03.645001 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81fb58-2a2b-4b56-aa48-5aa0da58690a None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:03.645506 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81fb58-2a2b-4b56-aa48-5aa0da58690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:03.669820 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c0cbb-7c13-4b62-b09e-fc4b80082a42 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:03.685297 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-1b81fb58-2a2b-4b56-aa48-5aa0da58690a None None] MFA Rules not processed for user `db58b5e04c204b2ebf6d896bb49afaa2`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:03.686680 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1b81fb58-2a2b-4b56-aa48-5aa0da58690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:03.745848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc990a-fbaa-4280-bf62-9a52ab820593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:03.747407 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc990a-fbaa-4280-bf62-9a52ab820593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:03.747896 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc990a-fbaa-4280-bf62-9a52ab820593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:03.748180 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc990a-fbaa-4280-bf62-9a52ab820593 admin admin] PATH_INFO: `/v3/projects/e7e35a3220954105811b0beb6974fcca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:03.750044 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc990a-fbaa-4280-bf62-9a52ab820593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e35a3220954105811b0beb6974fcca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:03.753244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc990a-fbaa-4280-bf62-9a52ab820593 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:03.793017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1372/2754] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:03.797728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81fb58-2a2b-4b56-aa48-5aa0da58690a None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:03.815587 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81fb58-2a2b-4b56-aa48-5aa0da58690a None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:03.825997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c2cc990a-fbaa-4280-bf62-9a52ab820593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e35a3220954105811b0beb6974fcca', 'request_id': 'req-c2cc990a-fbaa-4280-bf62-9a52ab820593'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:03.836246 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c2cc990a-fbaa-4280-bf62-9a52ab820593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e35a3220954105811b0beb6974fcca', 'request_id': 'req-c2cc990a-fbaa-4280-bf62-9a52ab820593'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:03.846868 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c2cc990a-fbaa-4280-bf62-9a52ab820593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e35a3220954105811b0beb6974fcca', 'request_id': 'req-c2cc990a-fbaa-4280-bf62-9a52ab820593'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:03.862132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c2cc990a-fbaa-4280-bf62-9a52ab820593 admin admin] The token cache is being invalidate because project e7e35a3220954105811b0beb6974fcca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:43:03.862539 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c2cc990a-fbaa-4280-bf62-9a52ab820593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:03.863357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-c2cc990a-fbaa-4280-bf62-9a52ab820593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:03.865801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1383/2755] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:43:03 2022] DELETE /identity/v3/projects/e7e35a3220954105811b0beb6974fcca => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:03.917515 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf409fe-546a-45af-9b2b-c6d44b079bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:03.918295 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf409fe-546a-45af-9b2b-c6d44b079bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:03.918604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf409fe-546a-45af-9b2b-c6d44b079bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:03.918871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf409fe-546a-45af-9b2b-c6d44b079bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:03.919595 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf409fe-546a-45af-9b2b-c6d44b079bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:03.921645 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf409fe-546a-45af-9b2b-c6d44b079bf3 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:03.965721 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1373/2756] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:43:03 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:43:03.970391 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc990a-fbaa-4280-bf62-9a52ab820593 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:03.973869 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c2cc990a-fbaa-4280-bf62-9a52ab820593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:03.989494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc990a-fbaa-4280-bf62-9a52ab820593 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:04.094465 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30980c74-9671-42b4-891f-31e37193da75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:04.095165 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30980c74-9671-42b4-891f-31e37193da75 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:04.095448 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30980c74-9671-42b4-891f-31e37193da75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:04.095829 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30980c74-9671-42b4-891f-31e37193da75 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:04.096682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30980c74-9671-42b4-891f-31e37193da75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:04.098833 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30980c74-9671-42b4-891f-31e37193da75 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:04.131714 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1384/2757] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:43:03 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:43:04.136209 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf409fe-546a-45af-9b2b-c6d44b079bf3 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:04.148442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf409fe-546a-45af-9b2b-c6d44b079bf3 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:04.158567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f310188-e782-473c-9eb9-3da5ce0ca081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:04.159253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f310188-e782-473c-9eb9-3da5ce0ca081 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:04.159543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f310188-e782-473c-9eb9-3da5ce0ca081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:04.159821 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f310188-e782-473c-9eb9-3da5ce0ca081 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:04.160618 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f310188-e782-473c-9eb9-3da5ce0ca081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:04.162335 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f310188-e782-473c-9eb9-3da5ce0ca081 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:04.181450 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1374/2758] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:43:04.182432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30980c74-9671-42b4-891f-31e37193da75 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:04.200769 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30980c74-9671-42b4-891f-31e37193da75 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:04.205805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14966c3f-acfa-42e5-8251-840ec2e8e608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:04.206841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14966c3f-acfa-42e5-8251-840ec2e8e608 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:04.207189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14966c3f-acfa-42e5-8251-840ec2e8e608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:04.207536 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14966c3f-acfa-42e5-8251-840ec2e8e608 admin admin] PATH_INFO: `/v3/projects/0ce31551d90343a6a3a16a820de39494/users/8a5ec9273075424f9306b443886fc8fa/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:04.224620 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14966c3f-acfa-42e5-8251-840ec2e8e608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce31551d90343a6a3a16a820de39494, user_id=8a5ec9273075424f9306b443886fc8fa, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:04.228019 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14966c3f-acfa-42e5-8251-840ec2e8e608 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:04.246738 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1385/2759] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:43:04 2022] PUT /identity/v3/projects/0ce31551d90343a6a3a16a820de39494/users/8a5ec9273075424f9306b443886fc8fa/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:04.250597 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f310188-e782-473c-9eb9-3da5ce0ca081 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:04.263748 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f310188-e782-473c-9eb9-3da5ce0ca081 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:04.320738 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377f795-0376-4b00-a7d9-a0eadeae326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:04.321372 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377f795-0376-4b00-a7d9-a0eadeae326f admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:04.321918 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377f795-0376-4b00-a7d9-a0eadeae326f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:04.322268 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377f795-0376-4b00-a7d9-a0eadeae326f admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:04.322983 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377f795-0376-4b00-a7d9-a0eadeae326f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:04.324663 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377f795-0376-4b00-a7d9-a0eadeae326f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:04.334867 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1375/2760] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:43:04.338914 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14966c3f-acfa-42e5-8251-840ec2e8e608 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:04.349651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14966c3f-acfa-42e5-8251-840ec2e8e608 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:04.354003 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0b0fc-8f2a-4664-88af-f97a326b217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:04.354955 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0b0fc-8f2a-4664-88af-f97a326b217c admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:04.355252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0b0fc-8f2a-4664-88af-f97a326b217c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:04.355509 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0b0fc-8f2a-4664-88af-f97a326b217c admin admin] PATH_INFO: `/v3/projects/0ce31551d90343a6a3a16a820de39494/users/8a5ec9273075424f9306b443886fc8fa/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:04.357504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0b0fc-8f2a-4664-88af-f97a326b217c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce31551d90343a6a3a16a820de39494, user_id=8a5ec9273075424f9306b443886fc8fa, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:04.360193 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0b0fc-8f2a-4664-88af-f97a326b217c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:04.371772 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1386/2761] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:43:04 2022] PUT /identity/v3/projects/0ce31551d90343a6a3a16a820de39494/users/8a5ec9273075424f9306b443886fc8fa/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:43:04.382232 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e41a0-a89f-4764-9743-9ab11b5ca025 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:04.382603 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e41a0-a89f-4764-9743-9ab11b5ca025 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:04.382891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e41a0-a89f-4764-9743-9ab11b5ca025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:04.411809 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-f70e41a0-a89f-4764-9743-9ab11b5ca025 None None] MFA Rules not processed for user `8a5ec9273075424f9306b443886fc8fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:04.413082 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f70e41a0-a89f-4764-9743-9ab11b5ca025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:04.481945 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1376/2762] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:04.493301 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0b0fc-8f2a-4664-88af-f97a326b217c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:04.495016 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-54a0b0fc-8f2a-4664-88af-f97a326b217c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:04.559964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0b0fc-8f2a-4664-88af-f97a326b217c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:04.563777 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d19c6-a461-4431-9b54-575b82dd5aab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:04.564441 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d19c6-a461-4431-9b54-575b82dd5aab service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:04.565375 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d19c6-a461-4431-9b54-575b82dd5aab service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:04.565669 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d19c6-a461-4431-9b54-575b82dd5aab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:04.567605 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a77d19c6-a461-4431-9b54-575b82dd5aab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:04.632990 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d19c6-a461-4431-9b54-575b82dd5aab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:04.634618 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d19c6-a461-4431-9b54-575b82dd5aab service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:04.644571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1387/2763] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:43:06.738683 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495880af-ce3c-4be4-bf9c-971e5cfd4d78 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:06.739250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495880af-ce3c-4be4-bf9c-971e5cfd4d78 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:06.739250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495880af-ce3c-4be4-bf9c-971e5cfd4d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:06.769181 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-495880af-ce3c-4be4-bf9c-971e5cfd4d78 None None] MFA Rules not processed for user `f0c4bc87acf84ad181e20fe4ea9d5d45`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:06.771189 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-495880af-ce3c-4be4-bf9c-971e5cfd4d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:06.848007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1377/2764] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:06.853053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d19c6-a461-4431-9b54-575b82dd5aab service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:06.854483 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a77d19c6-a461-4431-9b54-575b82dd5aab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:06.955400 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d19c6-a461-4431-9b54-575b82dd5aab service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:06.962200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09aa4c6-92dc-4b43-8b0d-8dcd10339259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:06.962856 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09aa4c6-92dc-4b43-8b0d-8dcd10339259 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:06.969263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09aa4c6-92dc-4b43-8b0d-8dcd10339259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:06.969600 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09aa4c6-92dc-4b43-8b0d-8dcd10339259 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:06.970390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09aa4c6-92dc-4b43-8b0d-8dcd10339259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:06.972357 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09aa4c6-92dc-4b43-8b0d-8dcd10339259 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:07.008498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1388/2765] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:43:06 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:43:07.012465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495880af-ce3c-4be4-bf9c-971e5cfd4d78 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:07.024792 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495880af-ce3c-4be4-bf9c-971e5cfd4d78 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:07.086997 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53ed34-3d73-4449-aa45-23dc57f411f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:07.087689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53ed34-3d73-4449-aa45-23dc57f411f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:07.087972 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53ed34-3d73-4449-aa45-23dc57f411f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:07.088253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53ed34-3d73-4449-aa45-23dc57f411f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:07.088965 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53ed34-3d73-4449-aa45-23dc57f411f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:07.090975 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53ed34-3d73-4449-aa45-23dc57f411f5 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:07.111949 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1378/2766] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:43:07 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:43:07.116044 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09aa4c6-92dc-4b43-8b0d-8dcd10339259 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:07.127341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09aa4c6-92dc-4b43-8b0d-8dcd10339259 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:07.132710 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd7a32-c05b-46f0-83ae-8e46f2ba4575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:07.133393 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd7a32-c05b-46f0-83ae-8e46f2ba4575 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:07.133679 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd7a32-c05b-46f0-83ae-8e46f2ba4575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:07.133968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd7a32-c05b-46f0-83ae-8e46f2ba4575 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:07.134712 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd7a32-c05b-46f0-83ae-8e46f2ba4575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:07.136310 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd7a32-c05b-46f0-83ae-8e46f2ba4575 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:07.148569 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1389/2767] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:43:07.152921 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53ed34-3d73-4449-aa45-23dc57f411f5 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:07.163427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53ed34-3d73-4449-aa45-23dc57f411f5 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:07.168207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a12ce5-ad89-4965-be7e-d0ac77f9d77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:07.169107 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a12ce5-ad89-4965-be7e-d0ac77f9d77f admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:07.169387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a12ce5-ad89-4965-be7e-d0ac77f9d77f admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:07.169672 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a12ce5-ad89-4965-be7e-d0ac77f9d77f admin admin] PATH_INFO: `/v3/projects/05d3ac60b3954296bb700b798e336788/users/79c976aa098b4f6597937b02ab332aae/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:07.188302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a12ce5-ad89-4965-be7e-d0ac77f9d77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d3ac60b3954296bb700b798e336788, user_id=79c976aa098b4f6597937b02ab332aae, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:07.191032 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a12ce5-ad89-4965-be7e-d0ac77f9d77f admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:07.208936 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1379/2768] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:43:07 2022] PUT /identity/v3/projects/05d3ac60b3954296bb700b798e336788/users/79c976aa098b4f6597937b02ab332aae/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:07.213244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd7a32-c05b-46f0-83ae-8e46f2ba4575 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:07.223814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd7a32-c05b-46f0-83ae-8e46f2ba4575 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:07.282997 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee5dc7-4a90-4c5f-bd1c-39b5ef4b8baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:07.283672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5dc7-4a90-4c5f-bd1c-39b5ef4b8baf admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:07.283958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5dc7-4a90-4c5f-bd1c-39b5ef4b8baf admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:07.284236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5dc7-4a90-4c5f-bd1c-39b5ef4b8baf admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:07.284978 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee5dc7-4a90-4c5f-bd1c-39b5ef4b8baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:07.287625 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee5dc7-4a90-4c5f-bd1c-39b5ef4b8baf admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:07.298296 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1390/2769] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:43:07.302846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a12ce5-ad89-4965-be7e-d0ac77f9d77f admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:07.319868 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a12ce5-ad89-4965-be7e-d0ac77f9d77f admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:07.324977 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb62dd-cd90-4ecf-ac10-0b0d40869518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:07.325878 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb62dd-cd90-4ecf-ac10-0b0d40869518 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:07.326687 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb62dd-cd90-4ecf-ac10-0b0d40869518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:07.327031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb62dd-cd90-4ecf-ac10-0b0d40869518 admin admin] PATH_INFO: `/v3/projects/05d3ac60b3954296bb700b798e336788/users/79c976aa098b4f6597937b02ab332aae/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:07.329193 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb62dd-cd90-4ecf-ac10-0b0d40869518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d3ac60b3954296bb700b798e336788, user_id=79c976aa098b4f6597937b02ab332aae, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:07.332041 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb62dd-cd90-4ecf-ac10-0b0d40869518 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:07.343441 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1380/2770] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:43:07 2022] PUT /identity/v3/projects/05d3ac60b3954296bb700b798e336788/users/79c976aa098b4f6597937b02ab332aae/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:09.199637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee5dc7-4a90-4c5f-bd1c-39b5ef4b8baf admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:09.202797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-4eee5dc7-4a90-4c5f-bd1c-39b5ef4b8baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:09.268055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee5dc7-4a90-4c5f-bd1c-39b5ef4b8baf admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:09.322651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb1671-04c2-4d95-ae25-16a1189a9dfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:09.323840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb1671-04c2-4d95-ae25-16a1189a9dfa service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:09.324298 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb1671-04c2-4d95-ae25-16a1189a9dfa service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:09.324942 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb1671-04c2-4d95-ae25-16a1189a9dfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:09.395375 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb1671-04c2-4d95-ae25-16a1189a9dfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:09.397565 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb1671-04c2-4d95-ae25-16a1189a9dfa service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:09.409255 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1391/2771] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:43:12.100312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912bb95-01d9-41bd-a32c-4eb396f6abba None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:12.100917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912bb95-01d9-41bd-a32c-4eb396f6abba None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:12.100917 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912bb95-01d9-41bd-a32c-4eb396f6abba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:12.138588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7912bb95-01d9-41bd-a32c-4eb396f6abba None None] MFA Rules not processed for user `79c976aa098b4f6597937b02ab332aae`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:12.139825 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7912bb95-01d9-41bd-a32c-4eb396f6abba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:12.223417 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1381/2772] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:12.235328 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb1671-04c2-4d95-ae25-16a1189a9dfa service cinder] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:12.236809 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ebeb1671-04c2-4d95-ae25-16a1189a9dfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:12.299729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb1671-04c2-4d95-ae25-16a1189a9dfa service cinder] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:12.303659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99bdab-1cb8-4176-920b-9ab1d2611bb0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34ff47d8c4f4d99955340ddbdc3d475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:12.304350 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99bdab-1cb8-4176-920b-9ab1d2611bb0 service glance] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:12.304589 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99bdab-1cb8-4176-920b-9ab1d2611bb0 service glance] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:12.304867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99bdab-1cb8-4176-920b-9ab1d2611bb0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:12.401523 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99bdab-1cb8-4176-920b-9ab1d2611bb0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:12.403520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99bdab-1cb8-4176-920b-9ab1d2611bb0 service glance] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:12.414547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1392/2773] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:43:12.524061 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b387543-b62d-4a5d-91ae-0911a964e89e None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:12.524357 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b387543-b62d-4a5d-91ae-0911a964e89e None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:12.524942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b387543-b62d-4a5d-91ae-0911a964e89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:12.543896 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-6b387543-b62d-4a5d-91ae-0911a964e89e None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:12.545192 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-6b387543-b62d-4a5d-91ae-0911a964e89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:12.611694 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1382/2774] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 14:43:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:12.666695 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99bdab-1cb8-4176-920b-9ab1d2611bb0 service glance] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:12.668592 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-0c99bdab-1cb8-4176-920b-9ab1d2611bb0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:12.749614 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99bdab-1cb8-4176-920b-9ab1d2611bb0 service glance] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:12.755779 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dae51c-d012-4b05-bde5-e3c8b65ce8e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:12.756466 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dae51c-d012-4b05-bde5-e3c8b65ce8e5 service swift] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:12.756932 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dae51c-d012-4b05-bde5-e3c8b65ce8e5 service swift] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:12.757641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dae51c-d012-4b05-bde5-e3c8b65ce8e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:12.766098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dae51c-d012-4b05-bde5-e3c8b65ce8e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:12.767784 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dae51c-d012-4b05-bde5-e3c8b65ce8e5 service swift] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:12.777360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1393/2775] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:43:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:43:14.707287 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b387543-b62d-4a5d-91ae-0911a964e89e None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:14.785263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b387543-b62d-4a5d-91ae-0911a964e89e None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:14.792415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db7218-eb60-4465-8f80-8b695ddf2476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:14.793259 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7218-eb60-4465-8f80-8b695ddf2476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:14.793631 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7218-eb60-4465-8f80-8b695ddf2476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:14.794135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7218-eb60-4465-8f80-8b695ddf2476 admin admin] PATH_INFO: `/v3/users/db58b5e04c204b2ebf6d896bb49afaa2` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:14.795458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db7218-eb60-4465-8f80-8b695ddf2476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db58b5e04c204b2ebf6d896bb49afaa2)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:14.798332 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db7218-eb60-4465-8f80-8b695ddf2476 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:14.883369 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-91db7218-eb60-4465-8f80-8b695ddf2476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db58b5e04c204b2ebf6d896bb49afaa2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:14.890708 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-91db7218-eb60-4465-8f80-8b695ddf2476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db58b5e04c204b2ebf6d896bb49afaa2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:14.891605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-91db7218-eb60-4465-8f80-8b695ddf2476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db58b5e04c204b2ebf6d896bb49afaa2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:14.911104 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-91db7218-eb60-4465-8f80-8b695ddf2476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db58b5e04c204b2ebf6d896bb49afaa2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:14.925891 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-91db7218-eb60-4465-8f80-8b695ddf2476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db58b5e04c204b2ebf6d896bb49afaa2'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:14.935244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1383/2776] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:43:14 2022] DELETE /identity/v3/users/db58b5e04c204b2ebf6d896bb49afaa2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:14.940990 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09747e26-c568-4d73-bcb5-766725f0849c None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:14.942545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09747e26-c568-4d73-bcb5-766725f0849c None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:14.943582 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09747e26-c568-4d73-bcb5-766725f0849c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:14.979274 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-09747e26-c568-4d73-bcb5-766725f0849c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:14.980516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-09747e26-c568-4d73-bcb5-766725f0849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:15.119382 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1394/2777] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:15.130958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db7218-eb60-4465-8f80-8b695ddf2476 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:15.132726 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-91db7218-eb60-4465-8f80-8b695ddf2476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:15.272774 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db7218-eb60-4465-8f80-8b695ddf2476 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:15.278981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872aa1c-10cc-4535-ac05-2718584e196a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:15.279732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872aa1c-10cc-4535-ac05-2718584e196a service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:15.280090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872aa1c-10cc-4535-ac05-2718584e196a service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:15.280439 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872aa1c-10cc-4535-ac05-2718584e196a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:15.291793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872aa1c-10cc-4535-ac05-2718584e196a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:15.293390 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872aa1c-10cc-4535-ac05-2718584e196a service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:15.320598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1384/2778] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:43:15.685265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09747e26-c568-4d73-bcb5-766725f0849c None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:15.686747 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-09747e26-c568-4d73-bcb5-766725f0849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:15.706068 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09747e26-c568-4d73-bcb5-766725f0849c None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:15.714079 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d68e6-85bf-4b29-997f-699587077d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:15.715828 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d68e6-85bf-4b29-997f-699587077d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:15.716189 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d68e6-85bf-4b29-997f-699587077d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:15.716538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d68e6-85bf-4b29-997f-699587077d81 admin admin] PATH_INFO: `/v3/projects/0733e79f0aa5460191a7d3f586c12a9f` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:15.717878 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d68e6-85bf-4b29-997f-699587077d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0733e79f0aa5460191a7d3f586c12a9f)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:15.719976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d68e6-85bf-4b29-997f-699587077d81 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:15.793279 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-111d68e6-85bf-4b29-997f-699587077d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0733e79f0aa5460191a7d3f586c12a9f', 'request_id': 'req-111d68e6-85bf-4b29-997f-699587077d81'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:15.800546 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-111d68e6-85bf-4b29-997f-699587077d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0733e79f0aa5460191a7d3f586c12a9f', 'request_id': 'req-111d68e6-85bf-4b29-997f-699587077d81'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:15.810214 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-111d68e6-85bf-4b29-997f-699587077d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0733e79f0aa5460191a7d3f586c12a9f', 'request_id': 'req-111d68e6-85bf-4b29-997f-699587077d81'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:15.823053 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-111d68e6-85bf-4b29-997f-699587077d81 admin admin] The token cache is being invalidate because project 0733e79f0aa5460191a7d3f586c12a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:43:15.823427 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-111d68e6-85bf-4b29-997f-699587077d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:15.824368 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-111d68e6-85bf-4b29-997f-699587077d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:15.828722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1395/2779] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:43:15 2022] DELETE /identity/v3/projects/0733e79f0aa5460191a7d3f586c12a9f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:15.829907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872aa1c-10cc-4535-ac05-2718584e196a service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:15.846888 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872aa1c-10cc-4535-ac05-2718584e196a service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:15.921890 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb1d60-4ac6-4647-82d7-0781e0804141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:15.922818 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb1d60-4ac6-4647-82d7-0781e0804141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:15.923106 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb1d60-4ac6-4647-82d7-0781e0804141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:15.923386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb1d60-4ac6-4647-82d7-0781e0804141 admin admin] PATH_INFO: `/v3/users/8a5ec9273075424f9306b443886fc8fa` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:15.924918 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb1d60-4ac6-4647-82d7-0781e0804141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5ec9273075424f9306b443886fc8fa)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:15.928701 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb1d60-4ac6-4647-82d7-0781e0804141 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:16.009445 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-05fb1d60-4ac6-4647-82d7-0781e0804141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5ec9273075424f9306b443886fc8fa'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:16.021602 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-05fb1d60-4ac6-4647-82d7-0781e0804141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5ec9273075424f9306b443886fc8fa'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:16.022400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-05fb1d60-4ac6-4647-82d7-0781e0804141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5ec9273075424f9306b443886fc8fa'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:16.041169 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-05fb1d60-4ac6-4647-82d7-0781e0804141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5ec9273075424f9306b443886fc8fa'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:16.051593 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-05fb1d60-4ac6-4647-82d7-0781e0804141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5ec9273075424f9306b443886fc8fa'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:16.066575 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1385/2780] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:43:15 2022] DELETE /identity/v3/users/8a5ec9273075424f9306b443886fc8fa => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:16.480482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d68e6-85bf-4b29-997f-699587077d81 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:16.482319 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-111d68e6-85bf-4b29-997f-699587077d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:16.500937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d68e6-85bf-4b29-997f-699587077d81 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:16.596886 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4f8ce-fbfc-44c8-9ec1-4bb080133ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:16.597940 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4f8ce-fbfc-44c8-9ec1-4bb080133ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:16.600637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4f8ce-fbfc-44c8-9ec1-4bb080133ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:16.601050 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4f8ce-fbfc-44c8-9ec1-4bb080133ac5 admin admin] PATH_INFO: `/v3/projects/0ce31551d90343a6a3a16a820de39494` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:16.604032 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4f8ce-fbfc-44c8-9ec1-4bb080133ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce31551d90343a6a3a16a820de39494)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:16.606206 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4f8ce-fbfc-44c8-9ec1-4bb080133ac5 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:16.702615 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2fb4f8ce-fbfc-44c8-9ec1-4bb080133ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce31551d90343a6a3a16a820de39494', 'request_id': 'req-2fb4f8ce-fbfc-44c8-9ec1-4bb080133ac5'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:16.718723 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2fb4f8ce-fbfc-44c8-9ec1-4bb080133ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce31551d90343a6a3a16a820de39494', 'request_id': 'req-2fb4f8ce-fbfc-44c8-9ec1-4bb080133ac5'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:16.743963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2fb4f8ce-fbfc-44c8-9ec1-4bb080133ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce31551d90343a6a3a16a820de39494', 'request_id': 'req-2fb4f8ce-fbfc-44c8-9ec1-4bb080133ac5'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:16.790958 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2fb4f8ce-fbfc-44c8-9ec1-4bb080133ac5 admin admin] The token cache is being invalidate because project 0ce31551d90343a6a3a16a820de39494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:43:16.794599 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2fb4f8ce-fbfc-44c8-9ec1-4bb080133ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:16.795563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-2fb4f8ce-fbfc-44c8-9ec1-4bb080133ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:16.797962 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1396/2781] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:43:16 2022] DELETE /identity/v3/projects/0ce31551d90343a6a3a16a820de39494 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:16.805337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112fe62-7c0d-4de1-94f1-7facfd6e2e58 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:16.805644 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112fe62-7c0d-4de1-94f1-7facfd6e2e58 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:16.805907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112fe62-7c0d-4de1-94f1-7facfd6e2e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:16.836111 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-9112fe62-7c0d-4de1-94f1-7facfd6e2e58 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:16.839337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-9112fe62-7c0d-4de1-94f1-7facfd6e2e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:16.963747 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1386/2782] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:16.972120 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84101e9f-ab8c-40b3-98ba-b618349150e3 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:16.972416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84101e9f-ab8c-40b3-98ba-b618349150e3 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:16.972698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84101e9f-ab8c-40b3-98ba-b618349150e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:16.994498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-84101e9f-ab8c-40b3-98ba-b618349150e3 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:16.995724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-84101e9f-ab8c-40b3-98ba-b618349150e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:17.005488 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1397/2783] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:43:17.009700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112fe62-7c0d-4de1-94f1-7facfd6e2e58 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:17.020405 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112fe62-7c0d-4de1-94f1-7facfd6e2e58 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:17.030673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89cc2a-53cc-4760-be1c-939b4de64fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:17.031689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89cc2a-53cc-4760-be1c-939b4de64fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:17.032178 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89cc2a-53cc-4760-be1c-939b4de64fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:17.032664 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89cc2a-53cc-4760-be1c-939b4de64fa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:17.033602 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89cc2a-53cc-4760-be1c-939b4de64fa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:43:17.034110 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89cc2a-53cc-4760-be1c-939b4de64fa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:17.035982 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89cc2a-53cc-4760-be1c-939b4de64fa7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:17.054301 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1387/2784] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:43:17.057166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84101e9f-ab8c-40b3-98ba-b618349150e3 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:17.070449 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84101e9f-ab8c-40b3-98ba-b618349150e3 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:17.078452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5067ea8-efe7-4dbf-80b2-4e561b56955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:17.079166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5067ea8-efe7-4dbf-80b2-4e561b56955f admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:17.079451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5067ea8-efe7-4dbf-80b2-4e561b56955f admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:17.079725 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5067ea8-efe7-4dbf-80b2-4e561b56955f admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:17.080419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5067ea8-efe7-4dbf-80b2-4e561b56955f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:17.082393 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5067ea8-efe7-4dbf-80b2-4e561b56955f admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:17.122374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1398/2785] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:43:17 2022] POST /identity/v3/projects => generated 361 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:43:17.126611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89cc2a-53cc-4760-be1c-939b4de64fa7 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:17.144632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89cc2a-53cc-4760-be1c-939b4de64fa7 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:17.216988 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fe61e-eeff-4e34-bf8e-a5a2e528ece9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:17.217674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fe61e-eeff-4e34-bf8e-a5a2e528ece9 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:17.217959 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fe61e-eeff-4e34-bf8e-a5a2e528ece9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:17.218270 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fe61e-eeff-4e34-bf8e-a5a2e528ece9 admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:17.219130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fe61e-eeff-4e34-bf8e-a5a2e528ece9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:17.221237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fe61e-eeff-4e34-bf8e-a5a2e528ece9 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:17.247155 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1388/2786] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:43:17 2022] POST /identity/v3/users => generated 281 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:43:17.251374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5067ea8-efe7-4dbf-80b2-4e561b56955f admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:17.262532 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5067ea8-efe7-4dbf-80b2-4e561b56955f admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:17.271453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eee2b-a885-4a89-bb49-d9a19a3e982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:17.272229 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eee2b-a885-4a89-bb49-d9a19a3e982d admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:17.272586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eee2b-a885-4a89-bb49-d9a19a3e982d admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:17.272935 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eee2b-a885-4a89-bb49-d9a19a3e982d admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:17.273747 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495eee2b-a885-4a89-bb49-d9a19a3e982d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:17.275477 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495eee2b-a885-4a89-bb49-d9a19a3e982d admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:17.288412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1399/2787] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:43:17.292387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fe61e-eeff-4e34-bf8e-a5a2e528ece9 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:17.308176 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fe61e-eeff-4e34-bf8e-a5a2e528ece9 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:17.313604 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf8b86-bcfc-435a-b4bd-4898a8d5bec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:17.314401 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf8b86-bcfc-435a-b4bd-4898a8d5bec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:17.314758 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf8b86-bcfc-435a-b4bd-4898a8d5bec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:17.315123 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf8b86-bcfc-435a-b4bd-4898a8d5bec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:17.315860 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf8b86-bcfc-435a-b4bd-4898a8d5bec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:17.317981 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf8b86-bcfc-435a-b4bd-4898a8d5bec6 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:17.334207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1389/2788] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:43:17.335071 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eee2b-a885-4a89-bb49-d9a19a3e982d admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:17.345969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eee2b-a885-4a89-bb49-d9a19a3e982d admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:17.351339 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fe64d-0576-4a8f-80a0-a7ebafdc2798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:17.352225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fe64d-0576-4a8f-80a0-a7ebafdc2798 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:17.352507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fe64d-0576-4a8f-80a0-a7ebafdc2798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:17.352787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fe64d-0576-4a8f-80a0-a7ebafdc2798 admin admin] PATH_INFO: `/v3/projects/3349d5da866b49aab16e57771640ab6d/users/36aeee51c33a46aea7d911472feee470/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:17.369951 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fe64d-0576-4a8f-80a0-a7ebafdc2798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3349d5da866b49aab16e57771640ab6d, user_id=36aeee51c33a46aea7d911472feee470, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:17.374546 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fe64d-0576-4a8f-80a0-a7ebafdc2798 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:17.400372 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1400/2789] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:43:17 2022] PUT /identity/v3/projects/3349d5da866b49aab16e57771640ab6d/users/36aeee51c33a46aea7d911472feee470/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:43:17.412606 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0c9c5-342a-48d9-9916-23b841e27b18 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:17.412937 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0c9c5-342a-48d9-9916-23b841e27b18 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:17.413177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0c9c5-342a-48d9-9916-23b841e27b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:17.443444 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-74e0c9c5-342a-48d9-9916-23b841e27b18 None None] MFA Rules not processed for user `36aeee51c33a46aea7d911472feee470`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:17.444670 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-74e0c9c5-342a-48d9-9916-23b841e27b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:17.524903 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1390/2790] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:17.563886 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fe64d-0576-4a8f-80a0-a7ebafdc2798 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:17.565682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-d22fe64d-0576-4a8f-80a0-a7ebafdc2798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:17.628413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fe64d-0576-4a8f-80a0-a7ebafdc2798 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:17.633663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb4cd6-62c4-40e0-86a7-681d974edd91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:17.634783 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb4cd6-62c4-40e0-86a7-681d974edd91 service cinder] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:17.637885 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb4cd6-62c4-40e0-86a7-681d974edd91 service cinder] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:17.638496 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb4cd6-62c4-40e0-86a7-681d974edd91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:17.649673 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb4cd6-62c4-40e0-86a7-681d974edd91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:17.651244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb4cd6-62c4-40e0-86a7-681d974edd91 service cinder] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:17.665841 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1401/2791] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:43:17.682846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0c9c5-342a-48d9-9916-23b841e27b18 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:17.768492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0c9c5-342a-48d9-9916-23b841e27b18 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:17.775879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90accd9-b3b9-44dc-a73e-33538c7765d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:17.776993 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90accd9-b3b9-44dc-a73e-33538c7765d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:17.777367 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90accd9-b3b9-44dc-a73e-33538c7765d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:17.777729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90accd9-b3b9-44dc-a73e-33538c7765d0 admin admin] PATH_INFO: `/v3/users/36aeee51c33a46aea7d911472feee470` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:17.783959 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90accd9-b3b9-44dc-a73e-33538c7765d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36aeee51c33a46aea7d911472feee470)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:17.786116 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90accd9-b3b9-44dc-a73e-33538c7765d0 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:17.853310 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f90accd9-b3b9-44dc-a73e-33538c7765d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36aeee51c33a46aea7d911472feee470'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:17.864130 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f90accd9-b3b9-44dc-a73e-33538c7765d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36aeee51c33a46aea7d911472feee470'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:17.866101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f90accd9-b3b9-44dc-a73e-33538c7765d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36aeee51c33a46aea7d911472feee470'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:17.879305 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f90accd9-b3b9-44dc-a73e-33538c7765d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36aeee51c33a46aea7d911472feee470'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:17.890101 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-f90accd9-b3b9-44dc-a73e-33538c7765d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36aeee51c33a46aea7d911472feee470'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:17.900437 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1391/2792] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:43:17 2022] DELETE /identity/v3/users/36aeee51c33a46aea7d911472feee470 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:17.905218 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042853ca-f8ea-4233-bf21-db4befb974db None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:17.905818 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042853ca-f8ea-4233-bf21-db4befb974db None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:17.906098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042853ca-f8ea-4233-bf21-db4befb974db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:17.927852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-042853ca-f8ea-4233-bf21-db4befb974db None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:17.929090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-042853ca-f8ea-4233-bf21-db4befb974db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:18.012677 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1402/2793] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:18.022838 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90accd9-b3b9-44dc-a73e-33538c7765d0 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:18.024308 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f90accd9-b3b9-44dc-a73e-33538c7765d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:18.105739 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90accd9-b3b9-44dc-a73e-33538c7765d0 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:18.109527 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a11c7f-c304-4109-b586-352984b0332f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:18.110205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a11c7f-c304-4109-b586-352984b0332f service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:18.110518 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a11c7f-c304-4109-b586-352984b0332f service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:18.110789 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a11c7f-c304-4109-b586-352984b0332f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:18.121522 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a11c7f-c304-4109-b586-352984b0332f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:18.123006 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a11c7f-c304-4109-b586-352984b0332f service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:18.137498 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1392/2794] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:43:18.491049 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042853ca-f8ea-4233-bf21-db4befb974db None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:18.492529 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-042853ca-f8ea-4233-bf21-db4befb974db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:18.506798 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042853ca-f8ea-4233-bf21-db4befb974db None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:18.512307 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f62ad4-1a11-4c31-b44c-7c32b16da057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:18.513390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f62ad4-1a11-4c31-b44c-7c32b16da057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:18.513531 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f62ad4-1a11-4c31-b44c-7c32b16da057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:18.513721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f62ad4-1a11-4c31-b44c-7c32b16da057 admin admin] PATH_INFO: `/v3/projects/3349d5da866b49aab16e57771640ab6d` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:18.514940 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f62ad4-1a11-4c31-b44c-7c32b16da057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3349d5da866b49aab16e57771640ab6d)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:18.516870 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f62ad4-1a11-4c31-b44c-7c32b16da057 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:18.573792 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-16f62ad4-1a11-4c31-b44c-7c32b16da057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3349d5da866b49aab16e57771640ab6d', 'request_id': 'req-16f62ad4-1a11-4c31-b44c-7c32b16da057'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:18.580452 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-16f62ad4-1a11-4c31-b44c-7c32b16da057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3349d5da866b49aab16e57771640ab6d', 'request_id': 'req-16f62ad4-1a11-4c31-b44c-7c32b16da057'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:18.591613 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-16f62ad4-1a11-4c31-b44c-7c32b16da057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3349d5da866b49aab16e57771640ab6d', 'request_id': 'req-16f62ad4-1a11-4c31-b44c-7c32b16da057'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:18.611289 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-16f62ad4-1a11-4c31-b44c-7c32b16da057 admin admin] The token cache is being invalidate because project 3349d5da866b49aab16e57771640ab6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:43:18.611916 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-16f62ad4-1a11-4c31-b44c-7c32b16da057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:18.613177 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-16f62ad4-1a11-4c31-b44c-7c32b16da057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:43:18.615721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1403/2795] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:43:18 2022] DELETE /identity/v3/projects/3349d5da866b49aab16e57771640ab6d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:43:18.620307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eda81-df67-4944-b014-a85e72e0b05e None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:18.620594 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eda81-df67-4944-b014-a85e72e0b05e None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:18.620871 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eda81-df67-4944-b014-a85e72e0b05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:18.640308 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-ad3eda81-df67-4944-b014-a85e72e0b05e None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:18.641617 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ad3eda81-df67-4944-b014-a85e72e0b05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:18.722212 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1393/2796] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:18.726825 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3915cf0-c520-4f8d-8f19-843b2745a407 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:18.727467 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3915cf0-c520-4f8d-8f19-843b2745a407 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:18.727929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3915cf0-c520-4f8d-8f19-843b2745a407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:18.752496 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c3915cf0-c520-4f8d-8f19-843b2745a407 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:18.753954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c3915cf0-c520-4f8d-8f19-843b2745a407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:18.767101 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1404/2797] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:18.768989 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3eda81-df67-4944-b014-a85e72e0b05e None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:18.786932 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3eda81-df67-4944-b014-a85e72e0b05e None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:18.795775 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333f368-5cf3-4acf-aa80-bebf82e01f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:18.798953 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333f368-5cf3-4acf-aa80-bebf82e01f92 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:18.799228 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333f368-5cf3-4acf-aa80-bebf82e01f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:18.799502 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333f368-5cf3-4acf-aa80-bebf82e01f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:18.800287 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333f368-5cf3-4acf-aa80-bebf82e01f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:43:18.800597 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333f368-5cf3-4acf-aa80-bebf82e01f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:18.803067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333f368-5cf3-4acf-aa80-bebf82e01f92 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:18.821353 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1394/2798] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:43:18.823333 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3915cf0-c520-4f8d-8f19-843b2745a407 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:18.837858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3915cf0-c520-4f8d-8f19-843b2745a407 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:18.850760 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284572c-483a-4151-93a3-72c4ad0361ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:18.851700 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284572c-483a-4151-93a3-72c4ad0361ef admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:18.852088 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284572c-483a-4151-93a3-72c4ad0361ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:18.853595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284572c-483a-4151-93a3-72c4ad0361ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:18.853595 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284572c-483a-4151-93a3-72c4ad0361ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:18.855284 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284572c-483a-4151-93a3-72c4ad0361ef admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:18.897494 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1405/2799] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:43:18 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:43:18.903131 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333f368-5cf3-4acf-aa80-bebf82e01f92 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:18.914534 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333f368-5cf3-4acf-aa80-bebf82e01f92 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:19.000768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c9d3e-ef04-48da-b2f6-676ca92eeb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:19.001782 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c9d3e-ef04-48da-b2f6-676ca92eeb1e admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:19.002356 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c9d3e-ef04-48da-b2f6-676ca92eeb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:19.002986 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c9d3e-ef04-48da-b2f6-676ca92eeb1e admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:19.003706 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c9d3e-ef04-48da-b2f6-676ca92eeb1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:19.005811 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c9d3e-ef04-48da-b2f6-676ca92eeb1e admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:19.031289 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1395/2800] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:43:18 2022] POST /identity/v3/users => generated 284 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:43:19.034972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284572c-483a-4151-93a3-72c4ad0361ef admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:19.047706 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284572c-483a-4151-93a3-72c4ad0361ef admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:19.053787 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7716f-ab40-446e-8008-01162ce8547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:19.054575 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7716f-ab40-446e-8008-01162ce8547a admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:19.054863 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7716f-ab40-446e-8008-01162ce8547a admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:19.055160 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7716f-ab40-446e-8008-01162ce8547a admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:19.055877 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7716f-ab40-446e-8008-01162ce8547a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:19.057815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7716f-ab40-446e-8008-01162ce8547a admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:19.069837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1406/2801] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:43:19.074118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c9d3e-ef04-48da-b2f6-676ca92eeb1e admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:19.084968 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c9d3e-ef04-48da-b2f6-676ca92eeb1e admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:19.089879 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca16d76-5d22-4009-8221-69f844db92a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:19.090767 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca16d76-5d22-4009-8221-69f844db92a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:19.091049 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca16d76-5d22-4009-8221-69f844db92a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:19.091317 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca16d76-5d22-4009-8221-69f844db92a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:19.092039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca16d76-5d22-4009-8221-69f844db92a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:19.093642 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca16d76-5d22-4009-8221-69f844db92a7 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:19.106275 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1396/2802] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 14:43:19.110031 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7716f-ab40-446e-8008-01162ce8547a admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:19.123092 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7716f-ab40-446e-8008-01162ce8547a admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:19.127946 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dbd2b-da1c-4853-9a2a-ada20ddd19a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:19.128979 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dbd2b-da1c-4853-9a2a-ada20ddd19a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:19.129260 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dbd2b-da1c-4853-9a2a-ada20ddd19a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:19.129551 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dbd2b-da1c-4853-9a2a-ada20ddd19a0 admin admin] PATH_INFO: `/v3/projects/ba4118e1d9ec45aead6438feeba7fd23/users/ba77a7bab76c440c85fd139bd2dc159e/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:19.152062 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dbd2b-da1c-4853-9a2a-ada20ddd19a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4118e1d9ec45aead6438feeba7fd23, user_id=ba77a7bab76c440c85fd139bd2dc159e, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:19.154792 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dbd2b-da1c-4853-9a2a-ada20ddd19a0 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:19.170386 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1407/2803] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:43:19 2022] PUT /identity/v3/projects/ba4118e1d9ec45aead6438feeba7fd23/users/ba77a7bab76c440c85fd139bd2dc159e/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:43:19.181179 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c92c8-9d21-49a5-bbe2-b394d1e684ec None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:19.181551 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c92c8-9d21-49a5-bbe2-b394d1e684ec None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:19.181894 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c92c8-9d21-49a5-bbe2-b394d1e684ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:19.215909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7c0c92c8-9d21-49a5-bbe2-b394d1e684ec None None] MFA Rules not processed for user `ba77a7bab76c440c85fd139bd2dc159e`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:19.217117 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7c0c92c8-9d21-49a5-bbe2-b394d1e684ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:19.292067 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1397/2804] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:19.306039 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dbd2b-da1c-4853-9a2a-ada20ddd19a0 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:19.307977 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-876dbd2b-da1c-4853-9a2a-ada20ddd19a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:19.381346 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dbd2b-da1c-4853-9a2a-ada20ddd19a0 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:19.385188 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad836a0-4724-4a96-b50c-43d96c387ea5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34ff47d8c4f4d99955340ddbdc3d475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:19.385835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad836a0-4724-4a96-b50c-43d96c387ea5 service glance] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:19.386114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad836a0-4724-4a96-b50c-43d96c387ea5 service glance] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:19.386416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad836a0-4724-4a96-b50c-43d96c387ea5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:19.396968 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad836a0-4724-4a96-b50c-43d96c387ea5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:19.398580 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad836a0-4724-4a96-b50c-43d96c387ea5 service glance] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:19.410367 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1408/2805] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:19 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:43:22.258427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986e9e8-be26-4544-8ea6-355be817208b None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:22.259012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986e9e8-be26-4544-8ea6-355be817208b None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:22.259012 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986e9e8-be26-4544-8ea6-355be817208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:22.277488 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-5986e9e8-be26-4544-8ea6-355be817208b None None] MFA Rules not processed for user `f0c4bc87acf84ad181e20fe4ea9d5d45`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:22.278714 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5986e9e8-be26-4544-8ea6-355be817208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:22.341511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1398/2806] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:43:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:22.596929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad836a0-4724-4a96-b50c-43d96c387ea5 service glance] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:22.598406 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-9ad836a0-4724-4a96-b50c-43d96c387ea5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:22.656028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad836a0-4724-4a96-b50c-43d96c387ea5 service glance] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:22.659749 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e1404-e97c-4ebb-af88-49b8a5e095d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:22.660398 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e1404-e97c-4ebb-af88-49b8a5e095d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:22.660677 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e1404-e97c-4ebb-af88-49b8a5e095d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:22.661502 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e1404-e97c-4ebb-af88-49b8a5e095d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:22.663515 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5b2e1404-e97c-4ebb-af88-49b8a5e095d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:22.673339 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e1404-e97c-4ebb-af88-49b8a5e095d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:22.674796 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e1404-e97c-4ebb-af88-49b8a5e095d6 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:22.683265 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1409/2807] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:43:25.304066 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986e9e8-be26-4544-8ea6-355be817208b None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:25.305491 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-5986e9e8-be26-4544-8ea6-355be817208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:25.378669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986e9e8-be26-4544-8ea6-355be817208b None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:25.384492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac929d0-f793-4b70-95fe-bc16436b0d03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fad90f42ebfe43eb8256611a88df87ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:25.385197 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac929d0-f793-4b70-95fe-bc16436b0d03 service placement] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:25.385431 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac929d0-f793-4b70-95fe-bc16436b0d03 service placement] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:25.385708 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac929d0-f793-4b70-95fe-bc16436b0d03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:25.387588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-eac929d0-f793-4b70-95fe-bc16436b0d03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:25.400619 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac929d0-f793-4b70-95fe-bc16436b0d03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:25.401772 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac929d0-f793-4b70-95fe-bc16436b0d03 service placement] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:25.412972 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1399/2808] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:43:29.711510 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b176b2-affe-4f20-a2c0-04d37f600666 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:29.711943 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b176b2-affe-4f20-a2c0-04d37f600666 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:29.712157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b176b2-affe-4f20-a2c0-04d37f600666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:29.739485 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-84b176b2-affe-4f20-a2c0-04d37f600666 None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:43:29.740870 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-84b176b2-affe-4f20-a2c0-04d37f600666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:29.804698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1410/2809] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 17 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:43:29.813326 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac929d0-f793-4b70-95fe-bc16436b0d03 service placement] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:29.814794 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-eac929d0-f793-4b70-95fe-bc16436b0d03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:29.914459 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac929d0-f793-4b70-95fe-bc16436b0d03 service placement] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:29.919451 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c991f-5275-4dd0-8631-fae1a63c5fca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:29.920093 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c991f-5275-4dd0-8631-fae1a63c5fca service swift] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:29.920386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c991f-5275-4dd0-8631-fae1a63c5fca service swift] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:29.920661 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c991f-5275-4dd0-8631-fae1a63c5fca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:29.931337 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c991f-5275-4dd0-8631-fae1a63c5fca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:29.933024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c991f-5275-4dd0-8631-fae1a63c5fca service swift] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:29.941167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1400/2810] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:43:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:43:44.146473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b176b2-affe-4f20-a2c0-04d37f600666 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:44.164348 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b176b2-affe-4f20-a2c0-04d37f600666 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:44.167866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd930a1-6e63-49e5-8460-57e6ec5f1218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:44.168505 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd930a1-6e63-49e5-8460-57e6ec5f1218 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:44.168789 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd930a1-6e63-49e5-8460-57e6ec5f1218 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:44.169064 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd930a1-6e63-49e5-8460-57e6ec5f1218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:44.170963 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-4dd930a1-6e63-49e5-8460-57e6ec5f1218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:44.192471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd930a1-6e63-49e5-8460-57e6ec5f1218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:44.194074 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd930a1-6e63-49e5-8460-57e6ec5f1218 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:44.206080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1411/2811] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:43:54.296081 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c991f-5275-4dd0-8631-fae1a63c5fca service swift] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:43:54.298635 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-905c991f-5275-4dd0-8631-fae1a63c5fca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:54.411952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c991f-5275-4dd0-8631-fae1a63c5fca service swift] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:43:54.418118 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3906212-4951-4526-a6f1-8f0cde005745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:43:54.418826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3906212-4951-4526-a6f1-8f0cde005745 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:43:54.419114 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3906212-4951-4526-a6f1-8f0cde005745 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:43:54.419387 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3906212-4951-4526-a6f1-8f0cde005745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:43:54.421327 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d3906212-4951-4526-a6f1-8f0cde005745 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:43:54.435705 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3906212-4951-4526-a6f1-8f0cde005745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:43:54.437504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3906212-4951-4526-a6f1-8f0cde005745 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:43:54.458916 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1401/2812] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:43:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:44:05.333839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd930a1-6e63-49e5-8460-57e6ec5f1218 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:05.411988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd930a1-6e63-49e5-8460-57e6ec5f1218 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:05.416545 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a951f99-bc3d-41a0-930b-394769bccae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:05.417401 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a951f99-bc3d-41a0-930b-394769bccae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:05.417678 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a951f99-bc3d-41a0-930b-394769bccae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:05.417948 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a951f99-bc3d-41a0-930b-394769bccae8 admin admin] PATH_INFO: `/v3/users/ba77a7bab76c440c85fd139bd2dc159e` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:05.419219 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a951f99-bc3d-41a0-930b-394769bccae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba77a7bab76c440c85fd139bd2dc159e)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:05.421137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a951f99-bc3d-41a0-930b-394769bccae8 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:05.466632 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6a951f99-bc3d-41a0-930b-394769bccae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba77a7bab76c440c85fd139bd2dc159e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:05.473538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6a951f99-bc3d-41a0-930b-394769bccae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba77a7bab76c440c85fd139bd2dc159e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:05.474158 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6a951f99-bc3d-41a0-930b-394769bccae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba77a7bab76c440c85fd139bd2dc159e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:05.485891 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6a951f99-bc3d-41a0-930b-394769bccae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba77a7bab76c440c85fd139bd2dc159e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:05.492765 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-6a951f99-bc3d-41a0-930b-394769bccae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba77a7bab76c440c85fd139bd2dc159e'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:05.498640 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1412/2813] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:44:05 2022] DELETE /identity/v3/users/ba77a7bab76c440c85fd139bd2dc159e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:44:05.503290 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a0801-d5d6-400a-8aaa-e9fdc6eb4880 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:05.503776 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a0801-d5d6-400a-8aaa-e9fdc6eb4880 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:05.503881 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a0801-d5d6-400a-8aaa-e9fdc6eb4880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:05.541865 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-bf4a0801-d5d6-400a-8aaa-e9fdc6eb4880 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:44:05.543107 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bf4a0801-d5d6-400a-8aaa-e9fdc6eb4880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:05.600167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1402/2814] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:44:05.609815 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a951f99-bc3d-41a0-930b-394769bccae8 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:05.611235 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-6a951f99-bc3d-41a0-930b-394769bccae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:05.689348 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a951f99-bc3d-41a0-930b-394769bccae8 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:05.693401 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fcb25-0039-4a8f-9055-d32d4dcbeaa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:05.694906 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fcb25-0039-4a8f-9055-d32d4dcbeaa4 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:05.695153 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fcb25-0039-4a8f-9055-d32d4dcbeaa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:05.695435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fcb25-0039-4a8f-9055-d32d4dcbeaa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:05.705011 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fcb25-0039-4a8f-9055-d32d4dcbeaa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:05.706547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fcb25-0039-4a8f-9055-d32d4dcbeaa4 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:05.716606 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1413/2815] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:44:05.974035 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a0801-d5d6-400a-8aaa-e9fdc6eb4880 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:05.976536 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bf4a0801-d5d6-400a-8aaa-e9fdc6eb4880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:05.987866 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a0801-d5d6-400a-8aaa-e9fdc6eb4880 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:05.993134 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a20f1e-0bb7-41e6-8d5d-e1ad8d057c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:05.994015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a20f1e-0bb7-41e6-8d5d-e1ad8d057c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:05.994331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a20f1e-0bb7-41e6-8d5d-e1ad8d057c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:05.994606 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a20f1e-0bb7-41e6-8d5d-e1ad8d057c34 admin admin] PATH_INFO: `/v3/projects/ba4118e1d9ec45aead6438feeba7fd23` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:05.995909 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a20f1e-0bb7-41e6-8d5d-e1ad8d057c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba4118e1d9ec45aead6438feeba7fd23)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:05.998015 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a20f1e-0bb7-41e6-8d5d-e1ad8d057c34 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:06.044762 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-c5a20f1e-0bb7-41e6-8d5d-e1ad8d057c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba4118e1d9ec45aead6438feeba7fd23', 'request_id': 'req-c5a20f1e-0bb7-41e6-8d5d-e1ad8d057c34'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:06.050729 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-c5a20f1e-0bb7-41e6-8d5d-e1ad8d057c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba4118e1d9ec45aead6438feeba7fd23', 'request_id': 'req-c5a20f1e-0bb7-41e6-8d5d-e1ad8d057c34'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:06.058506 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-c5a20f1e-0bb7-41e6-8d5d-e1ad8d057c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba4118e1d9ec45aead6438feeba7fd23', 'request_id': 'req-c5a20f1e-0bb7-41e6-8d5d-e1ad8d057c34'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:06.068831 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-c5a20f1e-0bb7-41e6-8d5d-e1ad8d057c34 admin admin] The token cache is being invalidate because project ba4118e1d9ec45aead6438feeba7fd23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:44:06.069358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-c5a20f1e-0bb7-41e6-8d5d-e1ad8d057c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:06.070000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-c5a20f1e-0bb7-41e6-8d5d-e1ad8d057c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:06.071824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1403/2816] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:44:05 2022] DELETE /identity/v3/projects/ba4118e1d9ec45aead6438feeba7fd23 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:44:06.076588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9afdc7-4a20-4bf2-aa81-bb70b7e23d0d None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:06.076881 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9afdc7-4a20-4bf2-aa81-bb70b7e23d0d None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:06.077166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9afdc7-4a20-4bf2-aa81-bb70b7e23d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:06.123945 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-1c9afdc7-4a20-4bf2-aa81-bb70b7e23d0d None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:44:06.125149 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-1c9afdc7-4a20-4bf2-aa81-bb70b7e23d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:06.182684 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1414/2817] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:44:06.190306 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df4a39-1c36-46b9-af5a-fec4bc679484 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:06.190622 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df4a39-1c36-46b9-af5a-fec4bc679484 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:06.190904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df4a39-1c36-46b9-af5a-fec4bc679484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:06.209210 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-a4df4a39-1c36-46b9-af5a-fec4bc679484 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:44:06.210649 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a4df4a39-1c36-46b9-af5a-fec4bc679484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:06.218272 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1404/2818] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:44:06.222471 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9afdc7-4a20-4bf2-aa81-bb70b7e23d0d None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:06.232409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9afdc7-4a20-4bf2-aa81-bb70b7e23d0d None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:06.236931 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50821-7e5c-436e-8483-a92d0c61fcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:06.237598 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50821-7e5c-436e-8483-a92d0c61fcac admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:06.237867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50821-7e5c-436e-8483-a92d0c61fcac admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:06.238146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50821-7e5c-436e-8483-a92d0c61fcac admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:06.238900 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea50821-7e5c-436e-8483-a92d0c61fcac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:44:06.239208 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea50821-7e5c-436e-8483-a92d0c61fcac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:06.241420 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea50821-7e5c-436e-8483-a92d0c61fcac admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:06.253019 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1415/2819] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:44:06.257307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df4a39-1c36-46b9-af5a-fec4bc679484 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:06.266703 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df4a39-1c36-46b9-af5a-fec4bc679484 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:06.271368 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a774ded-d678-4817-b607-0082d40459b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:06.272127 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a774ded-d678-4817-b607-0082d40459b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:06.272416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a774ded-d678-4817-b607-0082d40459b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:06.272697 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a774ded-d678-4817-b607-0082d40459b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:06.273406 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a774ded-d678-4817-b607-0082d40459b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:06.275361 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a774ded-d678-4817-b607-0082d40459b4 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:06.304851 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1405/2820] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:44:06 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:44:06.305975 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50821-7e5c-436e-8483-a92d0c61fcac admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:06.315743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50821-7e5c-436e-8483-a92d0c61fcac admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:06.369928 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a2985-9134-4760-9108-81aba0cf71d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:06.370621 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a2985-9134-4760-9108-81aba0cf71d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:06.370911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a2985-9134-4760-9108-81aba0cf71d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:06.371190 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a2985-9134-4760-9108-81aba0cf71d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:06.371873 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a2985-9134-4760-9108-81aba0cf71d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:06.373797 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a2985-9134-4760-9108-81aba0cf71d1 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:06.397408 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1416/2821] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:44:06 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:44:06.402075 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a774ded-d678-4817-b607-0082d40459b4 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:06.412325 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a774ded-d678-4817-b607-0082d40459b4 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:06.417687 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b4ef5-5b53-435e-97a3-8df39557d23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:06.418394 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b4ef5-5b53-435e-97a3-8df39557d23c admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:06.418674 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b4ef5-5b53-435e-97a3-8df39557d23c admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:06.418948 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b4ef5-5b53-435e-97a3-8df39557d23c admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:06.419669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b4ef5-5b53-435e-97a3-8df39557d23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:06.421249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b4ef5-5b53-435e-97a3-8df39557d23c admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:06.431504 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1406/2822] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:44:06.435380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a2985-9134-4760-9108-81aba0cf71d1 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:06.445570 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a2985-9134-4760-9108-81aba0cf71d1 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:06.450459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2713143-025e-41af-86a3-4f5b2f08a264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:06.451113 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2713143-025e-41af-86a3-4f5b2f08a264 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:06.451401 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2713143-025e-41af-86a3-4f5b2f08a264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:06.451766 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2713143-025e-41af-86a3-4f5b2f08a264 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:06.452522 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2713143-025e-41af-86a3-4f5b2f08a264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:06.454148 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2713143-025e-41af-86a3-4f5b2f08a264 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:06.464668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1417/2823] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:44:06.468529 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b4ef5-5b53-435e-97a3-8df39557d23c admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:06.478925 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b4ef5-5b53-435e-97a3-8df39557d23c admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:06.483379 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11320555-7a5b-4cf7-b536-ff408dbb3d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:06.484234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11320555-7a5b-4cf7-b536-ff408dbb3d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:06.484513 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11320555-7a5b-4cf7-b536-ff408dbb3d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:06.484786 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11320555-7a5b-4cf7-b536-ff408dbb3d9a admin admin] PATH_INFO: `/v3/projects/30538fa9e2af45058828ddd722c430b9/users/a5423cc1b2d6496db0b07ffae8bbba22/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:06.499066 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11320555-7a5b-4cf7-b536-ff408dbb3d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=30538fa9e2af45058828ddd722c430b9, user_id=a5423cc1b2d6496db0b07ffae8bbba22, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:06.501747 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11320555-7a5b-4cf7-b536-ff408dbb3d9a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:06.514356 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1407/2824] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:44:06 2022] PUT /identity/v3/projects/30538fa9e2af45058828ddd722c430b9/users/a5423cc1b2d6496db0b07ffae8bbba22/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:44:06.524976 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514312-06c6-4219-bb05-525e03a489b3 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:06.525270 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514312-06c6-4219-bb05-525e03a489b3 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:06.525554 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514312-06c6-4219-bb05-525e03a489b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:06.552191 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-18514312-06c6-4219-bb05-525e03a489b3 None None] MFA Rules not processed for user `a5423cc1b2d6496db0b07ffae8bbba22`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:44:06.553402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-18514312-06c6-4219-bb05-525e03a489b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:06.618698 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1418/2825] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:44:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:44:06.629942 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11320555-7a5b-4cf7-b536-ff408dbb3d9a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:06.631672 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-11320555-7a5b-4cf7-b536-ff408dbb3d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:06.689854 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11320555-7a5b-4cf7-b536-ff408dbb3d9a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:06.693518 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8b7c9-05fd-42c9-bc34-0b027f147346 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34ff47d8c4f4d99955340ddbdc3d475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:06.694156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8b7c9-05fd-42c9-bc34-0b027f147346 service glance] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:06.694466 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8b7c9-05fd-42c9-bc34-0b027f147346 service glance] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:06.694740 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8b7c9-05fd-42c9-bc34-0b027f147346 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:06.703824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8b7c9-05fd-42c9-bc34-0b027f147346 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:06.705252 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8b7c9-05fd-42c9-bc34-0b027f147346 service glance] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:06.714735 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1408/2826] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:44:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:44:10.239743 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18514312-06c6-4219-bb05-525e03a489b3 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:10.241137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-18514312-06c6-4219-bb05-525e03a489b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:10.298627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18514312-06c6-4219-bb05-525e03a489b3 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:10.302228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a3d1-7371-4921-a143-7eedc185fba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:10.302873 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a3d1-7371-4921-a143-7eedc185fba5 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:10.303157 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a3d1-7371-4921-a143-7eedc185fba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:10.303433 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a3d1-7371-4921-a143-7eedc185fba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:10.305210 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-70d0a3d1-7371-4921-a143-7eedc185fba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:10.367515 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0a3d1-7371-4921-a143-7eedc185fba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:10.369259 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0a3d1-7371-4921-a143-7eedc185fba5 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:10.380377 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1419/2827] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:44:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:44:13.893828 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8b7c9-05fd-42c9-bc34-0b027f147346 service glance] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:13.895336 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f2b8b7c9-05fd-42c9-bc34-0b027f147346 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:14.051143 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8b7c9-05fd-42c9-bc34-0b027f147346 service glance] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:14.058432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a895441-1fe9-48a2-8bfa-787293cea7c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:14.059465 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a895441-1fe9-48a2-8bfa-787293cea7c3 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:14.060668 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a895441-1fe9-48a2-8bfa-787293cea7c3 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:14.061039 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a895441-1fe9-48a2-8bfa-787293cea7c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:14.063905 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-3a895441-1fe9-48a2-8bfa-787293cea7c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:14.080160 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a895441-1fe9-48a2-8bfa-787293cea7c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:14.082750 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a895441-1fe9-48a2-8bfa-787293cea7c3 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:14.100563 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1409/2828] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:44:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:44:41.800293 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a3d1-7371-4921-a143-7eedc185fba5 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:41.860195 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a3d1-7371-4921-a143-7eedc185fba5 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:41.864792 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0fb1f-ad20-4c71-b70d-3f839ebb1a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:41.865654 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0fb1f-ad20-4c71-b70d-3f839ebb1a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:41.865937 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0fb1f-ad20-4c71-b70d-3f839ebb1a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:41.866244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0fb1f-ad20-4c71-b70d-3f839ebb1a4e admin admin] PATH_INFO: `/v3/users/a5423cc1b2d6496db0b07ffae8bbba22` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:41.867432 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0fb1f-ad20-4c71-b70d-3f839ebb1a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5423cc1b2d6496db0b07ffae8bbba22)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:41.869362 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0fb1f-ad20-4c71-b70d-3f839ebb1a4e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:41.914978 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-bac0fb1f-ad20-4c71-b70d-3f839ebb1a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5423cc1b2d6496db0b07ffae8bbba22'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:41.922012 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-bac0fb1f-ad20-4c71-b70d-3f839ebb1a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5423cc1b2d6496db0b07ffae8bbba22'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:41.922729 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-bac0fb1f-ad20-4c71-b70d-3f839ebb1a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5423cc1b2d6496db0b07ffae8bbba22'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:41.934151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-bac0fb1f-ad20-4c71-b70d-3f839ebb1a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5423cc1b2d6496db0b07ffae8bbba22'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:41.941259 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-bac0fb1f-ad20-4c71-b70d-3f839ebb1a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5423cc1b2d6496db0b07ffae8bbba22'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:41.947354 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1420/2829] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:44:41 2022] DELETE /identity/v3/users/a5423cc1b2d6496db0b07ffae8bbba22 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:44:41.952397 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bc3a5-fbb4-4900-89d5-3cfaabf9787c None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:41.952906 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bc3a5-fbb4-4900-89d5-3cfaabf9787c None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:41.953014 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bc3a5-fbb4-4900-89d5-3cfaabf9787c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:41.969427 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-853bc3a5-fbb4-4900-89d5-3cfaabf9787c None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:44:41.970640 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-853bc3a5-fbb4-4900-89d5-3cfaabf9787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:42.035270 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1410/2830] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:44:42.045043 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0fb1f-ad20-4c71-b70d-3f839ebb1a4e admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:42.046463 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-bac0fb1f-ad20-4c71-b70d-3f839ebb1a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:42.104360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0fb1f-ad20-4c71-b70d-3f839ebb1a4e admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:42.108347 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e336601-5650-4f0a-9616-1a1d91b73793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:42.108986 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e336601-5650-4f0a-9616-1a1d91b73793 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:42.109272 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e336601-5650-4f0a-9616-1a1d91b73793 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:42.109548 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e336601-5650-4f0a-9616-1a1d91b73793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:42.118923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e336601-5650-4f0a-9616-1a1d91b73793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:42.120370 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e336601-5650-4f0a-9616-1a1d91b73793 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:42.131316 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1421/2831] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:44:42.400771 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bc3a5-fbb4-4900-89d5-3cfaabf9787c None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:42.402331 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-853bc3a5-fbb4-4900-89d5-3cfaabf9787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:42.416335 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bc3a5-fbb4-4900-89d5-3cfaabf9787c None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:42.422346 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48cae7-800f-4739-9fd8-2e1955b801bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:42.423385 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48cae7-800f-4739-9fd8-2e1955b801bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:42.423733 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48cae7-800f-4739-9fd8-2e1955b801bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:42.424072 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48cae7-800f-4739-9fd8-2e1955b801bb admin admin] PATH_INFO: `/v3/projects/30538fa9e2af45058828ddd722c430b9` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:42.426017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48cae7-800f-4739-9fd8-2e1955b801bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=30538fa9e2af45058828ddd722c430b9)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:42.428493 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48cae7-800f-4739-9fd8-2e1955b801bb admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:42.473966 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6a48cae7-800f-4739-9fd8-2e1955b801bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30538fa9e2af45058828ddd722c430b9', 'request_id': 'req-6a48cae7-800f-4739-9fd8-2e1955b801bb'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:42.479882 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6a48cae7-800f-4739-9fd8-2e1955b801bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30538fa9e2af45058828ddd722c430b9', 'request_id': 'req-6a48cae7-800f-4739-9fd8-2e1955b801bb'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:42.487597 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6a48cae7-800f-4739-9fd8-2e1955b801bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30538fa9e2af45058828ddd722c430b9', 'request_id': 'req-6a48cae7-800f-4739-9fd8-2e1955b801bb'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:42.498860 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6a48cae7-800f-4739-9fd8-2e1955b801bb admin admin] The token cache is being invalidate because project 30538fa9e2af45058828ddd722c430b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:44:42.499150 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6a48cae7-800f-4739-9fd8-2e1955b801bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:42.499786 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-6a48cae7-800f-4739-9fd8-2e1955b801bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:44:42.501306 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1411/2832] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:44:42 2022] DELETE /identity/v3/projects/30538fa9e2af45058828ddd722c430b9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:44:42.506627 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb32e7-273f-4fcb-ac30-fa7b9199677a None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:42.506918 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb32e7-273f-4fcb-ac30-fa7b9199677a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:42.507204 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb32e7-273f-4fcb-ac30-fa7b9199677a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:42.524419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-5fdb32e7-273f-4fcb-ac30-fa7b9199677a None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:44:42.525651 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5fdb32e7-273f-4fcb-ac30-fa7b9199677a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:42.584034 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1422/2833] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:44:42.593366 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387eebd7-7574-4f01-8122-c01af7c93805 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:42.593649 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387eebd7-7574-4f01-8122-c01af7c93805 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:42.593943 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387eebd7-7574-4f01-8122-c01af7c93805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:42.612358 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-387eebd7-7574-4f01-8122-c01af7c93805 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:44:42.613533 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-387eebd7-7574-4f01-8122-c01af7c93805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:42.621241 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1412/2834] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:44:42.625665 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb32e7-273f-4fcb-ac30-fa7b9199677a None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:42.635151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb32e7-273f-4fcb-ac30-fa7b9199677a None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:42.639910 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379c6a0-0487-456c-b8e8-cbd5ec21019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:42.640556 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379c6a0-0487-456c-b8e8-cbd5ec21019c admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:42.640839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379c6a0-0487-456c-b8e8-cbd5ec21019c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:42.641114 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379c6a0-0487-456c-b8e8-cbd5ec21019c admin admin] PATH_INFO: `/v3/domains` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:42.641832 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379c6a0-0487-456c-b8e8-cbd5ec21019c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79877) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:44:42.642141 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379c6a0-0487-456c-b8e8-cbd5ec21019c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:42.643785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379c6a0-0487-456c-b8e8-cbd5ec21019c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:42.655721 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1423/2835] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:44:42.660432 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387eebd7-7574-4f01-8122-c01af7c93805 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:42.670207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387eebd7-7574-4f01-8122-c01af7c93805 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:42.675098 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501391a-9afc-4bd2-98d2-0136ed9f3888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:42.675862 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501391a-9afc-4bd2-98d2-0136ed9f3888 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:42.676181 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501391a-9afc-4bd2-98d2-0136ed9f3888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:42.676520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501391a-9afc-4bd2-98d2-0136ed9f3888 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:42.677314 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501391a-9afc-4bd2-98d2-0136ed9f3888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:42.679452 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501391a-9afc-4bd2-98d2-0136ed9f3888 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:42.705436 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1413/2836] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:44:42 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:44:42.709458 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379c6a0-0487-456c-b8e8-cbd5ec21019c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:42.720040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379c6a0-0487-456c-b8e8-cbd5ec21019c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:42.774928 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db2e56-d791-432c-ba71-61c3f4147bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:42.775588 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db2e56-d791-432c-ba71-61c3f4147bda admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:42.775871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db2e56-d791-432c-ba71-61c3f4147bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:42.776146 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db2e56-d791-432c-ba71-61c3f4147bda admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:42.776837 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db2e56-d791-432c-ba71-61c3f4147bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:42.779365 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db2e56-d791-432c-ba71-61c3f4147bda admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:42.798538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1424/2837] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:44:42 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 14:44:42.802632 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501391a-9afc-4bd2-98d2-0136ed9f3888 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:42.813682 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501391a-9afc-4bd2-98d2-0136ed9f3888 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:42.818289 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b14af-e071-4204-a754-95b2c040a11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:42.818950 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b14af-e071-4204-a754-95b2c040a11a admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:42.819233 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b14af-e071-4204-a754-95b2c040a11a admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:42.819510 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b14af-e071-4204-a754-95b2c040a11a admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:42.820237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b14af-e071-4204-a754-95b2c040a11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:42.822085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b14af-e071-4204-a754-95b2c040a11a admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:42.832538 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1414/2838] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:44:42.836725 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db2e56-d791-432c-ba71-61c3f4147bda admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:42.847793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db2e56-d791-432c-ba71-61c3f4147bda admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:42.852415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaaeb9-b881-4ac6-8440-139dcb95bdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:42.853072 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaaeb9-b881-4ac6-8440-139dcb95bdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:42.853356 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaaeb9-b881-4ac6-8440-139dcb95bdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:42.853637 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaaeb9-b881-4ac6-8440-139dcb95bdc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:42.854413 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaaeb9-b881-4ac6-8440-139dcb95bdc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:42.856117 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaaeb9-b881-4ac6-8440-139dcb95bdc9 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:42.867152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1425/2839] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:44:42.871249 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b14af-e071-4204-a754-95b2c040a11a admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:42.881335 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b14af-e071-4204-a754-95b2c040a11a admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:42.885851 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea4263-eddb-4ea1-b956-09e48cea9b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:42.886764 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4263-eddb-4ea1-b956-09e48cea9b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:42.887047 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4263-eddb-4ea1-b956-09e48cea9b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:42.887322 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4263-eddb-4ea1-b956-09e48cea9b3b admin admin] PATH_INFO: `/v3/projects/e181973b0aa04527a9991352f1c83adb/users/e0cfc22625774ef7a09727b27e6c4a49/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:42.902669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea4263-eddb-4ea1-b956-09e48cea9b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e181973b0aa04527a9991352f1c83adb, user_id=e0cfc22625774ef7a09727b27e6c4a49, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:42.906187 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea4263-eddb-4ea1-b956-09e48cea9b3b admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:42.919237 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1415/2840] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:44:42 2022] PUT /identity/v3/projects/e181973b0aa04527a9991352f1c83adb/users/e0cfc22625774ef7a09727b27e6c4a49/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:44:42.924392 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282682b9-d9e3-418f-8140-90dc39804132 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:42.924687 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282682b9-d9e3-418f-8140-90dc39804132 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:42.924969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282682b9-d9e3-418f-8140-90dc39804132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:42.942090 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-282682b9-d9e3-418f-8140-90dc39804132 None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:44:42.943321 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-282682b9-d9e3-418f-8140-90dc39804132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:43.002317 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1426/2841] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:44:43.011778 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea4263-eddb-4ea1-b956-09e48cea9b3b admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:43.014063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-edea4263-eddb-4ea1-b956-09e48cea9b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:43.070723 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea4263-eddb-4ea1-b956-09e48cea9b3b admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:43.074588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ff42e-ebfb-4059-8dbb-bc7cc6c64470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:43.076036 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ff42e-ebfb-4059-8dbb-bc7cc6c64470 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:43.076340 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ff42e-ebfb-4059-8dbb-bc7cc6c64470 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:43.076678 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ff42e-ebfb-4059-8dbb-bc7cc6c64470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:43.085543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ff42e-ebfb-4059-8dbb-bc7cc6c64470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:43.087042 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ff42e-ebfb-4059-8dbb-bc7cc6c64470 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:43.096914 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1416/2842] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:44:46.893802 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf201694-32cc-4c6e-a5aa-1d8afe80e516 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:46.894341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf201694-32cc-4c6e-a5aa-1d8afe80e516 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:46.894437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf201694-32cc-4c6e-a5aa-1d8afe80e516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:46.922035 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-bf201694-32cc-4c6e-a5aa-1d8afe80e516 None None] MFA Rules not processed for user `e0cfc22625774ef7a09727b27e6c4a49`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:44:46.923403 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-bf201694-32cc-4c6e-a5aa-1d8afe80e516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:46.993082 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1427/2843] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:44:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:44:46.997788 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ff42e-ebfb-4059-8dbb-bc7cc6c64470 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:47.007958 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ff42e-ebfb-4059-8dbb-bc7cc6c64470 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:47.013270 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb0363-5aa2-4dfa-8baa-62bb25e0a8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:47.013939 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb0363-5aa2-4dfa-8baa-62bb25e0a8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:47.014244 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb0363-5aa2-4dfa-8baa-62bb25e0a8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:47.014524 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb0363-5aa2-4dfa-8baa-62bb25e0a8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:47.015250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb0363-5aa2-4dfa-8baa-62bb25e0a8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:47.017181 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb0363-5aa2-4dfa-8baa-62bb25e0a8d5 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:47.052388 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1417/2844] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:44:46 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:44:47.056305 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf201694-32cc-4c6e-a5aa-1d8afe80e516 None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:47.068661 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf201694-32cc-4c6e-a5aa-1d8afe80e516 None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:47.132248 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c10ef1-16bf-4459-8d63-2059bf401d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:47.132940 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c10ef1-16bf-4459-8d63-2059bf401d49 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:47.133226 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c10ef1-16bf-4459-8d63-2059bf401d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:47.133505 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c10ef1-16bf-4459-8d63-2059bf401d49 admin admin] PATH_INFO: `/v3/users` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:47.134228 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c10ef1-16bf-4459-8d63-2059bf401d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:47.136844 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c10ef1-16bf-4459-8d63-2059bf401d49 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:47.165435 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1428/2845] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:44:47 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:44:47.169498 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb0363-5aa2-4dfa-8baa-62bb25e0a8d5 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:47.182801 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb0363-5aa2-4dfa-8baa-62bb25e0a8d5 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:47.188598 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e936d0-10ee-4814-828f-f91f53654e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:47.189328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e936d0-10ee-4814-828f-f91f53654e63 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:47.189607 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e936d0-10ee-4814-828f-f91f53654e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:47.189888 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e936d0-10ee-4814-828f-f91f53654e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:47.190671 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e936d0-10ee-4814-828f-f91f53654e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:47.192298 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e936d0-10ee-4814-828f-f91f53654e63 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:47.207255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1418/2846] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:44:47.211415 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c10ef1-16bf-4459-8d63-2059bf401d49 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:47.221890 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c10ef1-16bf-4459-8d63-2059bf401d49 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:47.226790 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df6fd5-3e65-4491-8d11-c6c8f00331a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:47.227682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df6fd5-3e65-4491-8d11-c6c8f00331a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:47.227970 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df6fd5-3e65-4491-8d11-c6c8f00331a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:47.228248 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df6fd5-3e65-4491-8d11-c6c8f00331a4 admin admin] PATH_INFO: `/v3/projects/3b80f94967f44c50b1655dec863c8681/users/42f7c00438e84441825d19817f1c3644/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:47.243969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df6fd5-3e65-4491-8d11-c6c8f00331a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b80f94967f44c50b1655dec863c8681, user_id=42f7c00438e84441825d19817f1c3644, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:47.246759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df6fd5-3e65-4491-8d11-c6c8f00331a4 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:47.262263 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1429/2847] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:44:47 2022] PUT /identity/v3/projects/3b80f94967f44c50b1655dec863c8681/users/42f7c00438e84441825d19817f1c3644/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:44:47.266781 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e936d0-10ee-4814-828f-f91f53654e63 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:47.276952 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e936d0-10ee-4814-828f-f91f53654e63 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:47.337328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ed08b-a7b8-49f3-b614-986a3f6f8102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:47.338018 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ed08b-a7b8-49f3-b614-986a3f6f8102 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:47.338343 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ed08b-a7b8-49f3-b614-986a3f6f8102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:47.338612 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ed08b-a7b8-49f3-b614-986a3f6f8102 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:47.339343 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ed08b-a7b8-49f3-b614-986a3f6f8102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:47.341025 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ed08b-a7b8-49f3-b614-986a3f6f8102 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:47.354429 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1419/2848] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:44:47.355875 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df6fd5-3e65-4491-8d11-c6c8f00331a4 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:47.366652 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df6fd5-3e65-4491-8d11-c6c8f00331a4 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:47.371693 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5da5e-f2cd-45ce-bac0-a2dc01f7e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:47.373240 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5da5e-f2cd-45ce-bac0-a2dc01f7e970 admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:47.373474 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5da5e-f2cd-45ce-bac0-a2dc01f7e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:47.375341 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5da5e-f2cd-45ce-bac0-a2dc01f7e970 admin admin] PATH_INFO: `/v3/projects/3b80f94967f44c50b1655dec863c8681/users/42f7c00438e84441825d19817f1c3644/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:47.378996 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5da5e-f2cd-45ce-bac0-a2dc01f7e970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b80f94967f44c50b1655dec863c8681, user_id=42f7c00438e84441825d19817f1c3644, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:47.381750 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5da5e-f2cd-45ce-bac0-a2dc01f7e970 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:47.393571 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1430/2849] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:44:47 2022] PUT /identity/v3/projects/3b80f94967f44c50b1655dec863c8681/users/42f7c00438e84441825d19817f1c3644/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:44:51.849230 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0576ff-2e8d-472b-acab-80ce066d109e None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:51.849800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0576ff-2e8d-472b-acab-80ce066d109e None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:51.849800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0576ff-2e8d-472b-acab-80ce066d109e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:51.879403 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-2b0576ff-2e8d-472b-acab-80ce066d109e None None] MFA Rules not processed for user `42f7c00438e84441825d19817f1c3644`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:44:51.880622 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-2b0576ff-2e8d-472b-acab-80ce066d109e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:51.969954 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1420/2850] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:44:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 14:44:51.996136 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5da5e-f2cd-45ce-bac0-a2dc01f7e970 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:44:51.998079 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a5c5da5e-f2cd-45ce-bac0-a2dc01f7e970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:52.087416 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5da5e-f2cd-45ce-bac0-a2dc01f7e970 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:44:52.102805 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12523834-58a6-450e-a288-ae7c7f5ee9e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:44:52.103984 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12523834-58a6-450e-a288-ae7c7f5ee9e2 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:52.104291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12523834-58a6-450e-a288-ae7c7f5ee9e2 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:52.104547 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12523834-58a6-450e-a288-ae7c7f5ee9e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:52.173190 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12523834-58a6-450e-a288-ae7c7f5ee9e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:44:52.174864 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12523834-58a6-450e-a288-ae7c7f5ee9e2 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:44:52.184360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1431/2851] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:44:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:44:54.173611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0a628-4d6a-48cf-866a-2b6c2f28d740 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:44:54.174113 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0a628-4d6a-48cf-866a-2b6c2f28d740 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:44:54.174253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0a628-4d6a-48cf-866a-2b6c2f28d740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:44:54.193198 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-7af0a628-4d6a-48cf-866a-2b6c2f28d740 None None] MFA Rules not processed for user `e0cfc22625774ef7a09727b27e6c4a49`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:44:54.194457 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7af0a628-4d6a-48cf-866a-2b6c2f28d740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:44:54.202258 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1421/2852] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:44:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:45:15.920211 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12523834-58a6-450e-a288-ae7c7f5ee9e2 service nova] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:45:15.973848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12523834-58a6-450e-a288-ae7c7f5ee9e2 service nova] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:45:15.977409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3854c-0327-4fbf-8d16-657ca51d229b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:45:15.978043 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3854c-0327-4fbf-8d16-657ca51d229b service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:45:15.978361 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3854c-0327-4fbf-8d16-657ca51d229b service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:45:15.978636 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3854c-0327-4fbf-8d16-657ca51d229b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:45:15.980360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-0ce3854c-0327-4fbf-8d16-657ca51d229b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:45:15.989954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3854c-0327-4fbf-8d16-657ca51d229b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:45:15.991405 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3854c-0327-4fbf-8d16-657ca51d229b service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:45:15.999152 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1432/2853] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:45:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:45:17.057530 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0a628-4d6a-48cf-866a-2b6c2f28d740 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:45:17.059024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7af0a628-4d6a-48cf-866a-2b6c2f28d740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:45:17.148302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0a628-4d6a-48cf-866a-2b6c2f28d740 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:45:17.153202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c67f6-6a87-4b76-981c-7ee8a3939b96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fad90f42ebfe43eb8256611a88df87ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:45:17.153848 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c67f6-6a87-4b76-981c-7ee8a3939b96 service placement] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:45:17.154133 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c67f6-6a87-4b76-981c-7ee8a3939b96 service placement] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:45:17.154458 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c67f6-6a87-4b76-981c-7ee8a3939b96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:45:17.156263 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-887c67f6-6a87-4b76-981c-7ee8a3939b96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:45:17.168088 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c67f6-6a87-4b76-981c-7ee8a3939b96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:45:17.169685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c67f6-6a87-4b76-981c-7ee8a3939b96 service placement] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:45:17.179795 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1422/2854] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:45:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:45:33.278439 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3854c-0327-4fbf-8d16-657ca51d229b service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:45:33.279822 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-0ce3854c-0327-4fbf-8d16-657ca51d229b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:45:33.289964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3854c-0327-4fbf-8d16-657ca51d229b service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:45:33.294216 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f981c7-8e17-434a-99d8-d7695f89b3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:45:33.294852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f981c7-8e17-434a-99d8-d7695f89b3fa service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:45:33.295134 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f981c7-8e17-434a-99d8-d7695f89b3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:45:33.295408 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f981c7-8e17-434a-99d8-d7695f89b3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:45:33.304235 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f981c7-8e17-434a-99d8-d7695f89b3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:45:33.305659 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f981c7-8e17-434a-99d8-d7695f89b3fa service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:45:33.315487 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1433/2855] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:45:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:46:58.685083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44472-1d14-4e13-9a35-186cadcc03a0 None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:46:58.685599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44472-1d14-4e13-9a35-186cadcc03a0 None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:46:58.685700 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44472-1d14-4e13-9a35-186cadcc03a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:46:58.744206 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-60b44472-1d14-4e13-9a35-186cadcc03a0 None None] MFA Rules not processed for user `ba800a3364ee46f395d040f7eb8f775f`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:46:58.745550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-60b44472-1d14-4e13-9a35-186cadcc03a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:46:58.808007 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1423/2856] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 17 14:46:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:46:58.847965 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f981c7-8e17-434a-99d8-d7695f89b3fa service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:46:58.849392 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f9f981c7-8e17-434a-99d8-d7695f89b3fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:46:58.937505 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f981c7-8e17-434a-99d8-d7695f89b3fa service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:46:58.942586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a2c51-010b-4289-a9dd-996d7c4f891e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055264c31c9e4d3dbf234a362ee82698', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:46:58.943229 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a2c51-010b-4289-a9dd-996d7c4f891e service swift] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:46:58.943520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a2c51-010b-4289-a9dd-996d7c4f891e service swift] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:46:58.943823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a2c51-010b-4289-a9dd-996d7c4f891e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:46:58.952437 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a2c51-010b-4289-a9dd-996d7c4f891e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:46:58.954014 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a2c51-010b-4289-a9dd-996d7c4f891e service swift] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:46:58.962028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1434/2857] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 17 14:46:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 14:47:05.442579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44472-1d14-4e13-9a35-186cadcc03a0 None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:05.444127 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-60b44472-1d14-4e13-9a35-186cadcc03a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:05.508210 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44472-1d14-4e13-9a35-186cadcc03a0 None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:05.512856 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034f43b-c21a-4402-9ba4-ab754d6443b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:05.513717 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034f43b-c21a-4402-9ba4-ab754d6443b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:05.513996 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034f43b-c21a-4402-9ba4-ab754d6443b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:05.514299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034f43b-c21a-4402-9ba4-ab754d6443b8 admin admin] PATH_INFO: `/v3/users/f0c4bc87acf84ad181e20fe4ea9d5d45` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:05.515476 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034f43b-c21a-4402-9ba4-ab754d6443b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c4bc87acf84ad181e20fe4ea9d5d45)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:05.517480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034f43b-c21a-4402-9ba4-ab754d6443b8 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:05.561083 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b034f43b-c21a-4402-9ba4-ab754d6443b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c4bc87acf84ad181e20fe4ea9d5d45'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:05.567589 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b034f43b-c21a-4402-9ba4-ab754d6443b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c4bc87acf84ad181e20fe4ea9d5d45'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:05.568421 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b034f43b-c21a-4402-9ba4-ab754d6443b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c4bc87acf84ad181e20fe4ea9d5d45'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:05.581239 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b034f43b-c21a-4402-9ba4-ab754d6443b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c4bc87acf84ad181e20fe4ea9d5d45'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:05.588721 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-b034f43b-c21a-4402-9ba4-ab754d6443b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c4bc87acf84ad181e20fe4ea9d5d45'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:05.594574 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1424/2858] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:47:05 2022] DELETE /identity/v3/users/f0c4bc87acf84ad181e20fe4ea9d5d45 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:47:05.777225 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a2c51-010b-4289-a9dd-996d7c4f891e service swift] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:05.789638 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a2c51-010b-4289-a9dd-996d7c4f891e service swift] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:05.847993 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f209b2-8a79-48db-ac55-d3abca1ce19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:05.848876 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f209b2-8a79-48db-ac55-d3abca1ce19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:05.849207 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f209b2-8a79-48db-ac55-d3abca1ce19c admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:05.849582 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f209b2-8a79-48db-ac55-d3abca1ce19c admin admin] PATH_INFO: `/v3/projects/dd03377c46e04496adbf06ead6bdf801` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:05.850785 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f209b2-8a79-48db-ac55-d3abca1ce19c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd03377c46e04496adbf06ead6bdf801)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:05.852699 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f209b2-8a79-48db-ac55-d3abca1ce19c admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:05.899037 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-45f209b2-8a79-48db-ac55-d3abca1ce19c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd03377c46e04496adbf06ead6bdf801', 'request_id': 'req-45f209b2-8a79-48db-ac55-d3abca1ce19c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:05.905573 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-45f209b2-8a79-48db-ac55-d3abca1ce19c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd03377c46e04496adbf06ead6bdf801', 'request_id': 'req-45f209b2-8a79-48db-ac55-d3abca1ce19c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:05.912447 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-45f209b2-8a79-48db-ac55-d3abca1ce19c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd03377c46e04496adbf06ead6bdf801', 'request_id': 'req-45f209b2-8a79-48db-ac55-d3abca1ce19c'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:05.922938 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-45f209b2-8a79-48db-ac55-d3abca1ce19c admin admin] The token cache is being invalidate because project dd03377c46e04496adbf06ead6bdf801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:47:05.923246 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-45f209b2-8a79-48db-ac55-d3abca1ce19c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:05.923857 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-45f209b2-8a79-48db-ac55-d3abca1ce19c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:05.925392 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1435/2859] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:47:05 2022] DELETE /identity/v3/projects/dd03377c46e04496adbf06ead6bdf801 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:47:05.929320 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034f43b-c21a-4402-9ba4-ab754d6443b8 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:05.930808 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-b034f43b-c21a-4402-9ba4-ab754d6443b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:05.943866 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034f43b-c21a-4402-9ba4-ab754d6443b8 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:06.001672 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc226bdb-d1c3-4168-8e91-2d3056b50728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:06.002496 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc226bdb-d1c3-4168-8e91-2d3056b50728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:06.002784 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc226bdb-d1c3-4168-8e91-2d3056b50728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:06.003060 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc226bdb-d1c3-4168-8e91-2d3056b50728 admin admin] PATH_INFO: `/v3/users/79c976aa098b4f6597937b02ab332aae` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:06.004250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc226bdb-d1c3-4168-8e91-2d3056b50728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c976aa098b4f6597937b02ab332aae)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:06.006190 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc226bdb-d1c3-4168-8e91-2d3056b50728 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:06.053793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-dc226bdb-d1c3-4168-8e91-2d3056b50728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c976aa098b4f6597937b02ab332aae'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:06.060805 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-dc226bdb-d1c3-4168-8e91-2d3056b50728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c976aa098b4f6597937b02ab332aae'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:06.061474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-dc226bdb-d1c3-4168-8e91-2d3056b50728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c976aa098b4f6597937b02ab332aae'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:06.073617 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-dc226bdb-d1c3-4168-8e91-2d3056b50728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c976aa098b4f6597937b02ab332aae'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:06.080124 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-dc226bdb-d1c3-4168-8e91-2d3056b50728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c976aa098b4f6597937b02ab332aae'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:06.085933 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1425/2860] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:47:05 2022] DELETE /identity/v3/users/79c976aa098b4f6597937b02ab332aae => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:47:06.253078 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f209b2-8a79-48db-ac55-d3abca1ce19c admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:06.255224 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-45f209b2-8a79-48db-ac55-d3abca1ce19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:06.269916 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f209b2-8a79-48db-ac55-d3abca1ce19c admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:06.328261 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7ef02-47fb-4269-aec6-ec50f8cbdf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:06.329121 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7ef02-47fb-4269-aec6-ec50f8cbdf32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:06.329408 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7ef02-47fb-4269-aec6-ec50f8cbdf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:06.329683 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7ef02-47fb-4269-aec6-ec50f8cbdf32 admin admin] PATH_INFO: `/v3/projects/05d3ac60b3954296bb700b798e336788` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:06.330880 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7ef02-47fb-4269-aec6-ec50f8cbdf32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d3ac60b3954296bb700b798e336788)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:06.332801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7ef02-47fb-4269-aec6-ec50f8cbdf32 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:06.376782 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-daa7ef02-47fb-4269-aec6-ec50f8cbdf32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d3ac60b3954296bb700b798e336788', 'request_id': 'req-daa7ef02-47fb-4269-aec6-ec50f8cbdf32'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:06.382821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-daa7ef02-47fb-4269-aec6-ec50f8cbdf32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d3ac60b3954296bb700b798e336788', 'request_id': 'req-daa7ef02-47fb-4269-aec6-ec50f8cbdf32'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:06.390459 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-daa7ef02-47fb-4269-aec6-ec50f8cbdf32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d3ac60b3954296bb700b798e336788', 'request_id': 'req-daa7ef02-47fb-4269-aec6-ec50f8cbdf32'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:06.400323 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-daa7ef02-47fb-4269-aec6-ec50f8cbdf32 admin admin] The token cache is being invalidate because project 05d3ac60b3954296bb700b798e336788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:47:06.400664 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-daa7ef02-47fb-4269-aec6-ec50f8cbdf32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:06.401295 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-daa7ef02-47fb-4269-aec6-ec50f8cbdf32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:47:06.402852 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1436/2861] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:47:06 2022] DELETE /identity/v3/projects/05d3ac60b3954296bb700b798e336788 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:47:06.407911 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c7c49-aaa1-409a-a467-31e482f21cfe None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:06.408200 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c7c49-aaa1-409a-a467-31e482f21cfe None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:06.408477 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c7c49-aaa1-409a-a467-31e482f21cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:06.426307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-2d6c7c49-aaa1-409a-a467-31e482f21cfe None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:47:06.427485 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-2d6c7c49-aaa1-409a-a467-31e482f21cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:06.484137 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1426/2862] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:47:06.492043 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00687bfa-f6a3-4d8d-b86a-afdd0b9c48ea None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:06.492332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00687bfa-f6a3-4d8d-b86a-afdd0b9c48ea None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:06.492610 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00687bfa-f6a3-4d8d-b86a-afdd0b9c48ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:06.511709 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-00687bfa-f6a3-4d8d-b86a-afdd0b9c48ea None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:47:06.512834 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-00687bfa-f6a3-4d8d-b86a-afdd0b9c48ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:06.520628 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1437/2863] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:47:06.524668 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c7c49-aaa1-409a-a467-31e482f21cfe None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:06.534090 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c7c49-aaa1-409a-a467-31e482f21cfe None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:06.538580 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7abd7c-ef75-4ec2-9cdd-b3f9b35fb630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:06.539227 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7abd7c-ef75-4ec2-9cdd-b3f9b35fb630 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:06.539506 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7abd7c-ef75-4ec2-9cdd-b3f9b35fb630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:06.539781 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7abd7c-ef75-4ec2-9cdd-b3f9b35fb630 admin admin] PATH_INFO: `/v3/domains` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:06.540492 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7abd7c-ef75-4ec2-9cdd-b3f9b35fb630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 14:47:06.540796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7abd7c-ef75-4ec2-9cdd-b3f9b35fb630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:06.542933 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7abd7c-ef75-4ec2-9cdd-b3f9b35fb630 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:06.554129 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1427/2864] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 17 14:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 14:47:06.559104 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00687bfa-f6a3-4d8d-b86a-afdd0b9c48ea None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:06.568388 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00687bfa-f6a3-4d8d-b86a-afdd0b9c48ea None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:06.573969 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622b641-1608-4bc7-a621-8c73e7e6c3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:06.574668 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622b641-1608-4bc7-a621-8c73e7e6c3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:06.574954 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622b641-1608-4bc7-a621-8c73e7e6c3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:06.575233 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622b641-1608-4bc7-a621-8c73e7e6c3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:06.575929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622b641-1608-4bc7-a621-8c73e7e6c3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:06.577840 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622b641-1608-4bc7-a621-8c73e7e6c3f1 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:06.603419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1438/2865] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:47:06 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:47:06.608330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7abd7c-ef75-4ec2-9cdd-b3f9b35fb630 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:06.618135 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7abd7c-ef75-4ec2-9cdd-b3f9b35fb630 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:06.673454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ab0dd-6107-41db-962d-9971a96c11bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:06.674127 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ab0dd-6107-41db-962d-9971a96c11bc admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:06.674443 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ab0dd-6107-41db-962d-9971a96c11bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:06.674725 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ab0dd-6107-41db-962d-9971a96c11bc admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:06.675417 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ab0dd-6107-41db-962d-9971a96c11bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:06.677351 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ab0dd-6107-41db-962d-9971a96c11bc admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:06.696685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1428/2866] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:47:06 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:47:06.700956 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622b641-1608-4bc7-a621-8c73e7e6c3f1 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:06.711081 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622b641-1608-4bc7-a621-8c73e7e6c3f1 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:06.715704 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a1df3-a116-4253-8497-5685452e555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:06.716360 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a1df3-a116-4253-8497-5685452e555b admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:06.716641 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a1df3-a116-4253-8497-5685452e555b admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:06.716919 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a1df3-a116-4253-8497-5685452e555b admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:06.717640 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a1df3-a116-4253-8497-5685452e555b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:06.719308 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a1df3-a116-4253-8497-5685452e555b admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:06.729823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1439/2867] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:47:06.733697 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ab0dd-6107-41db-962d-9971a96c11bc admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:06.743564 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ab0dd-6107-41db-962d-9971a96c11bc admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:06.749066 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4443a0-66aa-4210-bcc8-17dc5bc16b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:06.749719 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4443a0-66aa-4210-bcc8-17dc5bc16b77 admin admin] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:06.750004 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4443a0-66aa-4210-bcc8-17dc5bc16b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:06.750326 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4443a0-66aa-4210-bcc8-17dc5bc16b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:06.751085 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4443a0-66aa-4210-bcc8-17dc5bc16b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:06.752713 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4443a0-66aa-4210-bcc8-17dc5bc16b77 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:06.763550 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1429/2868] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:47:06.767507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a1df3-a116-4253-8497-5685452e555b admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:06.777249 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a1df3-a116-4253-8497-5685452e555b admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:06.781744 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e11cd-fef0-46f8-9374-32ebecc0b8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:06.782648 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e11cd-fef0-46f8-9374-32ebecc0b8de admin admin] REQUEST_METHOD: `PUT` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:06.782926 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e11cd-fef0-46f8-9374-32ebecc0b8de admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:06.783197 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e11cd-fef0-46f8-9374-32ebecc0b8de admin admin] PATH_INFO: `/v3/projects/8d520843c82e4d72aaa2dbeee639ad2b/users/12bd4aeee012494abfdc1ac09afc59db/roles/c2cbdedfc238463d91a843ca8e5ac3ca` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:06.798663 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e11cd-fef0-46f8-9374-32ebecc0b8de admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d520843c82e4d72aaa2dbeee639ad2b, user_id=12bd4aeee012494abfdc1ac09afc59db, role_id=c2cbdedfc238463d91a843ca8e5ac3ca)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:06.801362 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e11cd-fef0-46f8-9374-32ebecc0b8de admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:06.814291 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1440/2869] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:47:06 2022] PUT /identity/v3/projects/8d520843c82e4d72aaa2dbeee639ad2b/users/12bd4aeee012494abfdc1ac09afc59db/roles/c2cbdedfc238463d91a843ca8e5ac3ca => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:47:06.819461 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd4efa-fd3d-46e8-8343-22773425b4ba None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:06.819754 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd4efa-fd3d-46e8-8343-22773425b4ba None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:06.820033 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd4efa-fd3d-46e8-8343-22773425b4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:06.837400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-d1dd4efa-fd3d-46e8-8343-22773425b4ba None None] MFA Rules not processed for user `5f9c1bba177246ada74d212c9f20dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:47:06.838706 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-d1dd4efa-fd3d-46e8-8343-22773425b4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:06.896638 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1430/2870] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:47:06.906914 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e11cd-fef0-46f8-9374-32ebecc0b8de admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:06.908707 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-832e11cd-fef0-46f8-9374-32ebecc0b8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:06.966903 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e11cd-fef0-46f8-9374-32ebecc0b8de admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:06.970596 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e8b5c-e05e-4bc3-92ac-74b3eebe8888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:06.971244 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e8b5c-e05e-4bc3-92ac-74b3eebe8888 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:06.971531 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e8b5c-e05e-4bc3-92ac-74b3eebe8888 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:06.971811 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e8b5c-e05e-4bc3-92ac-74b3eebe8888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:06.981753 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e8b5c-e05e-4bc3-92ac-74b3eebe8888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:06.984002 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e8b5c-e05e-4bc3-92ac-74b3eebe8888 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:06.993952 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1441/2871] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:47:10.604944 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e1ebc-8dba-4b2c-bf6c-319417a27adf None None] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:10.605460 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e1ebc-8dba-4b2c-bf6c-319417a27adf None None] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:10.605631 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e1ebc-8dba-4b2c-bf6c-319417a27adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:10.633773 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.auth.core [None req-e66e1ebc-8dba-4b2c-bf6c-319417a27adf None None] MFA Rules not processed for user `12bd4aeee012494abfdc1ac09afc59db`. Rule list: `[]` (Enabled: `True`). {{(pid=79878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:47:10.635011 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e66e1ebc-8dba-4b2c-bf6c-319417a27adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:10.700250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1431/2872] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:47:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:47:10.704717 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e8b5c-e05e-4bc3-92ac-74b3eebe8888 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:10.714903 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e8b5c-e05e-4bc3-92ac-74b3eebe8888 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:10.719535 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87e316-8632-4117-b5bd-1bdc80c62c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:10.720273 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87e316-8632-4117-b5bd-1bdc80c62c05 admin admin] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:10.720624 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87e316-8632-4117-b5bd-1bdc80c62c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:10.720964 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87e316-8632-4117-b5bd-1bdc80c62c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:10.721722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87e316-8632-4117-b5bd-1bdc80c62c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:10.723746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87e316-8632-4117-b5bd-1bdc80c62c05 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:10.753886 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1442/2873] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 17 14:47:10 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:47:10.757908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e1ebc-8dba-4b2c-bf6c-319417a27adf None None] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:10.769438 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e1ebc-8dba-4b2c-bf6c-319417a27adf None None] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:10.828522 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9dfa3-6711-4210-a439-410de77f4ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:10.829330 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9dfa3-6711-4210-a439-410de77f4ebb admin admin] REQUEST_METHOD: `POST` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:10.829611 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9dfa3-6711-4210-a439-410de77f4ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:10.829908 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9dfa3-6711-4210-a439-410de77f4ebb admin admin] PATH_INFO: `/v3/users` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:10.830633 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9dfa3-6711-4210-a439-410de77f4ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:10.832649 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9dfa3-6711-4210-a439-410de77f4ebb admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:10.853312 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1432/2874] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 17 14:47:10 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 14:47:10.857332 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87e316-8632-4117-b5bd-1bdc80c62c05 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:10.867949 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87e316-8632-4117-b5bd-1bdc80c62c05 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:10.873482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be20a3-39fc-4bc9-bf89-23392497242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:10.874201 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be20a3-39fc-4bc9-bf89-23392497242e admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:10.874482 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be20a3-39fc-4bc9-bf89-23392497242e admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:10.874757 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be20a3-39fc-4bc9-bf89-23392497242e admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:10.875492 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be20a3-39fc-4bc9-bf89-23392497242e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:10.877137 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be20a3-39fc-4bc9-bf89-23392497242e admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:10.888866 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1443/2875] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:47:10.893283 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9dfa3-6711-4210-a439-410de77f4ebb admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:10.912202 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9dfa3-6711-4210-a439-410de77f4ebb admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:10.920352 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09880836-1faf-4c10-9e02-9b3de3c34cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:10.921253 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09880836-1faf-4c10-9e02-9b3de3c34cea admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:10.921537 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09880836-1faf-4c10-9e02-9b3de3c34cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:10.921813 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09880836-1faf-4c10-9e02-9b3de3c34cea admin admin] PATH_INFO: `/v3/projects/501f931a7965441ba5f6e7ee13cf72d6/users/7908da8ab6e047d1b994b17bbab017b4/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:10.957386 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09880836-1faf-4c10-9e02-9b3de3c34cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=501f931a7965441ba5f6e7ee13cf72d6, user_id=7908da8ab6e047d1b994b17bbab017b4, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:10.960299 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09880836-1faf-4c10-9e02-9b3de3c34cea admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:10.980008 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1433/2876] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:47:10 2022] PUT /identity/v3/projects/501f931a7965441ba5f6e7ee13cf72d6/users/7908da8ab6e047d1b994b17bbab017b4/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:47:10.984234 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be20a3-39fc-4bc9-bf89-23392497242e admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:10.997759 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be20a3-39fc-4bc9-bf89-23392497242e admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:11.065737 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2bd27-bcdd-441a-b08d-a33ec9ce6dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:11.066538 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2bd27-bcdd-441a-b08d-a33ec9ce6dfe admin admin] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:11.066911 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2bd27-bcdd-441a-b08d-a33ec9ce6dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:11.067254 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2bd27-bcdd-441a-b08d-a33ec9ce6dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:11.068084 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2bd27-bcdd-441a-b08d-a33ec9ce6dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:11.069766 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2bd27-bcdd-441a-b08d-a33ec9ce6dfe admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:11.081504 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1444/2877] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 17 14:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 14:47:11.085673 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09880836-1faf-4c10-9e02-9b3de3c34cea admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:11.097063 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09880836-1faf-4c10-9e02-9b3de3c34cea admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:11.102066 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c153b-46e4-476f-aafc-3d5c4c4d3bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:11.103248 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c153b-46e4-476f-aafc-3d5c4c4d3bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:11.103622 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c153b-46e4-476f-aafc-3d5c4c4d3bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:11.104078 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c153b-46e4-476f-aafc-3d5c4c4d3bd2 admin admin] PATH_INFO: `/v3/projects/501f931a7965441ba5f6e7ee13cf72d6/users/7908da8ab6e047d1b994b17bbab017b4/roles/adb74c52c74c4fac82c692163a0c6d8b` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:11.106528 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c153b-46e4-476f-aafc-3d5c4c4d3bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=501f931a7965441ba5f6e7ee13cf72d6, user_id=7908da8ab6e047d1b994b17bbab017b4, role_id=adb74c52c74c4fac82c692163a0c6d8b)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:11.109198 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c153b-46e4-476f-aafc-3d5c4c4d3bd2 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:11.121204 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1434/2878] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 17 14:47:11 2022] PUT /identity/v3/projects/501f931a7965441ba5f6e7ee13cf72d6/users/7908da8ab6e047d1b994b17bbab017b4/roles/adb74c52c74c4fac82c692163a0c6d8b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:47:15.668639 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf87e4-9ad7-444f-8dd0-b8c9b28ad844 None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:15.669126 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf87e4-9ad7-444f-8dd0-b8c9b28ad844 None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:15.669440 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf87e4-9ad7-444f-8dd0-b8c9b28ad844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:15.704491 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c3cf87e4-9ad7-444f-8dd0-b8c9b28ad844 None None] MFA Rules not processed for user `7908da8ab6e047d1b994b17bbab017b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:47:15.705794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c3cf87e4-9ad7-444f-8dd0-b8c9b28ad844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:15.787340 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1445/2879] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:47:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:47:15.795353 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c153b-46e4-476f-aafc-3d5c4c4d3bd2 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:15.797077 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-c18c153b-46e4-476f-aafc-3d5c4c4d3bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:15.928416 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c153b-46e4-476f-aafc-3d5c4c4d3bd2 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:15.934166 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61020121-5acc-483f-ab1d-2761018c7fa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:15.934856 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61020121-5acc-483f-ab1d-2761018c7fa1 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:15.935140 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61020121-5acc-483f-ab1d-2761018c7fa1 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:15.935415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61020121-5acc-483f-ab1d-2761018c7fa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:15.994798 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61020121-5acc-483f-ab1d-2761018c7fa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:15.996435 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61020121-5acc-483f-ab1d-2761018c7fa1 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:16.006131 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1435/2880] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:47:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:47:37.462793 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e81e2-1eea-4a80-ad50-fa698d85597e None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:37.463334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e81e2-1eea-4a80-ad50-fa698d85597e None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:37.463334 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e81e2-1eea-4a80-ad50-fa698d85597e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:37.481166 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-ff9e81e2-1eea-4a80-ad50-fa698d85597e None None] MFA Rules not processed for user `12bd4aeee012494abfdc1ac09afc59db`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:47:37.482607 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ff9e81e2-1eea-4a80-ad50-fa698d85597e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:37.489673 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1446/2881] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:47:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:47:37.526003 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61020121-5acc-483f-ab1d-2761018c7fa1 service nova] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:37.527415 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-61020121-5acc-483f-ab1d-2761018c7fa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:37.604156 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61020121-5acc-483f-ab1d-2761018c7fa1 service nova] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:37.608567 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84b2f5-7388-4630-9cc9-8202379ec343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:37.609239 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84b2f5-7388-4630-9cc9-8202379ec343 service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:37.609521 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84b2f5-7388-4630-9cc9-8202379ec343 service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:37.609796 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84b2f5-7388-4630-9cc9-8202379ec343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:37.611588 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7e84b2f5-7388-4630-9cc9-8202379ec343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:37.624736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84b2f5-7388-4630-9cc9-8202379ec343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:37.626207 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84b2f5-7388-4630-9cc9-8202379ec343 service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:37.637029 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1436/2882] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:47:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:47:38.356498 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e81e2-1eea-4a80-ad50-fa698d85597e None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:38.357916 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-ff9e81e2-1eea-4a80-ad50-fa698d85597e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:38.414773 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e81e2-1eea-4a80-ad50-fa698d85597e None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:38.418586 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffc0db-b886-45e0-bb52-985aa5fbb8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:38.419393 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffc0db-b886-45e0-bb52-985aa5fbb8ae service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:38.419672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffc0db-b886-45e0-bb52-985aa5fbb8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:38.419945 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffc0db-b886-45e0-bb52-985aa5fbb8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:38.421711 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-26ffc0db-b886-45e0-bb52-985aa5fbb8ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:38.435923 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffc0db-b886-45e0-bb52-985aa5fbb8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:38.437355 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffc0db-b886-45e0-bb52-985aa5fbb8ae service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:38.449028 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1447/2883] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:47:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:47:40.665687 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84b2f5-7388-4630-9cc9-8202379ec343 service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:40.667511 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-7e84b2f5-7388-4630-9cc9-8202379ec343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:40.702255 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84b2f5-7388-4630-9cc9-8202379ec343 service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:40.713462 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fe527-a985-4599-86c9-e5ff26c006d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:40.714907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fe527-a985-4599-86c9-e5ff26c006d1 service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:40.714907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fe527-a985-4599-86c9-e5ff26c006d1 service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:40.714907 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fe527-a985-4599-86c9-e5ff26c006d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:40.717433 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-f55fe527-a985-4599-86c9-e5ff26c006d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:47:40.731400 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fe527-a985-4599-86c9-e5ff26c006d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:40.735306 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fe527-a985-4599-86c9-e5ff26c006d1 service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:40.758736 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1437/2884] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:47:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:47:53.798821 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffc0db-b886-45e0-bb52-985aa5fbb8ae service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:47:53.807374 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffc0db-b886-45e0-bb52-985aa5fbb8ae service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:47:53.811836 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7df8-2fe5-4a64-9930-3b9e4a665b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:47:53.812468 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7df8-2fe5-4a64-9930-3b9e4a665b58 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:47:53.812750 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7df8-2fe5-4a64-9930-3b9e4a665b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:47:53.813027 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7df8-2fe5-4a64-9930-3b9e4a665b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:47:53.822109 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b7df8-2fe5-4a64-9930-3b9e4a665b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:47:53.823567 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b7df8-2fe5-4a64-9930-3b9e4a665b58 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:47:53.832835 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1448/2885] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:47:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:48:03.349540 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fe527-a985-4599-86c9-e5ff26c006d1 service nova] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:48:03.359728 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fe527-a985-4599-86c9-e5ff26c006d1 service nova] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:48:03.363482 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0a9b0-fd78-4855-8089-b5ba6370e959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:48:03.364203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0a9b0-fd78-4855-8089-b5ba6370e959 service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:48:03.364569 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0a9b0-fd78-4855-8089-b5ba6370e959 service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:48:03.364904 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0a9b0-fd78-4855-8089-b5ba6370e959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:48:03.366821 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-03c0a9b0-fd78-4855-8089-b5ba6370e959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:48:03.377205 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0a9b0-fd78-4855-8089-b5ba6370e959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:48:03.378793 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0a9b0-fd78-4855-8089-b5ba6370e959 service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:48:03.387353 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1438/2886] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:48:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:48:04.468761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7df8-2fe5-4a64-9930-3b9e4a665b58 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:48:04.477402 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7df8-2fe5-4a64-9930-3b9e4a665b58 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:48:04.481059 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8759f7-b3a7-4205-abe7-e5b07e6c3f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:48:04.481688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8759f7-b3a7-4205-abe7-e5b07e6c3f33 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:48:04.482508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8759f7-b3a7-4205-abe7-e5b07e6c3f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:48:04.482786 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8759f7-b3a7-4205-abe7-e5b07e6c3f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:48:04.484585 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-5b8759f7-b3a7-4205-abe7-e5b07e6c3f33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:48:04.498845 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8759f7-b3a7-4205-abe7-e5b07e6c3f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:48:04.500236 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8759f7-b3a7-4205-abe7-e5b07e6c3f33 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:48:04.511867 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1449/2887] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:48:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:49:43.110145 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0a9b0-fd78-4855-8089-b5ba6370e959 service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:49:43.119390 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0a9b0-fd78-4855-8089-b5ba6370e959 service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:49:43.123052 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c693a-2030-46b8-8d5e-a7cd6f93579b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:49:43.123687 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c693a-2030-46b8-8d5e-a7cd6f93579b service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:49:43.123999 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c693a-2030-46b8-8d5e-a7cd6f93579b service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:49:43.124280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c693a-2030-46b8-8d5e-a7cd6f93579b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:49:43.126037 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-872c693a-2030-46b8-8d5e-a7cd6f93579b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:49:43.136163 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c693a-2030-46b8-8d5e-a7cd6f93579b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:49:43.137746 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c693a-2030-46b8-8d5e-a7cd6f93579b service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:49:43.145751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1439/2888] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:49:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:49:51.993719 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8759f7-b3a7-4205-abe7-e5b07e6c3f33 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:49:51.996833 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c693a-2030-46b8-8d5e-a7cd6f93579b service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:49:52.006462 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8759f7-b3a7-4205-abe7-e5b07e6c3f33 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:49:52.010656 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c693a-2030-46b8-8d5e-a7cd6f93579b service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:49:52.012660 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30736090-6b3d-4448-81fc-dcc52f8ee5a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:49:52.013558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30736090-6b3d-4448-81fc-dcc52f8ee5a1 service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:49:52.013848 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30736090-6b3d-4448-81fc-dcc52f8ee5a1 service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:49:52.014123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30736090-6b3d-4448-81fc-dcc52f8ee5a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:49:52.016013 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-30736090-6b3d-4448-81fc-dcc52f8ee5a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:49:52.016819 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a095b5-b6c9-40fd-9dcb-d6c58d915d1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:49:52.017498 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a095b5-b6c9-40fd-9dcb-d6c58d915d1f service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:49:52.018512 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a095b5-b6c9-40fd-9dcb-d6c58d915d1f service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:49:52.018969 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a095b5-b6c9-40fd-9dcb-d6c58d915d1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:49:52.021028 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-03a095b5-b6c9-40fd-9dcb-d6c58d915d1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:49:52.034933 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a095b5-b6c9-40fd-9dcb-d6c58d915d1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:49:52.036547 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a095b5-b6c9-40fd-9dcb-d6c58d915d1f service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:49:52.047768 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1440/2889] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:49:52.088198 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30736090-6b3d-4448-81fc-dcc52f8ee5a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:49:52.089816 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30736090-6b3d-4448-81fc-dcc52f8ee5a1 service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:49:52.100133 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1450/2890] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:49:56.941360 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a095b5-b6c9-40fd-9dcb-d6c58d915d1f service nova] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:49:56.951024 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a095b5-b6c9-40fd-9dcb-d6c58d915d1f service nova] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:49:56.954599 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e1808-4732-4189-8b2e-7456b132a14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:49:56.955824 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e1808-4732-4189-8b2e-7456b132a14f service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:49:56.956112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e1808-4732-4189-8b2e-7456b132a14f service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:49:56.956470 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e1808-4732-4189-8b2e-7456b132a14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:49:56.958328 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-887e1808-4732-4189-8b2e-7456b132a14f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:49:57.021289 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e1808-4732-4189-8b2e-7456b132a14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:49:57.022784 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e1808-4732-4189-8b2e-7456b132a14f service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:49:57.032234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1441/2891] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:50:02.902055 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30736090-6b3d-4448-81fc-dcc52f8ee5a1 service nova] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:50:02.903564 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-30736090-6b3d-4448-81fc-dcc52f8ee5a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:50:02.917755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30736090-6b3d-4448-81fc-dcc52f8ee5a1 service nova] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:50:02.922823 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3171aa-225c-455b-af44-ea7ae4fed065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:50:02.924751 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3171aa-225c-455b-af44-ea7ae4fed065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:50:02.925040 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3171aa-225c-455b-af44-ea7ae4fed065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:50:02.925314 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3171aa-225c-455b-af44-ea7ae4fed065 admin admin] PATH_INFO: `/v3/users/e0cfc22625774ef7a09727b27e6c4a49` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:50:02.926579 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3171aa-225c-455b-af44-ea7ae4fed065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0cfc22625774ef7a09727b27e6c4a49)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:50:02.928910 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3171aa-225c-455b-af44-ea7ae4fed065 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:50:02.981419 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-1c3171aa-225c-455b-af44-ea7ae4fed065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0cfc22625774ef7a09727b27e6c4a49'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:02.989174 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-1c3171aa-225c-455b-af44-ea7ae4fed065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0cfc22625774ef7a09727b27e6c4a49'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:02.989858 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-1c3171aa-225c-455b-af44-ea7ae4fed065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0cfc22625774ef7a09727b27e6c4a49'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.005550 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-1c3171aa-225c-455b-af44-ea7ae4fed065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0cfc22625774ef7a09727b27e6c4a49'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.012351 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-1c3171aa-225c-455b-af44-ea7ae4fed065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0cfc22625774ef7a09727b27e6c4a49'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.019205 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1451/2892] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:50:02 2022] DELETE /identity/v3/users/e0cfc22625774ef7a09727b27e6c4a49 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:50:03.199225 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e1808-4732-4189-8b2e-7456b132a14f service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:50:03.210021 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e1808-4732-4189-8b2e-7456b132a14f service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:50:03.270398 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c1f84-1776-40af-93cc-5f26472b04e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:50:03.271280 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c1f84-1776-40af-93cc-5f26472b04e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:50:03.271549 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c1f84-1776-40af-93cc-5f26472b04e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:50:03.271826 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c1f84-1776-40af-93cc-5f26472b04e1 admin admin] PATH_INFO: `/v3/projects/e181973b0aa04527a9991352f1c83adb` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:50:03.273017 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c1f84-1776-40af-93cc-5f26472b04e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e181973b0aa04527a9991352f1c83adb)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:50:03.274989 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c1f84-1776-40af-93cc-5f26472b04e1 admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:50:03.319732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ef7c1f84-1776-40af-93cc-5f26472b04e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e181973b0aa04527a9991352f1c83adb', 'request_id': 'req-ef7c1f84-1776-40af-93cc-5f26472b04e1'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.326112 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ef7c1f84-1776-40af-93cc-5f26472b04e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e181973b0aa04527a9991352f1c83adb', 'request_id': 'req-ef7c1f84-1776-40af-93cc-5f26472b04e1'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.333157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ef7c1f84-1776-40af-93cc-5f26472b04e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e181973b0aa04527a9991352f1c83adb', 'request_id': 'req-ef7c1f84-1776-40af-93cc-5f26472b04e1'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.343543 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ef7c1f84-1776-40af-93cc-5f26472b04e1 admin admin] The token cache is being invalidate because project e181973b0aa04527a9991352f1c83adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:50:03.343859 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ef7c1f84-1776-40af-93cc-5f26472b04e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.344505 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-ef7c1f84-1776-40af-93cc-5f26472b04e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.346108 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1442/2893] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:50:03 2022] DELETE /identity/v3/projects/e181973b0aa04527a9991352f1c83adb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 14:50:03.350095 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3171aa-225c-455b-af44-ea7ae4fed065 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:50:03.351550 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-1c3171aa-225c-455b-af44-ea7ae4fed065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:50:03.365098 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3171aa-225c-455b-af44-ea7ae4fed065 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:50:03.419814 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732c60d-1422-411b-b509-36493f178db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:50:03.420674 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732c60d-1422-411b-b509-36493f178db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:50:03.420959 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732c60d-1422-411b-b509-36493f178db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:50:03.421237 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732c60d-1422-411b-b509-36493f178db9 admin admin] PATH_INFO: `/v3/users/42f7c00438e84441825d19817f1c3644` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:50:03.422453 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732c60d-1422-411b-b509-36493f178db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f7c00438e84441825d19817f1c3644)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:50:03.424399 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732c60d-1422-411b-b509-36493f178db9 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:50:03.469409 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7732c60d-1422-411b-b509-36493f178db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f7c00438e84441825d19817f1c3644'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.476930 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7732c60d-1422-411b-b509-36493f178db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f7c00438e84441825d19817f1c3644'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.477567 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7732c60d-1422-411b-b509-36493f178db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f7c00438e84441825d19817f1c3644'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.489238 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7732c60d-1422-411b-b509-36493f178db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f7c00438e84441825d19817f1c3644'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.495874 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-7732c60d-1422-411b-b509-36493f178db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f7c00438e84441825d19817f1c3644'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.501755 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1452/2894] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:50:03 2022] DELETE /identity/v3/users/42f7c00438e84441825d19817f1c3644 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:50:03.670616 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c1f84-1776-40af-93cc-5f26472b04e1 admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:50:03.672057 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-ef7c1f84-1776-40af-93cc-5f26472b04e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:50:03.686799 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c1f84-1776-40af-93cc-5f26472b04e1 admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:50:03.744224 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d418d33-2967-4729-8c71-6455d046ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:50:03.745016 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d418d33-2967-4729-8c71-6455d046ee3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:50:03.745302 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d418d33-2967-4729-8c71-6455d046ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:50:03.745582 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d418d33-2967-4729-8c71-6455d046ee3c admin admin] PATH_INFO: `/v3/projects/3b80f94967f44c50b1655dec863c8681` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:50:03.746802 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d418d33-2967-4729-8c71-6455d046ee3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b80f94967f44c50b1655dec863c8681)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:50:03.748738 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d418d33-2967-4729-8c71-6455d046ee3c admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:50:03.794820 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8d418d33-2967-4729-8c71-6455d046ee3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b80f94967f44c50b1655dec863c8681', 'request_id': 'req-8d418d33-2967-4729-8c71-6455d046ee3c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.800787 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8d418d33-2967-4729-8c71-6455d046ee3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b80f94967f44c50b1655dec863c8681', 'request_id': 'req-8d418d33-2967-4729-8c71-6455d046ee3c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.808655 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8d418d33-2967-4729-8c71-6455d046ee3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b80f94967f44c50b1655dec863c8681', 'request_id': 'req-8d418d33-2967-4729-8c71-6455d046ee3c'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.818999 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8d418d33-2967-4729-8c71-6455d046ee3c admin admin] The token cache is being invalidate because project 3b80f94967f44c50b1655dec863c8681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:50:03.819304 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8d418d33-2967-4729-8c71-6455d046ee3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.819913 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-8d418d33-2967-4729-8c71-6455d046ee3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:50:03.821689 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1443/2895] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:50:03 2022] DELETE /identity/v3/projects/3b80f94967f44c50b1655dec863c8681 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:50:15.888154 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04eb7bd-9d18-4e08-bb62-a8d5bf10ebbf None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:50:15.888684 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04eb7bd-9d18-4e08-bb62-a8d5bf10ebbf None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:50:15.888826 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04eb7bd-9d18-4e08-bb62-a8d5bf10ebbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:50:15.909772 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-c04eb7bd-9d18-4e08-bb62-a8d5bf10ebbf None None] MFA Rules not processed for user `12bd4aeee012494abfdc1ac09afc59db`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:50:15.911123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c04eb7bd-9d18-4e08-bb62-a8d5bf10ebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:50:15.968342 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1453/2896] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:50:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:50:16.272414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d418d33-2967-4729-8c71-6455d046ee3c admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:50:16.273821 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-8d418d33-2967-4729-8c71-6455d046ee3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:50:16.329820 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d418d33-2967-4729-8c71-6455d046ee3c admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:50:16.333630 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0773d-df63-4787-80be-00fe5b8c0e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:50:16.334291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0773d-df63-4787-80be-00fe5b8c0e1d service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:50:16.334572 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0773d-df63-4787-80be-00fe5b8c0e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:50:16.334846 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0773d-df63-4787-80be-00fe5b8c0e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:50:16.336547 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-76f0773d-df63-4787-80be-00fe5b8c0e1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:50:16.345686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0773d-df63-4787-80be-00fe5b8c0e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:50:16.347755 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0773d-df63-4787-80be-00fe5b8c0e1d service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:50:16.355509 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1444/2897] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:50:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:50:17.794981 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04eb7bd-9d18-4e08-bb62-a8d5bf10ebbf None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:50:17.796520 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-c04eb7bd-9d18-4e08-bb62-a8d5bf10ebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:50:17.867558 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04eb7bd-9d18-4e08-bb62-a8d5bf10ebbf None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:50:17.872685 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb237f-50aa-4ed7-88e5-a157f8fc3b54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fad90f42ebfe43eb8256611a88df87ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:50:17.873390 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb237f-50aa-4ed7-88e5-a157f8fc3b54 service placement] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:50:17.873667 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb237f-50aa-4ed7-88e5-a157f8fc3b54 service placement] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:50:17.873944 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb237f-50aa-4ed7-88e5-a157f8fc3b54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:50:17.875745 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-52bb237f-50aa-4ed7-88e5-a157f8fc3b54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:50:17.887692 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb237f-50aa-4ed7-88e5-a157f8fc3b54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:50:17.889255 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb237f-50aa-4ed7-88e5-a157f8fc3b54 service placement] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:50:17.899553 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1454/2898] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:50:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:50:21.351800 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0773d-df63-4787-80be-00fe5b8c0e1d service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:50:21.353214 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-76f0773d-df63-4787-80be-00fe5b8c0e1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:50:21.368491 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0773d-df63-4787-80be-00fe5b8c0e1d service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:50:21.375120 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e489a6-3e01-41b1-b5d2-eb6bcf93d701 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fad90f42ebfe43eb8256611a88df87ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:50:21.375751 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e489a6-3e01-41b1-b5d2-eb6bcf93d701 service placement] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:50:21.376031 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e489a6-3e01-41b1-b5d2-eb6bcf93d701 service placement] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:50:21.376307 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e489a6-3e01-41b1-b5d2-eb6bcf93d701 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:50:21.378053 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e1e489a6-3e01-41b1-b5d2-eb6bcf93d701 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:50:21.389000 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e489a6-3e01-41b1-b5d2-eb6bcf93d701 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:50:21.390605 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e489a6-3e01-41b1-b5d2-eb6bcf93d701 service placement] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:50:21.400857 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1445/2899] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:50:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:50:34.412995 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb237f-50aa-4ed7-88e5-a157f8fc3b54 service placement] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:50:34.414451 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-52bb237f-50aa-4ed7-88e5-a157f8fc3b54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:50:34.490988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb237f-50aa-4ed7-88e5-a157f8fc3b54 service placement] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:50:34.496497 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6b33b-4bf9-4390-88d6-083b9535a79f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:50:34.497163 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6b33b-4bf9-4390-88d6-083b9535a79f service nova] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:50:34.497447 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6b33b-4bf9-4390-88d6-083b9535a79f service nova] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:50:34.497722 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6b33b-4bf9-4390-88d6-083b9535a79f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:50:34.499560 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-11b6b33b-4bf9-4390-88d6-083b9535a79f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:50:34.512508 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6b33b-4bf9-4390-88d6-083b9535a79f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:50:34.514132 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6b33b-4bf9-4390-88d6-083b9535a79f service nova] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:50:34.525610 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1455/2900] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:50:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:52:27.961004 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e489a6-3e01-41b1-b5d2-eb6bcf93d701 service placement] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:52:27.962686 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-e1e489a6-3e01-41b1-b5d2-eb6bcf93d701 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:52:28.018131 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e489a6-3e01-41b1-b5d2-eb6bcf93d701 service placement] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:52:28.021732 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814590b-03be-4029-88d1-16512bc9f01b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:52:28.022924 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814590b-03be-4029-88d1-16512bc9f01b service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:52:28.023203 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814590b-03be-4029-88d1-16512bc9f01b service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:52:28.023480 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814590b-03be-4029-88d1-16512bc9f01b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:52:28.025234 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-2814590b-03be-4029-88d1-16512bc9f01b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:52:28.035685 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814590b-03be-4029-88d1-16512bc9f01b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:52:28.037102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814590b-03be-4029-88d1-16512bc9f01b service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:52:28.046665 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1446/2901] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:52:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:52:39.176008 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afb90b-27b4-4a5b-841b-502a7a783f7a None None] REQUEST_METHOD: `POST` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:52:39.176559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afb90b-27b4-4a5b-841b-502a7a783f7a None None] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:52:39.176559 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afb90b-27b4-4a5b-841b-502a7a783f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:52:39.193682 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.auth.core [None req-a7afb90b-27b4-4a5b-841b-502a7a783f7a None None] MFA Rules not processed for user `12bd4aeee012494abfdc1ac09afc59db`. Rule list: `[]` (Enabled: `True`). {{(pid=79877) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 14:52:39.196013 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a7afb90b-27b4-4a5b-841b-502a7a783f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:52:39.202899 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1456/2902] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 17 14:52:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 14:52:39.237042 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814590b-03be-4029-88d1-16512bc9f01b service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:52:39.246823 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814590b-03be-4029-88d1-16512bc9f01b service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:52:39.250651 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaebc62-7539-4278-b9d4-cbe29e8a63ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7fd6429fee94c89a6a29467b014ec5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:52:39.251289 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaebc62-7539-4278-b9d4-cbe29e8a63ed service cinder] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:52:39.251568 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaebc62-7539-4278-b9d4-cbe29e8a63ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:52:39.251837 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaebc62-7539-4278-b9d4-cbe29e8a63ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:52:39.253583 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-dcaebc62-7539-4278-b9d4-cbe29e8a63ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:52:39.267152 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaebc62-7539-4278-b9d4-cbe29e8a63ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:52:39.268576 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaebc62-7539-4278-b9d4-cbe29e8a63ed service cinder] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:52:39.280065 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1447/2903] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:52:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:52:40.994115 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afb90b-27b4-4a5b-841b-502a7a783f7a None None] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:52:40.995563 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-a7afb90b-27b4-4a5b-841b-502a7a783f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:52:41.007856 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afb90b-27b4-4a5b-841b-502a7a783f7a None None] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:52:41.011855 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37d5f0-b4a5-4627-a7aa-c623d79da079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:52:41.012489 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37d5f0-b4a5-4627-a7aa-c623d79da079 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:52:41.012771 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37d5f0-b4a5-4627-a7aa-c623d79da079 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:52:41.013043 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37d5f0-b4a5-4627-a7aa-c623d79da079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:52:41.014761 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-9e37d5f0-b4a5-4627-a7aa-c623d79da079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:52:41.028988 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37d5f0-b4a5-4627-a7aa-c623d79da079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:52:41.030454 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37d5f0-b4a5-4627-a7aa-c623d79da079 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:52:41.045337 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1457/2904] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:52:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:52:44.105026 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaebc62-7539-4278-b9d4-cbe29e8a63ed service cinder] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:52:44.119499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaebc62-7539-4278-b9d4-cbe29e8a63ed service cinder] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:52:44.131653 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8357ca-2563-4d90-86b6-eb30f0d86f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f443d2ca1534249bb2c4096300ddffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:52:44.132569 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8357ca-2563-4d90-86b6-eb30f0d86f2c service nova] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:52:44.132864 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8357ca-2563-4d90-86b6-eb30f0d86f2c service nova] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:52:44.133146 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8357ca-2563-4d90-86b6-eb30f0d86f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:52:44.135291 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-bb8357ca-2563-4d90-86b6-eb30f0d86f2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:52:44.151928 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8357ca-2563-4d90-86b6-eb30f0d86f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:52:44.153769 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8357ca-2563-4d90-86b6-eb30f0d86f2c service nova] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:52:44.166991 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1448/2905] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:52:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:52:59.863681 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37d5f0-b4a5-4627-a7aa-c623d79da079 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:52:59.872795 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37d5f0-b4a5-4627-a7aa-c623d79da079 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:52:59.876348 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96206b-922f-4a57-99a4-124abdf5ab89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:52:59.876972 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96206b-922f-4a57-99a4-124abdf5ab89 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:52:59.877252 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96206b-922f-4a57-99a4-124abdf5ab89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:52:59.877794 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96206b-922f-4a57-99a4-124abdf5ab89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:52:59.879603 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-2a96206b-922f-4a57-99a4-124abdf5ab89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:52:59.939105 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96206b-922f-4a57-99a4-124abdf5ab89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:52:59.940516 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96206b-922f-4a57-99a4-124abdf5ab89 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:52:59.950397 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1458/2906] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:52:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:54:49.129471 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8357ca-2563-4d90-86b6-eb30f0d86f2c service nova] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:54:49.167587 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8357ca-2563-4d90-86b6-eb30f0d86f2c service nova] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:54:49.171251 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa87ea9-7f77-4bf9-924e-03833cd1278e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:54:49.171895 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa87ea9-7f77-4bf9-924e-03833cd1278e service neutron] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:54:49.172177 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa87ea9-7f77-4bf9-924e-03833cd1278e service neutron] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:54:49.172455 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa87ea9-7f77-4bf9-924e-03833cd1278e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:54:49.174250 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-daa87ea9-7f77-4bf9-924e-03833cd1278e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:54:49.205221 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa87ea9-7f77-4bf9-924e-03833cd1278e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:54:49.206712 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa87ea9-7f77-4bf9-924e-03833cd1278e service neutron] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:54:49.215260 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1449/2907] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:54:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:55:06.520929 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96206b-922f-4a57-99a4-124abdf5ab89 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:55:06.549801 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96206b-922f-4a57-99a4-124abdf5ab89 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:55:06.553449 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a80e-ee24-469c-befc-815637c543a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b03ca44da654c3a9a5d9762b8eee189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:55:06.554080 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a80e-ee24-469c-befc-815637c543a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:55:06.554394 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a80e-ee24-469c-befc-815637c543a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:55:06.554672 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a80e-ee24-469c-befc-815637c543a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:55:06.556401 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-3b75a80e-ee24-469c-befc-815637c543a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:55:06.658412 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75a80e-ee24-469c-befc-815637c543a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:55:06.659839 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75a80e-ee24-469c-befc-815637c543a7 service neutron] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:55:06.678767 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1459/2908] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 14:55:12.889454 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa87ea9-7f77-4bf9-924e-03833cd1278e service neutron] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:55:12.892354 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-daa87ea9-7f77-4bf9-924e-03833cd1278e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:55:12.908885 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa87ea9-7f77-4bf9-924e-03833cd1278e service neutron] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:55:12.916157 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f81862-2f16-4f4d-a6dd-3b34e3585bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:55:12.917099 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f81862-2f16-4f4d-a6dd-3b34e3585bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:55:12.917381 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f81862-2f16-4f4d-a6dd-3b34e3585bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:55:12.917659 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f81862-2f16-4f4d-a6dd-3b34e3585bdc admin admin] PATH_INFO: `/v3/users/12bd4aeee012494abfdc1ac09afc59db` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:55:12.918914 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f81862-2f16-4f4d-a6dd-3b34e3585bdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=12bd4aeee012494abfdc1ac09afc59db)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:55:12.920866 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f81862-2f16-4f4d-a6dd-3b34e3585bdc admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:55:12.968520 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a4f81862-2f16-4f4d-a6dd-3b34e3585bdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12bd4aeee012494abfdc1ac09afc59db'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:12.975185 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a4f81862-2f16-4f4d-a6dd-3b34e3585bdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12bd4aeee012494abfdc1ac09afc59db'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:12.975851 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a4f81862-2f16-4f4d-a6dd-3b34e3585bdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12bd4aeee012494abfdc1ac09afc59db'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:12.987125 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a4f81862-2f16-4f4d-a6dd-3b34e3585bdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12bd4aeee012494abfdc1ac09afc59db'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:12.995022 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-a4f81862-2f16-4f4d-a6dd-3b34e3585bdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12bd4aeee012494abfdc1ac09afc59db'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.001406 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1450/2909] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:55:12 2022] DELETE /identity/v3/users/12bd4aeee012494abfdc1ac09afc59db => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:55:13.175292 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a80e-ee24-469c-befc-815637c543a7 service neutron] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:55:13.190942 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a80e-ee24-469c-befc-815637c543a7 service neutron] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:55:13.252724 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f5d42-312f-466f-a9c0-afbf72104e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:55:13.253720 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f5d42-312f-466f-a9c0-afbf72104e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:55:13.254099 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f5d42-312f-466f-a9c0-afbf72104e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:55:13.254473 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f5d42-312f-466f-a9c0-afbf72104e32 admin admin] PATH_INFO: `/v3/projects/8d520843c82e4d72aaa2dbeee639ad2b` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:55:13.255770 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f5d42-312f-466f-a9c0-afbf72104e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d520843c82e4d72aaa2dbeee639ad2b)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:55:13.257716 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f5d42-312f-466f-a9c0-afbf72104e32 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:55:13.305507 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-fc2f5d42-312f-466f-a9c0-afbf72104e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d520843c82e4d72aaa2dbeee639ad2b', 'request_id': 'req-fc2f5d42-312f-466f-a9c0-afbf72104e32'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.312123 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-fc2f5d42-312f-466f-a9c0-afbf72104e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d520843c82e4d72aaa2dbeee639ad2b', 'request_id': 'req-fc2f5d42-312f-466f-a9c0-afbf72104e32'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.319247 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-fc2f5d42-312f-466f-a9c0-afbf72104e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d520843c82e4d72aaa2dbeee639ad2b', 'request_id': 'req-fc2f5d42-312f-466f-a9c0-afbf72104e32'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.329920 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-fc2f5d42-312f-466f-a9c0-afbf72104e32 admin admin] The token cache is being invalidate because project 8d520843c82e4d72aaa2dbeee639ad2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:55:13.330230 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-fc2f5d42-312f-466f-a9c0-afbf72104e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.330870 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-fc2f5d42-312f-466f-a9c0-afbf72104e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.332380 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1460/2910] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:55:13 2022] DELETE /identity/v3/projects/8d520843c82e4d72aaa2dbeee639ad2b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:55:13.336414 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f81862-2f16-4f4d-a6dd-3b34e3585bdc admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:55:13.337812 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-a4f81862-2f16-4f4d-a6dd-3b34e3585bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:55:13.350696 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f81862-2f16-4f4d-a6dd-3b34e3585bdc admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:55:13.409020 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e5eb0-29e0-42ae-8304-a7f67875c75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:55:13.409887 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e5eb0-29e0-42ae-8304-a7f67875c75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:55:13.410167 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e5eb0-29e0-42ae-8304-a7f67875c75d admin admin] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:55:13.410474 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e5eb0-29e0-42ae-8304-a7f67875c75d admin admin] PATH_INFO: `/v3/users/7908da8ab6e047d1b994b17bbab017b4` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:55:13.411648 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e5eb0-29e0-42ae-8304-a7f67875c75d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7908da8ab6e047d1b994b17bbab017b4)` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:55:13.413552 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e5eb0-29e0-42ae-8304-a7f67875c75d admin admin] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:55:13.461579 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-9a1e5eb0-29e0-42ae-8304-a7f67875c75d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7908da8ab6e047d1b994b17bbab017b4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.468408 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-9a1e5eb0-29e0-42ae-8304-a7f67875c75d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7908da8ab6e047d1b994b17bbab017b4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.469087 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-9a1e5eb0-29e0-42ae-8304-a7f67875c75d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7908da8ab6e047d1b994b17bbab017b4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.481362 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-9a1e5eb0-29e0-42ae-8304-a7f67875c75d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7908da8ab6e047d1b994b17bbab017b4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.488409 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.notifications [None req-9a1e5eb0-29e0-42ae-8304-a7f67875c75d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7908da8ab6e047d1b994b17bbab017b4'} {{(pid=79878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.494303 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1451/2911] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 17 14:55:13 2022] DELETE /identity/v3/users/7908da8ab6e047d1b994b17bbab017b4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:55:13.666321 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f5d42-312f-466f-a9c0-afbf72104e32 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:55:13.668639 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-fc2f5d42-312f-466f-a9c0-afbf72104e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:55:13.681234 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f5d42-312f-466f-a9c0-afbf72104e32 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:55:13.738122 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4594f93-e034-4a36-819e-a7cfbad6d755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f9c1bba177246ada74d212c9f20dadb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7c1abe20ef64ed9a7be8720622420f6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:55:13.738999 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4594f93-e034-4a36-819e-a7cfbad6d755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:55:13.739278 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4594f93-e034-4a36-819e-a7cfbad6d755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:55:13.739549 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4594f93-e034-4a36-819e-a7cfbad6d755 admin admin] PATH_INFO: `/v3/projects/501f931a7965441ba5f6e7ee13cf72d6` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:55:13.740746 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4594f93-e034-4a36-819e-a7cfbad6d755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=501f931a7965441ba5f6e7ee13cf72d6)` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:55:13.742688 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4594f93-e034-4a36-819e-a7cfbad6d755 admin admin] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:55:13.786408 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f4594f93-e034-4a36-819e-a7cfbad6d755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501f931a7965441ba5f6e7ee13cf72d6', 'request_id': 'req-f4594f93-e034-4a36-819e-a7cfbad6d755'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.792871 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f4594f93-e034-4a36-819e-a7cfbad6d755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501f931a7965441ba5f6e7ee13cf72d6', 'request_id': 'req-f4594f93-e034-4a36-819e-a7cfbad6d755'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.800005 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f4594f93-e034-4a36-819e-a7cfbad6d755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501f931a7965441ba5f6e7ee13cf72d6', 'request_id': 'req-f4594f93-e034-4a36-819e-a7cfbad6d755'} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.810725 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f4594f93-e034-4a36-819e-a7cfbad6d755 admin admin] The token cache is being invalidate because project 501f931a7965441ba5f6e7ee13cf72d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79877) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 14:55:13.811009 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f4594f93-e034-4a36-819e-a7cfbad6d755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.811644 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.notifications [None req-f4594f93-e034-4a36-819e-a7cfbad6d755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79877) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 14:55:13.813151 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1461/2912] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 17 14:55:13 2022] DELETE /identity/v3/projects/501f931a7965441ba5f6e7ee13cf72d6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 14:55:42.436364 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e5eb0-29e0-42ae-8304-a7f67875c75d admin admin] Authenticating user token {{(pid=79878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 14:55:42.437850 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-9a1e5eb0-29e0-42ae-8304-a7f67875c75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:55:42.526132 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e5eb0-29e0-42ae-8304-a7f67875c75d admin admin] Validating token access rules against request {{(pid=79878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 14:55:42.583442 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55da7a-ec59-4c91-9b4b-efa406324bfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fad90f42ebfe43eb8256611a88df87ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 14:55:42.584102 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55da7a-ec59-4c91-9b4b-efa406324bfb service placement] REQUEST_METHOD: `GET` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 14:55:42.584389 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55da7a-ec59-4c91-9b4b-efa406324bfb service placement] SCRIPT_NAME: `/identity` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 14:55:42.584669 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55da7a-ec59-4c91-9b4b-efa406324bfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 14:55:42.586499 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.fernet_utils [None req-1f55da7a-ec59-4c91-9b4b-efa406324bfb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 14:55:42.597655 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55da7a-ec59-4c91-9b4b-efa406324bfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 14:55:42.599273 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55da7a-ec59-4c91-9b4b-efa406324bfb service placement] RBAC: Authorization granted {{(pid=79878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 14:55:42.609788 dv-cinder-835881-12-iscsi devstack@keystone.service[79878]: [pid: 79878|app: 0|req: 1452/2913] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 14:55:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 15:00:45.357159 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4594f93-e034-4a36-819e-a7cfbad6d755 admin admin] Authenticating user token {{(pid=79877) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 15:00:45.358593 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.fernet_utils [None req-f4594f93-e034-4a36-819e-a7cfbad6d755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79877) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 15:00:45.373493 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4594f93-e034-4a36-819e-a7cfbad6d755 admin admin] Validating token access rules against request {{(pid=79877) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 15:00:45.378562 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6217d88-8281-4aec-b30e-902c4c503b0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fad90f42ebfe43eb8256611a88df87ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ac7d1119033458393ad6f78fc0df7a3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79877) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 15:00:45.379200 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6217d88-8281-4aec-b30e-902c4c503b0a service placement] REQUEST_METHOD: `GET` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 15:00:45.379486 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6217d88-8281-4aec-b30e-902c4c503b0a service placement] SCRIPT_NAME: `/identity` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 15:00:45.379764 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6217d88-8281-4aec-b30e-902c4c503b0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79877) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 15:00:45.388365 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6217d88-8281-4aec-b30e-902c4c503b0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 15:00:45.389955 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6217d88-8281-4aec-b30e-902c4c503b0a service placement] RBAC: Authorization granted {{(pid=79877) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 15:00:45.400610 dv-cinder-835881-12-iscsi devstack@keystone.service[79877]: [pid: 79877|app: 0|req: 1462/2914] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 17 15:00:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)